SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 626–650 of 1135 papers

TitleStatusHype
ChartMind: A Comprehensive Benchmark for Complex Real-world Multimodal Chart Question Answering—0
Causal Head Gating: A Framework for Interpreting Roles of Attention Heads in Transformers—0
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization—0
MIDB: Multilingual Instruction Data Booster for Enhancing Multilingual Instruction Synthesis—0
A Comparative Study between Full-Parameter and LoRA-based Fine-Tuning on Chinese Instruction Data for Instruction Following Large Language Model—0
Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models—0
Mimicking User Data: On Mitigating Fine-Tuning Risks in Closed Large Language Models—0
Case Study: Fine-tuning Small Language Models for Accurate and Private CWE Detection in Python Code—0
MiningGPT -- A Domain-Specific Large Language Model for the Mining Industry—0
MinMo: A Multimodal Large Language Model for Seamless Voice Interaction—0
Mitigating Dialogue Hallucination for Large Vision Language Models via Adversarial Instruction Tuning—0
Mitigating the Influence of Distractor Tasks in LMs with Prior-Aware Decoding—0
Mixture of Cluster-conditional LoRA Experts for Vision-language Instruction Tuning—0
Mixture of Weight-shared Heterogeneous Group Attention Experts for Dynamic Token-wise KV Optimization—0
Capybara-OMNI: An Efficient Paradigm for Building Omni-Modal Language Models—0
WoLF: Wide-scope Large Language Model Framework for CXR Understanding—0
Towards Understanding the Fragility of Multilingual LLMs against Fine-Tuning Attacks—0
MMMT-IF: A Challenging Multimodal Multi-Turn Instruction Following Benchmark—0
CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues—0
Towards Vision Enhancing LLMs: Empowering Multimodal Knowledge Storage and Sharing in LLMs—0
MMTEB: Massive Multilingual Text Embedding Benchmark—0
TOWER: Tree Organized Weighting for Evaluating Complex Instructions—0
MoDA: Modulation Adapter for Fine-Grained Visual Grounding in Instructional MLLMs—0
Zero-shot Task Adaptation using Natural Language—0
Modular Framework for Visuomotor Language Grounding—0
Show:102550
← PrevPage 26 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified