SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 276–300 of 1135 papers

TitleStatusHype
Instruction Following without Instruction TuningCode1
ChemEval: A Comprehensive Multi-Level Chemical Evaluation for Large Language ModelsCode1
Unlocking Reasoning Potential in Large Langauge Models by Scaling Code-form PlanningCode1
Diversify and Conquer: Diversity-Centric Data Selection with Iterative RefinementCode1
LongGenBench: Benchmarking Long-Form Generation in Long Context LLMsCode1
Ex3: Automatic Novel Writing by Extracting, Excelsior and ExpandingCode1
LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMsCode1
Bridging and Modeling Correlations in Pairwise Data for Direct Preference OptimizationCode1
Investigating Instruction Tuning Large Language Models on GraphsCode1
WalledEval: A Comprehensive Safety Evaluation Toolkit for Large Language ModelsCode1
Extend Model Merging from Fine-Tuned to Pre-Trained Large Language Models via Weight DisentanglementCode1
ReALFRED: An Embodied Instruction Following Benchmark in Photo-Realistic EnvironmentsCode1
Efficient Inference of Vision Instruction-Following Models with Elastic CacheCode1
DISCO: Embodied Navigation and Interaction via Differentiable Scene Semantics and Dual-level ControlCode1
EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote SensingCode1
SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic FinetuningCode1
LIONs: An Empirically Optimized Approach to Align Language ModelsCode1
Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMsCode1
MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMsCode1
The SIFo Benchmark: Investigating the Sequential Instruction Following Ability of Large Language ModelsCode1
MM-Instruct: Generated Visual Instructions for Large Multimodal Model AlignmentCode1
Suri: Multi-constraint Instruction Following for Long-form Text GenerationCode1
AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language ModelsCode1
RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository ScaleCode1
Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMsCode1
Show:102550
← PrevPage 12 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified