SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 91–100 of 1135 papers

TitleStatusHype
Causal Head Gating: A Framework for Interpreting Roles of Attention Heads in Transformers—0
What Prompts Don't Say: Understanding and Managing Underspecification in LLM PromptsCode0
Rethinking Predictive Modeling for LLM Routing: When Simple kNN Beats Complex Learned Routers—0
Multi-Level Aware Preference Learning: Enhancing RLHF for Complex Multi-Instruction Tasks—0
KIT's Offline Speech Translation and Instruction Following Submission for IWSLT 2025—0
CompBench: Benchmarking Complex Instruction-guided Image Editing—0
Internal Causal Mechanisms Robustly Predict Language Model Out-of-Distribution BehaviorsCode0
Enhancing Complex Instruction Following for Large Language Models with Mixture-of-Contexts Fine-tuning—0
GIE-Bench: Towards Grounded Evaluation for Text-Guided Image EditingCode1
HelpSteer3-Preference: Open Human-Annotated Preference Data across Diverse Tasks and Languages—0
Show:102550
← PrevPage 10 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified