SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 76100 of 1135 papers

TitleStatusHype
ToDi: Token-wise Distillation via Fine-Grained Divergence Control0
AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic ScenariosCode1
In-Context Watermarks for Large Language Models0
ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Models0
Sparse Activation Editing for Reliable Instruction Following in Narratives0
Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective0
ThinkLess: A Training-Free Inference-Efficient Method for Reducing Reasoning Redundancy0
FlowKV: Enhancing Multi-Turn Conversational Coherence in LLMs via Isolated Key-Value Cache Management0
Hunyuan-TurboS: Advancing Large Language Models through Mamba-Transformer Synergy and Adaptive Chain-of-Thought0
Joint Flashback Adaptation for Forgetting-Resistant Instruction Tuning0
Scaling Reasoning, Losing Control: Evaluating Instruction Following in Large Reasoning ModelsCode1
DecIF: Improving Instruction-Following through Meta-Decomposition0
Ground-V: Teaching VLMs to Ground Complex Instructions in Pixels0
Two Experts Are All You Need for Steering Thinking: Reinforcing Cognitive Effort in MoE Reasoning Models Without Additional Training0
Domain Adaptation of VLM for Soccer Video Understanding0
Causal Head Gating: A Framework for Interpreting Roles of Attention Heads in Transformers0
What Prompts Don't Say: Understanding and Managing Underspecification in LLM PromptsCode0
Rethinking Predictive Modeling for LLM Routing: When Simple kNN Beats Complex Learned Routers0
Multi-Level Aware Preference Learning: Enhancing RLHF for Complex Multi-Instruction Tasks0
KIT's Offline Speech Translation and Instruction Following Submission for IWSLT 20250
CompBench: Benchmarking Complex Instruction-guided Image Editing0
Internal Causal Mechanisms Robustly Predict Language Model Out-of-Distribution BehaviorsCode0
Enhancing Complex Instruction Following for Large Language Models with Mixture-of-Contexts Fine-tuning0
GIE-Bench: Towards Grounded Evaluation for Text-Guided Image EditingCode1
HelpSteer3-Preference: Open Human-Annotated Preference Data across Diverse Tasks and Languages0
Show:102550
← PrevPage 4 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified