SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 7180 of 1135 papers

TitleStatusHype
IDA-Bench: Evaluating LLMs on Interactive Guided Data AnalysisCode1
ToDi: Token-wise Distillation via Fine-Grained Divergence Control0
In-Context Watermarks for Large Language Models0
CASTILLO: Characterizing Response Length Distributions of Large Language ModelsCode0
LIFEBench: Evaluating Length Instruction Following in Large Language ModelsCode0
IFEval-Audio: Benchmarking Instruction-Following Capability in Audio-based Large Language ModelsCode3
LaViDa: A Large Diffusion Language Model for Multimodal UnderstandingCode3
AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic ScenariosCode1
Sparse Activation Editing for Reliable Instruction Following in Narratives0
ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Models0
Show:102550
← PrevPage 8 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified