SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 211220 of 1135 papers

TitleStatusHype
Adversarial Paraphrasing: A Universal Attack for Humanizing AI-Generated TextCode1
RewardAnything: Generalizable Principle-Following Reward ModelsCode1
Incentivizing Reasoning for Advanced Instruction-Following of Large Language ModelsCode1
Don't Reinvent the Wheel: Efficient Instruction-Following Text Embedding based on Guided Space TransformationCode1
Speech-IFEval: Evaluating Instruction-Following and Quantifying Catastrophic Forgetting in Speech-Aware Language ModelsCode1
STRICT: Stress Test of Rendering Images Containing TextCode1
OmniGenBench: A Benchmark for Omnipotent Multimodal Generation across 50+ TasksCode1
IDA-Bench: Evaluating LLMs on Interactive Guided Data AnalysisCode1
AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic ScenariosCode1
Scaling Reasoning, Losing Control: Evaluating Instruction Following in Large Reasoning ModelsCode1
Show:102550
← PrevPage 22 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified