SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 321330 of 1135 papers

TitleStatusHype
MM-Instruct: Generated Visual Instructions for Large Multimodal Model AlignmentCode1
Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language ModelsCode1
MathChat: Benchmarking Mathematical Reasoning and Instruction Following in Multi-Turn InteractionsCode1
Agri-LLaVA: Knowledge-Infused Large Multimodal Assistant on Agricultural Pests and DiseasesCode1
IDA-Bench: Evaluating LLMs on Interactive Guided Data AnalysisCode1
ChatBug: A Common Vulnerability of Aligned LLMs Induced by Chat TemplatesCode1
Evaluating LLMs at Detecting Errors in LLM ResponsesCode1
Evaluating Large Language Models at Evaluating Instruction FollowingCode1
AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic ScenariosCode1
Evaluating Correctness and Faithfulness of Instruction-Following Models for Question AnsweringCode1
Show:102550
← PrevPage 33 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified