SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 451460 of 1135 papers

TitleStatusHype
Instruction Following without Instruction TuningCode1
Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language ModelsCode0
ChemEval: A Comprehensive Multi-Level Chemical Evaluation for Large Language ModelsCode1
Eliciting Instruction-tuned Code Language Models' Capabilities to Utilize Auxiliary Function for Code Generation0
Unlocking Reasoning Potential in Large Langauge Models by Scaling Code-form PlanningCode1
CamelEval: Advancing Culturally Aligned Arabic Language Models and Benchmarks0
SIFToM: Robust Spoken Instruction Following through Theory of Mind0
Exploring the Trade-Offs: Quantization Methods, Task Difficulty, and Model Size in Large Language Models From Edge to GiantCode0
Enhancing Low-Resource Language and Instruction Following Capabilities of Audio Language Models0
Diversify and Conquer: Diversity-Centric Data Selection with Iterative RefinementCode1
Show:102550
← PrevPage 46 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified