SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 291300 of 1135 papers

TitleStatusHype
CodeIF: Benchmarking the Instruction-Following Capabilities of Large Language Models for Code GenerationCode1
ChemEval: A Comprehensive Multi-Level Chemical Evaluation for Large Language ModelsCode1
A Survey on Data Selection for LLM Instruction TuningCode1
Alexa Arena: A User-Centric Interactive Platform for Embodied AICode1
Kun: Answer Polishment for Chinese Self-Alignment with Instruction Back-TranslationCode1
Lana: A Language-Capable Navigator for Instruction Following and GenerationCode1
BLEUBERI: BLEU is a surprisingly effective reward for instruction followingCode1
Jatmo: Prompt Injection Defense by Task-Specific FinetuningCode1
EventHallusion: Diagnosing Event Hallucinations in Video LLMsCode1
AlchemistCoder: Harmonizing and Eliciting Code Capability by Hindsight Tuning on Multi-source DataCode1
Show:102550
← PrevPage 30 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified