SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 731740 of 1135 papers

TitleStatusHype
Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking0
RefuteBench: Evaluating Refuting Instruction-Following for Large Language ModelsCode0
Self-Distillation Bridges Distribution Gap in Language Model Fine-TuningCode2
Investigating Multilingual Instruction-Tuning: Do Polyglot Models Demand for Multilingual Instructions?0
VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Models0
The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional AnalysisCode0
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models0
PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt TuningCode1
CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models0
The Revolution of Multimodal Large Language Models: A SurveyCode2
Show:102550
← PrevPage 74 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified