SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 941950 of 1135 papers

TitleStatusHype
RefuteBench: Evaluating Refuting Instruction-Following for Large Language ModelsCode0
VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Models0
Investigating Multilingual Instruction-Tuning: Do Polyglot Models Demand for Multilingual Instructions?0
CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models0
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models0
The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional AnalysisCode0
Transformer-based Causal Language Models Perform Clustering0
Aligning Large Language Models by On-Policy Self-JudgmentCode0
AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility EstimationCode0
Efficient Prompt Optimization Through the Lens of Best Arm Identification0
Show:102550
← PrevPage 95 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified