SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1071–1080 of 1135 papers

TitleStatusHype
SOTOPIA-Ω: Dynamic Strategy Injection Learning and Social Instruction Following Evaluation for Social AgentsCode0
WangchanLion and WangchanX MRC EvalCode0
The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional AnalysisCode0
X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual InstructionsCode0
Optimal Transport-Based Token Weighting scheme for Enhanced Preference OptimizationCode0
LACMA: Language-Aligning Contrastive Learning with Meta-Actions for Embodied Instruction FollowingCode0
Chasing Ghosts: Instruction Following as Bayesian State TrackingCode0
Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language ModelsCode0
Evaluating the Instruction-Following Robustness of Large Language Models to Prompt InjectionCode0
Language as an Abstraction for Hierarchical Deep Reinforcement LearningCode0
Show:102550
← PrevPage 108 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified