SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 551575 of 1135 papers

TitleStatusHype
Finding Fantastic Experts in MoEs: A Unified Study for Expert Dropping Strategies and Observations0
Separator Injection Attack: Uncovering Dialogue Biases in Large Language Models Caused by Role Separators0
From 128K to 4M: Efficient Training of Ultra-Long Context Large Language Models0
The Hidden Space of Safety: Understanding Preference-Tuned LLMs in Multilingual context0
Effectively Controlling Reasoning Models through Thinking Intervention0
Pay More Attention to the Robustness of Prompt for Instruction Data Mining0
Learning to Instruct for Visual Instruction Tuning0
Gemma 3 Technical Report0
OmniGeo: Towards a Multimodal Large Language Models for Geospatial Artificial Intelligence0
Does Context Matter? ContextualJudgeBench for Evaluating LLM-based Judges in Contextual SettingsCode0
ThinkPatterns-21k: A Systematic Study on the Impact of Thinking Patterns in LLMs0
ICCO: Learning an Instruction-conditioned Coordinator for Language-guided Task-aligned Multi-robot Control0
ASMA-Tune: Unlocking LLMs' Assembly Code Comprehension via Structural-Semantic Instruction TuningCode0
D3: Diversity, Difficulty, and Dependability-Aware Data Selection for Sample-Efficient LLM Instruction Tuning0
Compositional Subspace Representation Fine-tuning for Adaptive Large Language Models0
Exo2Ego: Exocentric Knowledge Guided MLLM for Egocentric Video Understanding0
Got Compute, but No Data: Lessons From Post-training a Finnish LLM0
Open-World Skill Discovery from Unsegmented Demonstrations0
DAFE: LLM-Based Evaluation Through Dynamic Arbitration for Free-Form Question-Answering0
Robust Multi-Objective Controlled Decoding of Large Language ModelsCode0
XIFBench: Evaluating Large Language Models on Multilingual Instruction Following0
Dr Genre: Reinforcement Learning from Decoupled LLM Feedback for Generic Text Rewriting0
WildIFEval: Instruction Following in the WildCode0
S2S-Arena, Evaluating Speech2Speech Protocols on Instruction Following with Paralinguistic Information0
IFIR: A Comprehensive Benchmark for Evaluating Instruction-Following in Expert-Domain Information Retrieval0
Show:102550
← PrevPage 23 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified