SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 226250 of 1135 papers

TitleStatusHype
Cuckoo: An IE Free Rider Hatched by Massive Nutrition in LLM's NestCode0
CORDIAL: Can Multimodal Large Language Models Effectively Understand Coherence Relationships?Code0
Enhancing Cross-Tokenizer Knowledge Distillation with Contextual Dynamical MappingCode1
Rewrite to Jailbreak: Discover Learnable and Transferable Implicit Harmfulness InstructionCode0
Large Language Diffusion ModelsCode7
E2LVLM:Evidence-Enhanced Large Vision-Language Model for Multimodal Out-of-Context Misinformation Detection0
IHEval: Evaluating Language Models on Following the Instruction HierarchyCode1
BenchMAX: A Comprehensive Multilingual Evaluation Suite for Large Language ModelsCode1
Who Taught You That? Tracing Teachers in Model Distillation0
Temporal Representation Alignment: Successor Features Enable Emergent Compositionality in Robot Instruction Following0
Hypencoder: Hypernetworks for Information Retrieval0
M-IFEval: Multilingual Instruction-Following EvaluationCode1
Verifiable Format Control for Large Language Model Generations0
UltraIF: Advancing Instruction Following from the WildCode1
LLMs can be easily Confused by Instructional Distractions0
Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons0
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model0
Shuttle Between the Instructions and the Parameters of Large Language Models0
CoDe: Blockwise Control for Denoising Diffusion ModelsCode0
BARE: Leveraging Base Language Models for Few-Shot Synthetic Data Generation0
Learning Human Perception Dynamics for Informative Robot Communication0
Disentangling Length Bias In Preference Learning Via Response-Conditioned Modeling0
ReFoRCE: A Text-to-SQL Agent with Self-Refinement, Format Restriction, and Column Exploration0
mFollowIR: a Multilingual Benchmark for Instruction Following in RetrievalCode2
Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models0
Show:102550
← PrevPage 10 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified