SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 451–500 of 1135 papers

TitleStatusHype
LLaVA-Pose: Enhancing Human Pose and Action Understanding via Keypoint-Integrated Instruction TuningCode0
Bridging Offline and Online Reinforcement Learning for LLMs—0
Multi-lingual Functional Evaluation for Large Language Models—0
Learning Instruction-Following Policies through Open-Ended Instruction Relabeling with Large Language Models—0
JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent—0
Treasure Hunt: Real-time Targeting of the Long Tail using Training-Time Markers—0
Instruction Following by Boosting Attention of Large Language Models—0
Mixture of Weight-shared Heterogeneous Group Attention Experts for Dynamic Token-wise KV Optimization—0
LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instruction—0
MM-R5: MultiModal Reasoning-Enhanced ReRanker via Reinforcement Learning for Document RetrievalCode0
CMI-Bench: A Comprehensive Benchmark for Evaluating Music Instruction Following—0
Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation LearningCode0
AC/DC: LLM-based Audio Comprehension via Dialogue Continuation—0
HalLoc: Token-level Localization of Hallucinations for Vision Language ModelsCode0
Conversational Search: From Fundamentals to Frontiers in the LLM Era—0
Magistral—0
Alzheimer's Dementia Detection Using Perplexity from Paired Large Language Models—0
RHealthTwin: Towards Responsible and Multimodal Digital Twins for Personalized Well-being—0
LLaVA-c: Continual Improved Visual Instruction Tuning—0
EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language ModelsCode0
Aligning Text, Images, and 3D Structure Token-by-Token—0
Video Unlearning via Low-Rank Refusal Vector—0
Being Strong Progressively! Enhancing Knowledge Distillation of Large Language Models through a Curriculum Learning FrameworkCode0
Audio-Aware Large Language Models as Judges for Speaking Styles—0
Identifying Reliable Evaluation Metrics for Scientific Text RevisionCode0
RELIC: Evaluating Compositional Instruction Following via Language Recognition—0
Unleashing Hour-Scale Video Training for Long Video-Language Understanding—0
SeedEdit 3.0: Fast and High-Quality Generative Image Editing—0
On the Mechanism of Reasoning Pattern Selection in Reinforcement Learning for Language Models—0
Robust Anti-Backdoor Instruction Tuning in LVLMs—0
MASTER: Enhancing Large Language Model via Multi-Agent Simulated Teaching—0
MoDA: Modulation Adapter for Fine-Grained Visual Grounding in Instructional MLLMs—0
TIIF-Bench: How Does Your T2I Model Follow Your Instructions?—0
PersianMedQA: Language-Centric Evaluation of LLMs in the Persian Medical Domain—0
Differential Information: An Information-Theoretic Perspective on Preference Optimization—0
ChartMind: A Comprehensive Benchmark for Complex Real-world Multimodal Chart Question Answering—0
ARC: Argument Representation and Coverage Analysis for Zero-Shot Long Document Summarization with Instruction Following LLMs—0
Adaptive Detoxification: Safeguarding General Capabilities of LLMs through Toxicity-Aware Knowledge Editing—0
LaMDAgent: An Autonomous Framework for Post-Training Pipeline Optimization via LLM Agents—0
PartInstruct: Part-level Instruction Following for Fine-grained Robot Manipulation—0
A Course Correction in Steerability Evaluation: Revealing Miscalibration and Side Effects in LLMsCode0
StyleAR: Customizing Multimodal Autoregressive Model for Style-Aligned Text-to-Image Generation—0
From Alignment to Advancement: Bootstrapping Audio-Language Alignment with Synthetic Data—0
Leveraging Importance Sampling to Detach Alignment Modules from Large Language Models—0
Evaluating Robustness of Large Audio Language Models to Audio Injection: An Empirical Study—0
RECAST: Strengthening LLMs' Complex Instruction Following with Constraint-Verifiable Data—0
Optimal Transport-Based Token Weighting scheme for Enhanced Preference OptimizationCode0
MIDB: Multilingual Instruction Data Booster for Enhancing Multilingual Instruction Synthesis—0
In-Context Watermarks for Large Language Models—0
Sparse Activation Editing for Reliable Instruction Following in Narratives—0
Show:102550
← PrevPage 10 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified