SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–25 of 1135 papers

TitleStatusHype
AnyCap Project: A Unified Framework, Dataset, and Benchmark for Controllable Omni-modal Captioning—0
DrafterBench: Benchmarking Large Language Models for Tasks Automation in Civil EngineeringCode2
How Many Instructions Can LLMs Follow at Once?—0
Multilingual Multimodal Software Developer for Code Generation—0
TuneShield: Mitigating Toxicity in Conversational AI while Fine-tuning on Untrusted Data—0
Meta SecAlign: A Secure Foundation LLM Against Prompt Injection AttacksCode2
DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal AlignmentCode2
Kwai Keye-VL Technical ReportCode4
Bridging Offline and Online Reinforcement Learning for LLMs—0
LLaVA-Pose: Enhancing Human Pose and Action Understanding via Keypoint-Integrated Instruction TuningCode0
Multi-lingual Functional Evaluation for Large Language Models—0
Learning Instruction-Following Policies through Open-Ended Instruction Relabeling with Large Language Models—0
JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent—0
InstructTTSEval: Benchmarking Complex Natural-Language Instruction Following in Text-to-Speech SystemsCode1
Treasure Hunt: Real-time Targeting of the Long Tail using Training-Time Markers—0
Instruction Following by Boosting Attention of Large Language Models—0
Mixture of Weight-shared Heterogeneous Group Attention Experts for Dynamic Token-wise KV Optimization—0
LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instruction—0
MM-R5: MultiModal Reasoning-Enhanced ReRanker via Reinforcement Learning for Document RetrievalCode0
CMI-Bench: A Comprehensive Benchmark for Evaluating Music Instruction Following—0
HalLoc: Token-level Localization of Hallucinations for Vision Language ModelsCode0
AC/DC: LLM-based Audio Comprehension via Dialogue Continuation—0
Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation LearningCode0
Magistral—0
Conversational Search: From Fundamentals to Frontiers in the LLM Era—0
Show:102550
← PrevPage 1 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified