SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 801825 of 1135 papers

TitleStatusHype
HelpSteer3-Preference: Open Human-Annotated Preference Data across Diverse Tasks and Languages0
"Are you telling me to put glasses on the dog?'' Content-Grounded Annotation of Instruction Clarification Requests in the CoDraw Dataset0
X-VILA: Cross-Modality Alignment for Large Language Model0
SeedEdit 3.0: Fast and High-Quality Generative Image Editing0
Are You Human? An Adversarial Benchmark to Expose LLMs0
Vision-Language Models Provide Promptable Representations for Reinforcement Learning0
Are We There Yet? Learning to Localize in Embodied Instruction Following0
VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by Video Spatiotemporal Augmentation0
Self-Boosting Large Language Models with Synthetic Preference Data0
Self-Corrected Multimodal Large Language Model for End-to-End Robot Manipulation0
Self-driven Grounding: Large Language Model Agents with Automatical Language-aligned Skill Learning0
Self-Educated Language Agent with Hindsight Experience Replay for Instruction Following0
HIGhER : Improving instruction following with Hindsight Generation for Experience Replay0
VisualCritic: Making LMMs Perceive Visual Quality Like Humans0
ARC: Argument Representation and Coverage Analysis for Zero-Shot Long Document Summarization with Instruction Following LLMs0
Visual Fact Checker: Enabling High-Fidelity Detailed Caption Generation0
AnyCap Project: A Unified Framework, Dataset, and Benchmark for Controllable Omni-modal Captioning0
An Incomplete Loop: Deductive, Inductive, and Abductive Learning in Large Language Models0
When Thinking Fails: The Pitfalls of Reasoning for Instruction-Following in LLMs0
Self-Specialization: Uncovering Latent Expertise within Large Language Models0
Self-supervised Quantized Representation for Seamlessly Integrating Knowledge Graphs with Large Language Models0
Separable Mixture of Low-Rank Adaptation for Continual Visual Instruction Tuning0
Separator Injection Attack: Uncovering Dialogue Biases in Large Language Models Caused by Role Separators0
Sequence-level Large Language Model Training with Contrastive Preference Optimization0
SeRA: Self-Reviewing and Alignment of Large Language Models using Implicit Reward Margins0
Show:102550
← PrevPage 33 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified