SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 951975 of 1135 papers

TitleStatusHype
SAIF: A Sparse Autoencoder Framework for Interpreting and Steering Instruction Following of Language Models0
SAIL: Search-Augmented Instruction Learning0
SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation0
SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domain0
Scalable Ensembling For Mitigating Reward Overoptimisation0
Scalable Vision Language Model Training via High Quality Data Curation0
ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting0
Video Instruction Tuning With Synthetic Data0
Video Unlearning via Low-Rank Refusal Vector0
Argument Quality Assessment in the Age of Instruction-Following Large Language Models0
VidHalluc: Evaluating Temporal Hallucinations in Multimodal Large Language Models for Video Understanding0
HelpSteer3-Preference: Open Human-Annotated Preference Data across Diverse Tasks and Languages0
"Are you telling me to put glasses on the dog?'' Content-Grounded Annotation of Instruction Clarification Requests in the CoDraw Dataset0
X-VILA: Cross-Modality Alignment for Large Language Model0
SeedEdit 3.0: Fast and High-Quality Generative Image Editing0
Are You Human? An Adversarial Benchmark to Expose LLMs0
Vision-Language Models Provide Promptable Representations for Reinforcement Learning0
Are We There Yet? Learning to Localize in Embodied Instruction Following0
VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by Video Spatiotemporal Augmentation0
Self-Boosting Large Language Models with Synthetic Preference Data0
Self-Corrected Multimodal Large Language Model for End-to-End Robot Manipulation0
Self-driven Grounding: Large Language Model Agents with Automatical Language-aligned Skill Learning0
Self-Educated Language Agent with Hindsight Experience Replay for Instruction Following0
HIGhER : Improving instruction following with Hindsight Generation for Experience Replay0
Identifying Reliable Evaluation Metrics for Scientific Text RevisionCode0
Show:102550
← PrevPage 39 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified