SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 526550 of 1135 papers

TitleStatusHype
How Far Can In-Context Alignment Go? Exploring the State of In-Context Alignment0
Balancing Continuous Pre-Training and Instruction Fine-Tuning: Optimizing Instruction-Following in LLMs0
HelpSteer3-Preference: Open Human-Annotated Preference Data across Diverse Tasks and Languages0
Holistic Capability Preservation: Towards Compact Yet Comprehensive Reasoning Models0
Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models0
Hindsight Planner: A Closed-Loop Few-Shot Planner for Embodied Instruction Following0
Procedures as Programs: Hierarchical Control of Situated Agents through Natural Language0
Active Reasoning in an Open-World Environment0
HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understanding0
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models0
SteP: Stacked LLM Policies for Web Actions0
HAPFI: History-Aware Planning based on Fused Information0
CROME: Cross-Modal Adapters for Efficient Multimodal LLM0
Aligning Text, Images, and 3D Structure Token-by-Token0
Mitigating Biases for Instruction-following Language Models via Bias Neurons Elimination0
Guided Adaptive Credit Assignment for Sample Efficient Policy Optimization0
Ground-V: Teaching VLMs to Ground Complex Instructions in Pixels0
Creating Arabic LLM Prompts at Scale0
Ground-level Viewpoint Vision-and-Language Navigation in Continuous Environments0
Language Conditioned Imitation Learning over Unstructured Data0
AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents0
Grounding Language by Continuous Observation of Instruction Following0
CoTBal: Comprehensive Task Balancing for Multi-Task Visual Instruction Tuning0
GROOT: Learning to Follow Instructions by Watching Gameplay Videos0
GROOT-2: Weakly Supervised Multi-Modal Instruction Following Agents0
Show:102550
← PrevPage 22 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified