SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 961970 of 1135 papers

TitleStatusHype
SteP: Stacked LLM Policies for Web Actions0
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models0
HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understanding0
Procedures as Programs: Hierarchical Control of Situated Agents through Natural Language0
Hindsight Planner: A Closed-Loop Few-Shot Planner for Embodied Instruction Following0
Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models0
Holistic Capability Preservation: Towards Compact Yet Comprehensive Reasoning Models0
DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment0
DEM: Distribution Edited Model for Training with Mixed Data Distributions0
How Far Can In-Context Alignment Go? Exploring the State of In-Context Alignment0
Show:102550
← PrevPage 97 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified