SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 951975 of 1135 papers

TitleStatusHype
Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective0
Grounding Language by Continuous Observation of Instruction Following0
Language Conditioned Imitation Learning over Unstructured Data0
Ground-level Viewpoint Vision-and-Language Navigation in Continuous Environments0
Ground-V: Teaching VLMs to Ground Complex Instructions in Pixels0
Guided Adaptive Credit Assignment for Sample Efficient Policy Optimization0
Differential Information: An Information-Theoretic Perspective on Preference Optimization0
Systematic Evaluation of Long-Context LLMs on Financial Concepts0
HAPFI: History-Aware Planning based on Fused Information0
DiffChat: Learning to Chat with Text-to-Image Synthesis Models for Interactive Image Creation0
SteP: Stacked LLM Policies for Web Actions0
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models0
HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understanding0
Procedures as Programs: Hierarchical Control of Situated Agents through Natural Language0
Hindsight Planner: A Closed-Loop Few-Shot Planner for Embodied Instruction Following0
Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models0
Holistic Capability Preservation: Towards Compact Yet Comprehensive Reasoning Models0
DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment0
DEM: Distribution Edited Model for Training with Mixed Data Distributions0
How Far Can In-Context Alignment Go? Exploring the State of In-Context Alignment0
DecIF: Improving Instruction-Following through Meta-Decomposition0
How Many Instructions Can LLMs Follow at Once?0
How well can LLMs Grade Essays in Arabic?0
Human Instruction-Following with Deep Reinforcement Learning via Transfer-Learning from Text0
HSI-GPT: A General-Purpose Large Scene-Motion-Language Model for Human Scene Interaction0
Show:102550
← PrevPage 39 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified