SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 951–1000 of 1135 papers

TitleStatusHype
Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective—0
Grounding Language by Continuous Observation of Instruction Following—0
Language Conditioned Imitation Learning over Unstructured Data—0
Ground-level Viewpoint Vision-and-Language Navigation in Continuous Environments—0
Ground-V: Teaching VLMs to Ground Complex Instructions in Pixels—0
Guided Adaptive Credit Assignment for Sample Efficient Policy Optimization—0
Differential Information: An Information-Theoretic Perspective on Preference Optimization—0
Systematic Evaluation of Long-Context LLMs on Financial Concepts—0
HAPFI: History-Aware Planning based on Fused Information—0
DiffChat: Learning to Chat with Text-to-Image Synthesis Models for Interactive Image Creation—0
SteP: Stacked LLM Policies for Web Actions—0
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models—0
HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understanding—0
Procedures as Programs: Hierarchical Control of Situated Agents through Natural Language—0
Hindsight Planner: A Closed-Loop Few-Shot Planner for Embodied Instruction Following—0
Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models—0
Holistic Capability Preservation: Towards Compact Yet Comprehensive Reasoning Models—0
DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment—0
DEM: Distribution Edited Model for Training with Mixed Data Distributions—0
How Far Can In-Context Alignment Go? Exploring the State of In-Context Alignment—0
DecIF: Improving Instruction-Following through Meta-Decomposition—0
How Many Instructions Can LLMs Follow at Once?—0
How well can LLMs Grade Essays in Arabic?—0
Human Instruction-Following with Deep Reinforcement Learning via Transfer-Learning from Text—0
HSI-GPT: A General-Purpose Large Scene-Motion-Language Model for Human Scene Interaction—0
Human-Instruction-Free LLM Self-Alignment with Limited Samples—0
Hunyuan-TurboS: Advancing Large Language Models through Mamba-Transformer Synergy and Adaptive Chain-of-Thought—0
T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generation—0
Hypencoder: Hypernetworks for Information Retrieval—0
HyperCLOVA X Technical Report—0
VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought—0
ICCO: Learning an Instruction-conditioned Coordinator for Language-guided Task-aligned Multi-robot Control—0
T2VTextBench: A Human Evaluation Benchmark for Textual Control in Video Generation Models—0
DataMan: Data Manager for Pre-training Large Language Models—0
IFIR: A Comprehensive Benchmark for Evaluating Instruction-Following in Expert-Domain Information Retrieval—0
If You Can't Use Them, Recycle Them: Optimizing Merging at Scale Mitigates Performance Tradeoffs—0
Data Extraction Attacks in Retrieval-Augmented Generation via Backdoors—0
Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoning—0
Improving Instruction-Following in Language Models through Activation Steering—0
Improving Instruct Models for Free: A Study on Partial Adaptation—0
Improving Multilingual Instruction Finetuning via Linguistically Natural and Diverse Datasets—0
Improving Open Information Extraction with Large Language Models: A Study on Demonstration Uncertainty—0
Improving Reward Models with Synthetic Critiques—0
Improving the Robustness of Large Language Models via Consistency Alignment—0
Improving the Robustness to Variations of Objects and Instructions with a Neuro-Symbolic Approach for Interactive Instruction Following—0
Incentivizing Inclusive Contributions in Model Sharing Markets—0
TALKPLAY: Multimodal Music Recommendation with Large Language Models—0
In-context Learning vs. Instruction Tuning: The Case of Small and Multilingual Language Models—0
In-Context Watermarks for Large Language Models—0
Leveraging LLMs for Influence Path Planning in Proactive Recommendation—0
Show:102550
← PrevPage 20 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified