SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 10511100 of 1135 papers

TitleStatusHype
Knowledge-enhanced Agents for Interactive Text Games0
Kubrick: Multimodal Agent Collaborations for Synthetic Video Generation0
Mitigating Biases for Instruction-following Language Models via Bias Neurons Elimination0
Creating Arabic LLM Prompts at Scale0
LaMDAgent: An Autonomous Framework for Post-Training Pipeline Optimization via LLM Agents0
Language and Planning in Robotic Navigation: A Multilingual Evaluation of State-of-the-Art Models0
Language-Conditioned Goal Generation: a New Approach to Language Grounding for RL0
Language-Conditioned Goal Generation: a New Approach to Language Grounding in RL0
The Perfect Blend: Redefining RLHF with Mixture of Judges0
Language-guided Semantic Mapping and Mobile Manipulation in Partially Observable Environments0
Adaptive Decoding via Latent Preference Optimization0
Language Models are General-Purpose Interfaces0
CoTBal: Comprehensive Task Balancing for Multi-Task Visual Instruction Tuning0
COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning0
Language Models Benefit from Preparation with Elicited Knowledge0
AdaGrad under Anisotropic Smoothness0
Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Course0
Conversational Search: From Fundamentals to Frontiers in the LLM Era0
Space-LLaVA: a Vision-Language Model Adapted to Extraterrestrial Applications0
Large Language Models for Autonomous Driving (LLM4AD): Concept, Benchmark, Experiments, and Challenges0
WildChat: 1M ChatGPT Interaction Logs in the Wild0
Controllable Text-to-Image Generation with GPT-40
Layer-Aware Task Arithmetic: Disentangling Task-Specific and Instruction-Following Knowledge0
Learning Human Perception Dynamics for Informative Robot Communication0
Learning Instruction-Following Policies through Open-Ended Instruction Relabeling with Large Language Models0
Continual Skill and Task Learning via Dialogue0
Learning to Instruct for Visual Instruction Tuning0
Learning to Keep a Promise: Scaling Language Model Decoding Parallelism with Learned Asynchronous Decoding0
Think Big, Generate Quick: LLM-to-SLM for Fast Autoregressive Decoding0
Learning to Navigate the Web0
LearnLM: Improving Gemini for Learning0
Length Controlled Generation for Black-box LLMs0
Preference Consistency Matters: Enhancing Preference Learning in Language Models with Automated Self-Curation of Training Corpora0
Less is More: Generating Grounded Navigation Instructions from Landmarks0
Compositional Subspace Representation Fine-tuning for Adaptive Large Language Models0
Leveraging Importance Sampling to Detach Alignment Modules from Large Language Models0
Leveraging Large Vision-Language Model as User Intent-aware Encoder for Composed Image Retrieval0
LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instruction0
Compositional pre-training for neural semantic parsing0
LEWIS (LayEr WIse Sparsity) -- A Training Free Guided Model Merging Approach0
ThinkBot: Embodied Instruction Following with Thought Chain Reasoning0
Thinking LLMs: General Instruction Following with Thought Generation0
LIDAO: Towards Limited Interventions for Debiasing (Large) Language Models0
LiDAR-LLM: Exploring the Potential of Large Language Models for 3D LiDAR Understanding0
LIMIT: Less Is More for Instruction Tuning Across Evaluation Paradigms0
Compositional Instruction Following with Language Models and Reinforcement Learning0
ThinkLess: A Training-Free Inference-Efficient Method for Reducing Reasoning Redundancy0
Compositional Data and Task Augmentation for Instruction Following0
CompBench: Benchmarking Complex Instruction-guided Image Editing0
Comparison Visual Instruction Tuning0
Show:102550
← PrevPage 22 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified