SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 601–650 of 1135 papers

TitleStatusHype
HAPFI: History-Aware Planning based on Fused Information—0
DiffChat: Learning to Chat with Text-to-Image Synthesis Models for Interactive Image Creation—0
SteP: Stacked LLM Policies for Web Actions—0
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models—0
HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understanding—0
Procedures as Programs: Hierarchical Control of Situated Agents through Natural Language—0
Hindsight Planner: A Closed-Loop Few-Shot Planner for Embodied Instruction Following—0
Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models—0
Holistic Capability Preservation: Towards Compact Yet Comprehensive Reasoning Models—0
DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment—0
DEM: Distribution Edited Model for Training with Mixed Data Distributions—0
How Far Can In-Context Alignment Go? Exploring the State of In-Context Alignment—0
DecIF: Improving Instruction-Following through Meta-Decomposition—0
How Many Instructions Can LLMs Follow at Once?—0
How well can LLMs Grade Essays in Arabic?—0
Human Instruction-Following with Deep Reinforcement Learning via Transfer-Learning from Text—0
DataMan: Data Manager for Pre-training Large Language Models—0
IFIR: A Comprehensive Benchmark for Evaluating Instruction-Following in Expert-Domain Information Retrieval—0
If You Can't Use Them, Recycle Them: Optimizing Merging at Scale Mitigates Performance Tradeoffs—0
Data Extraction Attacks in Retrieval-Augmented Generation via Backdoors—0
Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoning—0
Improving Instruction-Following in Language Models through Activation Steering—0
Improving Instruct Models for Free: A Study on Partial Adaptation—0
Improving Multilingual Instruction Finetuning via Linguistically Natural and Diverse Datasets—0
Improving Open Information Extraction with Large Language Models: A Study on Demonstration Uncertainty—0
Improving Reward Models with Synthetic Critiques—0
Improving the Robustness of Large Language Models via Consistency Alignment—0
Improving the Robustness to Variations of Objects and Instructions with a Neuro-Symbolic Approach for Interactive Instruction Following—0
Incentivizing Inclusive Contributions in Model Sharing Markets—0
TALKPLAY: Multimodal Music Recommendation with Large Language Models—0
In-context Learning vs. Instruction Tuning: The Case of Small and Multilingual Language Models—0
In-Context Watermarks for Large Language Models—0
Leveraging LLMs for Influence Path Planning in Proactive Recommendation—0
Incorporating Visual Experts to Resolve the Information Loss in Multimodal Large Language Models—0
Inference-Time Language Model Alignment via Integrated Value Guidance—0
Teach Better or Show Smarter? On Instructions and Exemplars in Automatic Prompt Optimization—0
Data Diversity Matters for Robust Instruction Tuning—0
InSerter: Speech Instruction Following with Unsupervised Interleaved Pre-training—0
InsightEdit: Towards Better Instruction Following for Image Editing—0
DAFE: LLM-Based Evaluation Through Dynamic Arbitration for Free-Form Question-Answering—0
Temporal Representation Alignment: Successor Features Enable Emergent Compositionality in Robot Instruction Following—0
InstructBooth: Instruction-following Personalized Text-to-Image Generation—0
Attend and Enrich: Enhanced Visual Prompt for Zero-Shot Learning—0
Instructional Segment Embedding: Improving LLM Safety with Instruction Hierarchy—0
InstructionCP: A fast approach to transfer Large Language Models into target language—0
Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game—0
Instruction Following by Boosting Attention of Large Language Models—0
D3: Diversity, Difficulty, and Dependability-Aware Data Selection for Sample-Efficient LLM Instruction Tuning—0
Instruction-following Evaluation through Verbalizer Manipulation—0
Instruction-Following Pruning for Large Language Models—0
Show:102550
← PrevPage 13 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified