SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 451475 of 1135 papers

TitleStatusHype
Adaptive Detoxification: Safeguarding General Capabilities of LLMs through Toxicity-Aware Knowledge Editing0
Disentangling Length Bias In Preference Learning Via Response-Conditioned Modeling0
DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding0
AC/DC: LLM-based Audio Comprehension via Dialogue Continuation0
Better Instruction-Following Through Minimum Bayes Risk0
Efficient Prompt Optimization Through the Lens of Best Arm Identification0
Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective0
Knowledge-enhanced Agents for Interactive Text Games0
Differential Information: An Information-Theoretic Perspective on Preference Optimization0
DiffChat: Learning to Chat with Text-to-Image Synthesis Models for Interactive Image Creation0
A Monte Carlo Language Model Pipeline for Zero-Shot Sociopolitical Event Extraction0
Kubrick: Multimodal Agent Collaborations for Synthetic Video Generation0
Incentivizing Inclusive Contributions in Model Sharing Markets0
Improving the Robustness to Variations of Objects and Instructions with a Neuro-Symbolic Approach for Interactive Instruction Following0
DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment0
Improving the Robustness of Large Language Models via Consistency Alignment0
Improving Reward Models with Synthetic Critiques0
Improving Open Information Extraction with Large Language Models: A Study on Demonstration Uncertainty0
Improving Multilingual Instruction Finetuning via Linguistically Natural and Diverse Datasets0
Improving Instruct Models for Free: A Study on Partial Adaptation0
Improving Instruction-Following in Language Models through Activation Steering0
DEM: Distribution Edited Model for Training with Mixed Data Distributions0
Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoning0
Benchmarking and Improving Generator-Validator Consistency of Language Models0
Alzheimer's Dementia Detection Using Perplexity from Paired Large Language Models0
Show:102550
← PrevPage 19 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified