SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 401425 of 1135 papers

TitleStatusHype
Language Imbalance Driven Rewarding for Multilingual Self-improvingCode1
CoPESD: A Multi-Level Surgical Motion Dataset for Training Large Vision-Language Models to Co-Pilot Endoscopic Submucosal DissectionCode1
Reward-Augmented Data Enhances Direct Preference Alignment of LLMsCode1
Evolutionary Contrastive Distillation for Language Model Alignment0
Instructional Segment Embedding: Improving LLM Safety with Instruction Hierarchy0
LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraints0
HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understanding0
Large Language Model Compression with Neural Architecture Search0
ReIFE: Re-evaluating Instruction-Following EvaluationCode0
Self-Boosting Large Language Models with Synthetic Preference Data0
Direct Preference Optimization for LLM-Enhanced Recommendation Systems0
Multimodal Situational Safety0
Aria: An Open Multimodal Native Mixture-of-Experts ModelCode5
TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation DataCode2
TOWER: Tree Organized Weighting for Evaluating Complex Instructions0
A Recipe For Building a Compliant Real Estate ChatbotCode1
Superficial Safety Alignment Hypothesis0
On Instruction-Finetuning Neural Machine Translation Models0
RevisEval: Improving LLM-as-a-Judge via Response-Adapted References0
Only-IF:Revealing the Decisive Effect of Instruction Diversity on Generalization0
SFTMix: Elevating Language Model Instruction Tuning with Mixup Recipe0
CS4: Measuring the Creativity of Large Language Models Automatically by Controlling the Number of Story-Writing ConstraintsCode0
Self-Powered LLM Modality Expansion for Large Speech-Text ModelsCode0
SAG: Style-Aligned Article Generation via Model Collaboration0
TICKing All the Boxes: Generated Checklists Improve LLM Evaluation and Generation0
Show:102550
← PrevPage 17 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified