SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 11–20 of 1135 papers

TitleStatusHype
Multi-lingual Functional Evaluation for Large Language Models—0
Learning Instruction-Following Policies through Open-Ended Instruction Relabeling with Large Language Models—0
JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent—0
InstructTTSEval: Benchmarking Complex Natural-Language Instruction Following in Text-to-Speech SystemsCode1
Treasure Hunt: Real-time Targeting of the Long Tail using Training-Time Markers—0
Mixture of Weight-shared Heterogeneous Group Attention Experts for Dynamic Token-wise KV Optimization—0
Instruction Following by Boosting Attention of Large Language Models—0
LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instruction—0
MM-R5: MultiModal Reasoning-Enhanced ReRanker via Reinforcement Learning for Document RetrievalCode0
CMI-Bench: A Comprehensive Benchmark for Evaluating Music Instruction Following—0
Show:102550
← PrevPage 2 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified