SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1061–1070 of 1135 papers

TitleStatusHype
From MTEB to MTOB: Retrieval-Augmented Classification for Descriptive GrammarsCode0
RefuteBench: Evaluating Refuting Instruction-Following for Large Language ModelsCode0
Judging the Judges: Can Large Vision-Language Models Fairly Evaluate Chart Comprehension and Reasoning?Code0
Dancing in Chains: Reconciling Instruction Following and Faithfulness in Language ModelsCode0
Biomedical Visual Instruction Tuning with Clinician Preference AlignmentCode0
A Course Correction in Steerability Evaluation: Revealing Miscalibration and Side Effects in LLMsCode0
MDCure: A Scalable Pipeline for Multi-Document Instruction-FollowingCode0
ReIFE: Re-evaluating Instruction-Following EvaluationCode0
Re-Imagining Multimodal Instruction Tuning: A Representation ViewCode0
Exploring the Trade-Offs: Quantization Methods, Task Difficulty, and Model Size in Large Language Models From Edge to GiantCode0
Show:102550
← PrevPage 107 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified