SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1081–1090 of 1135 papers

TitleStatusHype
Language-Conditioned Change-point Detection to Identify Sub-Tasks in Robotics DomainsCode0
URL: Universal Referential Knowledge Linking via Task-instructed Representation CompressionCode0
A Reminder of its Brittleness: Language Reward Shaping May Hinder Learning for Instruction Following AgentsCode0
Grade Score: Quantifying LLM Performance in Option SelectionCode0
Order Matters: Investigate the Position Bias in Multi-constraint Instruction FollowingCode0
Don't Copy the Teacher: Data and Model Challenges in Embodied DialogueCode0
Beyond Content Relevance: Evaluating Instruction Following in Retrieval ModelsCode0
CASTILLO: Characterizing Response Length Distributions of Large Language ModelsCode0
HREF: Human Response-Guided Evaluation of Instruction Following in Language ModelsCode0
MIMO: A Medical Vision Language Model with Visual Referring Multimodal Input and Pixel Grounding Multimodal OutputCode0
Show:102550
← PrevPage 109 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified