SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1071–1080 of 1135 papers

TitleStatusHype
Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw DatasetCode0
Natural Language-conditioned Reinforcement Learning with Inside-out Task Language Development and Translation—0
Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks—0
Distilling Internet-Scale Vision-Language Models into Embodied Agents—0
Multimodal Sequential Generative Models for Semi-Supervised Language Instruction Following—0
Continual Learning for Instruction Following from Realtime FeedbackCode0
CLIP-Nav: Using CLIP for Zero-Shot Vision-and-Language Navigation—0
UGIF: UI Grounded Instruction Following—0
Learning to Follow Instructions in Text-Based GamesCode0
Prompter: Utilizing Large Language Model Prompting for a Data Efficient Embodied Instruction Following—0
Show:102550
← PrevPage 108 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified