SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 651675 of 1135 papers

TitleStatusHype
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models0
From Persona to Personalization: A Survey on Role-Playing Language Agents0
URL: Universal Referential Knowledge Linking via Task-instructed Representation CompressionCode0
From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Language ModelsCode2
Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models0
GSCo: Towards Generalizable AI in Medicine via Generalist-Specialist CollaborationCode2
Socratic Planner: Self-QA-Based Zero-Shot Planning for Embodied Instruction Following0
The Instruction Hierarchy: Training LLMs to Prioritize Privileged InstructionsCode1
Look Before You Decide: Prompting Active Deduction of MLLMs for Assumptive Reasoning0
Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V0
Unveiling the Misuse Potential of Base Large Language Models via In-Context Learning0
Sketch-Plan-Generalize: Learning and Planning with Neuro-Symbolic Programmatic Representations for Inductive Spatial Concepts0
CodecLM: Aligning Language Models with Tailored Synthetic Data0
Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs0
Facial Affective Behavior Analysis with Instruction TuningCode1
Teaching Llama a New Language Through Cross-Lingual Knowledge TransferCode0
CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues0
Evaluating LLMs at Detecting Errors in LLM ResponsesCode1
An Incomplete Loop: Deductive, Inductive, and Abductive Learning in Large Language Models0
Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language ModelsCode2
HyperCLOVA X Technical Report0
Learning by Correction: Efficient Tuning Task for Zero-Shot Generative Vision-Language ReasoningCode0
LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction0
Token-Efficient Leverage Learning in Large Language ModelsCode0
Direct Preference Optimization of Video Large Multimodal Models from Language Model RewardCode2
Show:102550
← PrevPage 27 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified