SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 961970 of 1135 papers

TitleStatusHype
Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification RequestsCode0
KAUCUS: Knowledge Augmented User Simulators for Training Language Model Assistants0
AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents0
COCO is "ALL'' You Need for Visual Instruction Fine-tuning0
PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities0
Human-Instruction-Free LLM Self-Alignment with Limited Samples0
Incorporating Visual Experts to Resolve the Information Loss in Multimodal Large Language Models0
Multilingual Instruction Tuning With Just a Pinch of Multilinguality0
SSP: A Simple and Safe automatic Prompt engineering method towards realistic image synthesis on LVM0
Generate Subgoal Images before Act: Unlocking the Chain-of-Thought Reasoning in Diffusion Model for Robot Manipulation with Multimodal Prompts0
Show:102550
← PrevPage 97 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified