SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 951975 of 1135 papers

TitleStatusHype
Multi-Query Focused Disaster Summarization via Instruction-Based Prompting0
Policy Improvement using Language Feedback ModelsCode0
Investigating the Impact of Data Contamination of Large Language Models in Text-to-SQL Translation0
PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs0
Nevermind: Instruction Override and Moderation in Large Language Models0
Vision-Language Models Provide Promptable Representations for Reinforcement Learning0
Diversity Measurement and Subset Selection for Instruction Tuning Datasets0
IndiVec: An Exploration of Leveraging Large Language Models for Media Bias Detection with Fine-Grained Bias IndicatorsCode0
Instruction Makes a DifferenceCode0
Mitigating the Influence of Distractor Tasks in LMs with Prior-Aware Decoding0
Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification RequestsCode0
KAUCUS: Knowledge Augmented User Simulators for Training Language Model Assistants0
AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents0
COCO is "ALL'' You Need for Visual Instruction Fine-tuning0
PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities0
Human-Instruction-Free LLM Self-Alignment with Limited Samples0
Incorporating Visual Experts to Resolve the Information Loss in Multimodal Large Language Models0
Multilingual Instruction Tuning With Just a Pinch of Multilinguality0
SSP: A Simple and Safe automatic Prompt engineering method towards realistic image synthesis on LVM0
Generate Subgoal Images before Act: Unlocking the Chain-of-Thought Reasoning in Diffusion Model for Robot Manipulation with Multimodal Prompts0
Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision Language Audio and Action0
Visual Instruction Tuning towards General-Purpose Multimodal Model: A Survey0
LiDAR-LLM: Exploring the Potential of Large Language Models for 3D LiDAR Understanding0
Mixture of Cluster-conditional LoRA Experts for Vision-language Instruction Tuning0
Rethinking the Instruction Quality: LIFT is What You Need0
Show:102550
← PrevPage 39 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified