SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 726750 of 1135 papers

TitleStatusHype
Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents0
Plug-and-Play Grounding of Reasoning in Multimodal Large Language Models0
Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision Language Audio and Action0
Unified Mind Model: Reimagining Autonomous Agents in the LLM Era0
Becoming self-instruct: introducing early stopping criteria for minimal instruct tuning0
The Comparative Trap: Pairwise Comparisons Amplifies Biased Preferences of LLM Evaluators0
Privately Aligning Language Models with Reinforcement Learning0
Prompt Baking0
Prompter: Utilizing Large Language Model Prompting for a Data Efficient Embodied Instruction Following0
Unleashing Hour-Scale Video Training for Long Video-Language Understanding0
PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities0
PUMGPT: A Large Vision-Language Model for Product Understanding0
BARE: Leveraging Base Language Models for Few-Shot Synthetic Data Generation0
Quantifying and Attributing the Hallucination of Large Language Models via Association Analysis0
Question: How do Large Language Models perform on the Question Answering tasks? Answer:0
BAP v2: An Enhanced Task Framework for Instruction Following in Minecraft Dialogues0
Balancing Continuous Pre-Training and Instruction Fine-Tuning: Optimizing Instruction-Following in LLMs0
AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents0
Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models0
Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model0
RE-Adapt: Reverse Engineered Adaptation of Large Language Models0
WatME: Towards Lossless Watermarking Through Lexical Redundancy0
Accessible Instruction-Following Agent0
RECAST: Strengthening LLMs' Complex Instruction Following with Constraint-Verifiable Data0
RecExplainer: Aligning Large Language Models for Explaining Recommendation Models0
Show:102550
← PrevPage 30 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified