SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 10111020 of 1135 papers

TitleStatusHype
Quantifying Self-diagnostic Atomic Knowledge in Chinese Medical Foundation Model: A Computational AnalysisCode0
LoHoRavens: A Long-Horizon Language-Conditioned Benchmark for Robotic Tabletop Manipulation0
VeRA: Vector-based Random Matrix Adaptation0
Gaining Wisdom from Setbacks: Aligning Large Language Models via Mistake Analysis0
Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning0
GROOT: Learning to Follow Instructions by Watching Gameplay Videos0
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization0
From Supervised to Generative: A Novel Paradigm for Tabular Deep Learning with Large Language ModelsCode0
Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models0
SteP: Stacked LLM Policies for Web Actions0
Show:102550
← PrevPage 102 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified