SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 10011025 of 1135 papers

TitleStatusHype
DialMAT: Dialogue-Enabled Transformer with Moment-Based Adversarial TrainingCode0
ChEF: A Comprehensive Evaluation Framework for Standardized Assessment of Multimodal Large Language Models0
COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning0
Active Reasoning in an Open-World Environment0
Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game0
Multilingual Coarse Political Stance Classification of Media. The Editorial Line of a ChatGPT and Bard Newspaper0
CycleAlign: Iterative Distillation from Black-box LLM to White-box Models for Better Human Alignment0
Privately Aligning Language Models with Reinforcement Learning0
Analyzing Multilingual Competency of LLMs in Multi-Turn Instruction Following: A Case Study of Arabic0
LACMA: Language-Aligning Contrastive Learning with Meta-Actions for Embodied Instruction FollowingCode0
Quantifying Self-diagnostic Atomic Knowledge in Chinese Medical Foundation Model: A Computational AnalysisCode0
LoHoRavens: A Long-Horizon Language-Conditioned Benchmark for Robotic Tabletop Manipulation0
VeRA: Vector-based Random Matrix Adaptation0
Gaining Wisdom from Setbacks: Aligning Large Language Models via Mistake Analysis0
Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning0
GROOT: Learning to Follow Instructions by Watching Gameplay Videos0
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization0
From Supervised to Generative: A Novel Paradigm for Tabular Deep Learning with Large Language ModelsCode0
Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models0
SteP: Stacked LLM Policies for Web Actions0
Benchmarking and Improving Generator-Validator Consistency of Language Models0
PACIT: Unlocking the Power of Examples for Better In-Context Instruction TuningCode0
SLM: Bridge the thin gap between speech and text foundation models0
Self-Specialization: Uncovering Latent Expertise within Large Language Models0
Towards LLM-guided Causal Explainability for Black-box Text Classifiers0
Show:102550
← PrevPage 41 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified