SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 826850 of 1135 papers

TitleStatusHype
D-Rax: Domain-specific Radiologic assistant leveraging multi-modal data and eXpert model predictions0
Improving Multilingual Instruction Finetuning via Linguistically Natural and Diverse Datasets0
Iterative Data Generation with Large Language Models for Aspect-based Sentiment Analysis0
ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting0
DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment0
OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents0
Role-Play Zero-Shot Prompting with Large Language Models for Open-Domain Human-Machine Conversation0
A Text is Worth Several Tokens: Text Embedding from LLMs Secretly Aligns Well with The Key Tokens0
Following Length Constraints in Instructions0
Evaluation of Instruction-Following Ability for Large Language Models on Story-Ending Generation0
Teach Better or Show Smarter? On Instructions and Exemplars in Automatic Prompt Optimization0
AdaGrad under Anisotropic Smoothness0
DEM: Distribution Edited Model for Training with Mixed Data Distributions0
IWISDM: Assessing instruction following in multimodal models at scaleCode0
VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought0
Biomedical Visual Instruction Tuning with Clinician Preference AlignmentCode0
The Comparative Trap: Pairwise Comparisons Amplifies Biased Preferences of LLM Evaluators0
Opt-Out: Investigating Entity-Level Unlearning for Large Language Models via Optimal TransportCode0
Unveiling the Flaws: Exploring Imperfections in Synthetic Data and Mitigation Strategies for Large Language Models0
Refine Large Language Model Fine-tuning via Instruction Vector0
Embodied Instruction Following in Unknown Environments0
Enhancing and Assessing Instruction-Following with Fine-Grained Instruction Variants0
How Far Can In-Context Alignment Go? Exploring the State of In-Context Alignment0
Generative Visual Instruction TuningCode0
Grade Score: Quantifying LLM Performance in Option SelectionCode0
Show:102550
← PrevPage 34 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified