SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 601650 of 1135 papers

TitleStatusHype
Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play ApproachCode1
Adversarial Moment-Matching Distillation of Large Language ModelsCode0
Attend and Enrich: Enhanced Visual Prompt for Zero-Shot Learning0
Scalable Ensembling For Mitigating Reward Overoptimisation0
LIDAO: Towards Limited Interventions for Debiasing (Large) Language Models0
Phased Instruction Fine-Tuning for Large Language ModelsCode0
clembench-2024: A Challenging, Dynamic, Complementary, Multilingual Benchmark and Underlying Flexible Framework for LLMs as Multi-Action Agents0
Improving Reward Models with Synthetic Critiques0
Joint Embeddings for Graph Instruction Tuning0
SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation0
TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models0
X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual InstructionsCode0
Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memory0
Instruction-Guided Visual MaskingCode1
Is In-Context Learning Sufficient for Instruction Following in LLMs?Code1
InstructionCP: A fast approach to transfer Large Language Models into target language0
AlchemistCoder: Harmonizing and Eliciting Code Capability by Hindsight Tuning on Multi-source DataCode1
X-VILA: Cross-Modality Alignment for Large Language Model0
MathChat: Benchmarking Mathematical Reasoning and Instruction Following in Multi-Turn InteractionsCode1
BLSP-KD: Bootstrapping Language-Speech Pre-training via Knowledge Distillation0
Weak-to-Strong Search: Align Large Language Models via Searching over Small Language ModelsCode2
Self-Exploring Language Models: Active Preference Elicitation for Online AlignmentCode2
Empowering Source-Free Domain Adaptation with MLLM-driven Curriculum LearningCode0
Self-Corrected Multimodal Large Language Model for End-to-End Robot Manipulation0
PromptFix: You Prompt and We Fix the PhotoCode4
RE-Adapt: Reverse Engineered Adaptation of Large Language Models0
From Role-Play to Drama-Interaction: An LLM Solution0
EditWorld: Simulating World Dynamics for Instruction-Following Image EditingCode2
SimPO: Simple Preference Optimization with a Reference-Free RewardCode4
A Survey on Vision-Language-Action Models for Embodied AICode4
Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning0
Mosaic-IT: Free Compositional Data Augmentation Improves Instruction TuningCode1
Vikhr: Constructing a State-of-the-art Bilingual Open-Source Instruction-Following Large Language Model for RussianCode2
Disperse-Then-Merge: Pushing the Limits of Instruction Tuning via Alignment Tax ReductionCode0
RecGPT: Generative Pre-training for Text-based RecommendationCode1
Grounded 3D-LLM with Referent TokensCode2
Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning0
A safety realignment framework via subspace-oriented model fusion for large language modelsCode0
SpeechVerse: A Large-scale Generalizable Audio Language Model0
SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models0
Improving Instruction Following in Language Models through Proxy-Based Uncertainty EstimationCode0
CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-ExpertsCode2
Zero-shot LLM-guided Counterfactual Generation: A Case Study on NLP Model EvaluationCode0
Long Context Alignment with Short Instructions and Synthesized Positions0
Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment0
LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language ModelCode0
WildChat: 1M ChatGPT Interaction Logs in the Wild0
LLM-AD: Large Language Model based Audio Description System0
FLAME: Factuality-Aware Alignment for Large Language Models0
Visual Fact Checker: Enabling High-Fidelity Detailed Caption Generation0
Show:102550
← PrevPage 13 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified