SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 851900 of 1135 papers

TitleStatusHype
Reminding Multimodal Large Language Models of Object-aware Knowledge with Retrieved Tags0
DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding0
Comparison Visual Instruction Tuning0
Mimicking User Data: On Mitigating Fine-Tuning Risks in Closed Large Language Models0
FaceGPT: Self-supervised Learning to Chat about 3D Human Faces0
CoEvol: Constructing Better Responses for Instruction Finetuning through Multi-Agent CooperationCode0
3D-Properties: Identifying Challenges in DPO and Charting a Path Forward0
OPTune: Efficient Online Preference Tuning0
Attend and Enrich: Enhanced Visual Prompt for Zero-Shot Learning0
Synthetic Programming Elicitation for Text-to-Code in Very Low-Resource Programming and Formal LanguagesCode0
Adversarial Moment-Matching Distillation of Large Language ModelsCode0
Scalable Ensembling For Mitigating Reward Overoptimisation0
LIDAO: Towards Limited Interventions for Debiasing (Large) Language Models0
Phased Instruction Fine-Tuning for Large Language ModelsCode0
clembench-2024: A Challenging, Dynamic, Complementary, Multilingual Benchmark and Underlying Flexible Framework for LLMs as Multi-Action Agents0
Improving Reward Models with Synthetic Critiques0
Joint Embeddings for Graph Instruction Tuning0
TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models0
Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memory0
InstructionCP: A fast approach to transfer Large Language Models into target language0
SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation0
X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual InstructionsCode0
BLSP-KD: Bootstrapping Language-Speech Pre-training via Knowledge Distillation0
X-VILA: Cross-Modality Alignment for Large Language Model0
Empowering Source-Free Domain Adaptation with MLLM-driven Curriculum LearningCode0
Self-Corrected Multimodal Large Language Model for End-to-End Robot Manipulation0
RE-Adapt: Reverse Engineered Adaptation of Large Language Models0
From Role-Play to Drama-Interaction: An LLM Solution0
Disperse-Then-Merge: Pushing the Limits of Instruction Tuning via Alignment Tax ReductionCode0
Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning0
Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning0
A safety realignment framework via subspace-oriented model fusion for large language modelsCode0
SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models0
SpeechVerse: A Large-scale Generalizable Audio Language Model0
Improving Instruction Following in Language Models through Proxy-Based Uncertainty EstimationCode0
Zero-shot LLM-guided Counterfactual Generation: A Case Study on NLP Model EvaluationCode0
Long Context Alignment with Short Instructions and Synthesized Positions0
Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment0
LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language ModelCode0
WildChat: 1M ChatGPT Interaction Logs in the Wild0
LLM-AD: Large Language Model based Audio Description System0
FLAME: Factuality-Aware Alignment for Large Language Models0
Visual Fact Checker: Enabling High-Fidelity Detailed Caption Generation0
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models0
From Persona to Personalization: A Survey on Role-Playing Language Agents0
URL: Universal Referential Knowledge Linking via Task-instructed Representation CompressionCode0
Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models0
Socratic Planner: Self-QA-Based Zero-Shot Planning for Embodied Instruction Following0
Look Before You Decide: Prompting Active Deduction of MLLMs for Assumptive Reasoning0
Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V0
Show:102550
← PrevPage 18 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified