SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 11011125 of 1135 papers

TitleStatusHype
LLaMA-E: Empowering E-commerce Authoring with Object-Interleaved Instruction Following0
LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction0
Collaborative decoding of critical tokens for boosting factuality of large language models0
ThinkPatterns-21k: A Systematic Study on the Impact of Thinking Patterns in LLMs0
CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following0
LLaVA-c: Continual Improved Visual Instruction Tuning0
LLaVA-Critic: Learning to Evaluate Multimodal Models0
CodeIF-Bench: Evaluating Instruction-Following Capabilities of Large Language Models in Interactive Code Generation0
CodecLM: Aligning Language Models with Tailored Synthetic Data0
LLaVA-Ultra: Large Chinese Language and Vision Assistant for Ultrasound0
LLaVA-Zip: Adaptive Visual Token Compression with Intrinsic Image Information0
LLM-AD: Large Language Model based Audio Description System0
LLM-Align: Utilizing Large Language Models for Entity Alignment in Knowledge Graphs0
LLM Censorship: A Machine Learning Challenge or a Computer Security Problem?0
Large Language Model Compression with Neural Architecture Search0
TICKing All the Boxes: Generated Checklists Improve LLM Evaluation and Generation0
COCO is "ALL'' You Need for Visual Instruction Fine-tuning0
TIIF-Bench: How Does Your T2I Model Follow Your Instructions?0
Towards LLM-guided Causal Explainability for Black-box Text Classifiers0
LLMs can be easily Confused by Instructional Distractions0
LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraints0
LLMs for Generalizable Language-Conditioned Policy Learning under Minimal Data Requirements0
CMI-Bench: A Comprehensive Benchmark for Evaluating Music Instruction Following0
Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V0
CLIP-Nav: Using CLIP for Zero-Shot Vision-and-Language Navigation0
Show:102550
← PrevPage 45 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified