SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 401–450 of 1135 papers

TitleStatusHype
Language Imbalance Driven Rewarding for Multilingual Self-improvingCode1
CoPESD: A Multi-Level Surgical Motion Dataset for Training Large Vision-Language Models to Co-Pilot Endoscopic Submucosal DissectionCode1
Reward-Augmented Data Enhances Direct Preference Alignment of LLMsCode1
Evolutionary Contrastive Distillation for Language Model Alignment—0
Instructional Segment Embedding: Improving LLM Safety with Instruction Hierarchy—0
HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understanding—0
Large Language Model Compression with Neural Architecture Search—0
LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraints—0
ReIFE: Re-evaluating Instruction-Following EvaluationCode0
Self-Boosting Large Language Models with Synthetic Preference Data—0
Direct Preference Optimization for LLM-Enhanced Recommendation Systems—0
TOWER: Tree Organized Weighting for Evaluating Complex Instructions—0
Aria: An Open Multimodal Native Mixture-of-Experts ModelCode5
Multimodal Situational Safety—0
TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation DataCode2
Superficial Safety Alignment Hypothesis—0
A Recipe For Building a Compliant Real Estate ChatbotCode1
On Instruction-Finetuning Neural Machine Translation Models—0
RevisEval: Improving LLM-as-a-Judge via Response-Adapted References—0
SFTMix: Elevating Language Model Instruction Tuning with Mixup Recipe—0
Only-IF:Revealing the Decisive Effect of Instruction Diversity on Generalization—0
CS4: Measuring the Creativity of Large Language Models Automatically by Controlling the Number of Story-Writing ConstraintsCode0
Self-Powered LLM Modality Expansion for Large Speech-Text ModelsCode0
SAG: Style-Aligned Article Generation via Model Collaboration—0
CommonIT: Commonality-Aware Instruction Tuning for Large Language Models via Data PartitionsCode0
TICKing All the Boxes: Generated Checklists Improve LLM Evaluation and Generation—0
Better Instruction-Following Through Minimum Bayes Risk—0
LoGra-Med: Long Context Multi-Graph Alignment for Medical Vision-Language Model—0
LLaVA-Critic: Learning to Evaluate Multimodal Models—0
Video Instruction Tuning With Synthetic Data—0
MedQA-CS: Benchmarking Large Language Models Clinical Skills Using an AI-SCE FrameworkCode1
LASeR: Learning to Adaptively Select Reward Models with Multi-Armed BanditsCode1
Robin3D: Improving 3D Large Language Model via Robust Instruction TuningCode2
DeSTA2: Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning DataCode2
The Perfect Blend: Redefining RLHF with Mixture of Judges—0
Revisiting the Superficial Alignment Hypothesis—0
Ruler: A Model-Agnostic Method to Control Generated Length for Large Language ModelsCode1
Align^2LLaVA: Cascaded Human and Large Language Model Preference Alignment for Multi-modal Instruction CurationCode0
MMMT-IF: A Challenging Multimodal Multi-Turn Instruction Following Benchmark—0
Inference-Time Language Model Alignment via Integrated Value Guidance—0
Infer Human's Intentions Before Following Natural Language InstructionsCode1
Mitigating the Bias of Large Language Model EvaluationCode0
EventHallusion: Diagnosing Event Hallucinations in Video LLMsCode1
EAGLE: Towards Efficient Arbitrary Referring Visual Prompts Comprehension for Multimodal Large Language Models—0
FMDLlama: Financial Misinformation Detection based on Large Language ModelsCode0
MM-CamObj: A Comprehensive Multimodal Dataset for Camouflaged Object ScenariosCode1
Style Outweighs Substance: Failure Modes of LLM Judges in Alignment BenchmarkingCode0
OmniBench: Towards The Future of Universal Omni-Language ModelsCode2
Archon: An Architecture Search Framework for Inference-Time TechniquesCode2
ToolPlanner: A Tool Augmented LLM for Multi Granularity Instructions with Path Planning and FeedbackCode1
Show:102550
← PrevPage 9 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified