SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–300 of 1135 papers

TitleStatusHype
KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language ModelsCode1
RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of ExpertsCode1
PrefixKV: Adaptive Prefix KV Cache is What Vision Instruction-Following Models Need for Efficient GenerationCode1
Agri-LLaVA: Knowledge-Infused Large Multimodal Assistant on Agricultural Pests and DiseasesCode1
SetLexSem Challenge: Using Set Operations to Evaluate the Lexical and Semantic Robustness of Language ModelsCode1
Constraint Back-translation Improves Complex Instruction Following of Large Language ModelsCode1
LLaMo: Large Language Model-based Molecular Graph AssistantCode1
DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate HallucinationsCode1
Cross-model Control: Improving Multiple Large Language Models in One-time TrainingCode1
ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language TuningCode1
GATEAU: Selecting Influential Samples for Long Context AlignmentCode1
LoGU: Long-form Generation with Uncertainty ExpressionsCode1
Do LLMs "know" internally when they follow instructions?Code1
RuleRAG: Rule-guided retrieval-augmented generation with language models for question answeringCode1
Language Imbalance Driven Rewarding for Multilingual Self-improvingCode1
CoPESD: A Multi-Level Surgical Motion Dataset for Training Large Vision-Language Models to Co-Pilot Endoscopic Submucosal DissectionCode1
Reward-Augmented Data Enhances Direct Preference Alignment of LLMsCode1
A Recipe For Building a Compliant Real Estate ChatbotCode1
MedQA-CS: Benchmarking Large Language Models Clinical Skills Using an AI-SCE FrameworkCode1
LASeR: Learning to Adaptively Select Reward Models with Multi-Armed BanditsCode1
Ruler: A Model-Agnostic Method to Control Generated Length for Large Language ModelsCode1
Infer Human's Intentions Before Following Natural Language InstructionsCode1
EventHallusion: Diagnosing Event Hallucinations in Video LLMsCode1
MM-CamObj: A Comprehensive Multimodal Dataset for Camouflaged Object ScenariosCode1
ToolPlanner: A Tool Augmented LLM for Multi Granularity Instructions with Path Planning and FeedbackCode1
Instruction Following without Instruction TuningCode1
ChemEval: A Comprehensive Multi-Level Chemical Evaluation for Large Language ModelsCode1
Unlocking Reasoning Potential in Large Langauge Models by Scaling Code-form PlanningCode1
Diversify and Conquer: Diversity-Centric Data Selection with Iterative RefinementCode1
LongGenBench: Benchmarking Long-Form Generation in Long Context LLMsCode1
Ex3: Automatic Novel Writing by Extracting, Excelsior and ExpandingCode1
LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMsCode1
Bridging and Modeling Correlations in Pairwise Data for Direct Preference OptimizationCode1
Investigating Instruction Tuning Large Language Models on GraphsCode1
WalledEval: A Comprehensive Safety Evaluation Toolkit for Large Language ModelsCode1
Extend Model Merging from Fine-Tuned to Pre-Trained Large Language Models via Weight DisentanglementCode1
ReALFRED: An Embodied Instruction Following Benchmark in Photo-Realistic EnvironmentsCode1
Efficient Inference of Vision Instruction-Following Models with Elastic CacheCode1
DISCO: Embodied Navigation and Interaction via Differentiable Scene Semantics and Dual-level ControlCode1
EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote SensingCode1
SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic FinetuningCode1
LIONs: An Empirically Optimized Approach to Align Language ModelsCode1
Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMsCode1
MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMsCode1
The SIFo Benchmark: Investigating the Sequential Instruction Following Ability of Large Language ModelsCode1
MM-Instruct: Generated Visual Instructions for Large Multimodal Model AlignmentCode1
Suri: Multi-constraint Instruction Following for Long-form Text GenerationCode1
AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language ModelsCode1
RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository ScaleCode1
Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMsCode1
Show:102550
← PrevPage 6 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified