SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 451–500 of 1135 papers

TitleStatusHype
Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation LearningCode0
InstructAny2Pix: Flexible Visual Editing via Multimodal Instruction FollowingCode0
Towards Robust Instruction Tuning on Multimodal Large Language ModelsCode0
Robust Multi-Objective Controlled Decoding of Large Language ModelsCode0
RoleMRC: A Fine-Grained Composite Benchmark for Role-Playing and Instruction-FollowingCode0
IndiVec: An Exploration of Leveraging Large Language Models for Media Bias Detection with Fine-Grained Bias IndicatorsCode0
DialMAT: Dialogue-Enabled Transformer with Moment-Based Adversarial TrainingCode0
Rewrite to Jailbreak: Discover Learnable and Transferable Implicit Harmfulness InstructionCode0
Re-Imagining Multimodal Instruction Tuning: A Representation ViewCode0
ReIFE: Re-evaluating Instruction-Following EvaluationCode0
Rate, Explain and Cite (REC): Enhanced Explanation and Attribution in Automatic Evaluation by Large Language ModelsCode0
Improving Instruction Following in Language Models through Proxy-Based Uncertainty EstimationCode0
RefuteBench: Evaluating Refuting Instruction-Following for Large Language ModelsCode0
Implicit Cross-Lingual Rewarding for Efficient Multilingual Preference AlignmentCode0
Being Strong Progressively! Enhancing Knowledge Distillation of Large Language Models through a Curriculum Learning FrameworkCode0
IFShip: Interpretable Fine-grained Ship Classification with Domain Knowledge-Enhanced Vision-Language ModelsCode0
Bayesian Calibration of Win Rate Estimation with LLM EvaluatorsCode0
Identifying Reliable Evaluation Metrics for Scientific Text RevisionCode0
PrimeGuard: Safe and Helpful LLMs through Tuning-Free RoutingCode0
ProgCo: Program Helps Self-Correction of Large Language ModelsCode0
Preference-Guided Reflective Sampling for Aligning Language ModelsCode0
Pre-Learning Environment Representations for Data-Efficient Neural Instruction FollowingCode0
Quantifying Self-diagnostic Atomic Knowledge in Chinese Medical Foundation Model: A Computational AnalysisCode0
Playpen: An Environment for Exploring Learning Through Conversational InteractionCode0
HREF: Human Response-Guided Evaluation of Instruction Following in Language ModelsCode0
How You Prompt Matters! Even Task-Oriented Constraints in Instructions Affect LLM-Generated Text DetectionCode0
How Trustworthy are Open-Source LLMs? An Assessment under Malicious Demonstrations Shows their VulnerabilitiesCode0
How to Leverage Demonstration Data in Alignment for Large Language Model? A Self-Imitation Learning PerspectiveCode0
Phased Instruction Fine-Tuning for Large Language ModelsCode0
Policy Improvement using Language Feedback ModelsCode0
Cuckoo: An IE Free Rider Hatched by Massive Nutrition in LLM's NestCode0
CS4: Measuring the Creativity of Large Language Models Automatically by Controlling the Number of Story-Writing ConstraintsCode0
AdaPPA: Adaptive Position Pre-Fill Jailbreak Attack Approach Targeting LLMsCode0
PediaBench: A Comprehensive Chinese Pediatric Dataset for Benchmarking Large Language ModelsCode0
POROver: Improving Safety and Reducing Overrefusal in Large Language Models with Overgeneration and Preference OptimizationCode0
Hierarchical Modular Framework for Long Horizon Instruction FollowingCode0
Order Matters: Investigate the Position Bias in Multi-constraint Instruction FollowingCode0
Cross-lingual Transfer of Reward Models in Multilingual AlignmentCode0
Optimal Transport-Based Token Weighting scheme for Enhanced Preference OptimizationCode0
Alignment-based compositional semantics for instruction followingCode0
HalLoc: Token-level Localization of Hallucinations for Vision Language ModelsCode0
Guiding Policies with Language via Meta-LearningCode0
Dancing in Chains: Reconciling Instruction Following and Faithfulness in Language ModelsCode0
On the Loss of Context-awareness in General Instruction Fine-tuningCode0
Aligning Large Language Models by On-Policy Self-JudgmentCode0
CORDIAL: Can Multimodal Large Language Models Effectively Understand Coherence Relationships?Code0
Grade Score: Quantifying LLM Performance in Option SelectionCode0
MuSC: Improving Complex Instruction Following with Multi-granularity Self-Contrastive TrainingCode0
GoalNet: Inferring Conjunctive Goal Predicates from Human Plan Demonstrations for Robot Instruction FollowingCode0
Automated curriculum generation for Policy Gradients from DemonstrationsCode0
Show:102550
← PrevPage 10 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified