SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 551–600 of 1135 papers

TitleStatusHype
Self-Powered LLM Modality Expansion for Large Speech-Text ModelsCode0
POROver: Improving Safety and Reducing Overrefusal in Large Language Models with Overgeneration and Preference OptimizationCode0
Language as an Abstraction for Hierarchical Deep Reinforcement LearningCode0
Generalization Analogies: A Testbed for Generalizing AI Oversight to Hard-To-Measure DomainsCode0
MpoxVLM: A Vision-Language Model for Diagnosing Skin Lesions from Mpox Virus InfectionCode0
Semantic Graphs for Syntactic Simplification: A Revisit from the Age of LLMCode0
Preference-Guided Reflective Sampling for Aligning Language ModelsCode0
Unintended Impacts of LLM Alignment on Global RepresentationCode0
Pre-Learning Environment Representations for Data-Efficient Neural Instruction FollowingCode0
Generative Visual Instruction TuningCode0
Language-Conditioned Change-point Detection to Identify Sub-Tasks in Robotics DomainsCode0
Disperse-Then-Merge: Pushing the Limits of Instruction Tuning via Alignment Tax ReductionCode0
PrimeGuard: Safe and Helpful LLMs through Tuning-Free RoutingCode0
GoalNet: Inferring Conjunctive Goal Predicates from Human Plan Demonstrations for Robot Instruction FollowingCode0
Instruction Makes a DifferenceCode0
ProgCo: Program Helps Self-Correction of Large Language ModelsCode0
TF1-EN-3M: Three Million Synthetic Moral Fables for Training Small, Open Language ModelsCode0
LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-SteeringCode0
Grade Score: Quantifying LLM Performance in Option SelectionCode0
Building Accurate Translation-Tailored LLMs with Language Aware Instruction TuningCode0
Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation LearningCode0
Bayesian Calibration of Win Rate Estimation with LLM EvaluatorsCode0
Look Wide and Interpret Twice: Improving Performance on Interactive Instruction-following TasksCode0
Analysis of Language Change in Collaborative Instruction FollowingCode0
Multi-Level Compositional Reasoning for Interactive Instruction FollowingCode0
WildIFEval: Instruction Following in the WildCode0
Compositionality as Lexical SymmetryCode0
Quantifying Self-diagnostic Atomic Knowledge in Chinese Medical Foundation Model: A Computational AnalysisCode0
InstructAny2Pix: Flexible Visual Editing via Multimodal Instruction FollowingCode0
Cuckoo: An IE Free Rider Hatched by Massive Nutrition in LLM's NestCode0
Synthetic Programming Elicitation for Text-to-Code in Very Low-Resource Programming and Formal LanguagesCode0
Guiding Policies with Language via Meta-LearningCode0
Token-Efficient Leverage Learning in Large Language ModelsCode0
HalLoc: Token-level Localization of Hallucinations for Vision Language ModelsCode0
LIFBench: Evaluating the Instruction Following Performance and Stability of Large Language Models in Long-Context ScenariosCode0
LIFEBench: Evaluating Length Instruction Following in Large Language ModelsCode0
Sloth: scaling laws for LLM skills to predict multi-benchmark performance across familiesCode0
IndiVec: An Exploration of Leveraging Large Language Models for Media Bias Detection with Fine-Grained Bias IndicatorsCode0
Automated curriculum generation for Policy Gradients from DemonstrationsCode0
Iterative Label Refinement Matters More than Preference Optimization under Weak SupervisionCode0
Opt-Out: Investigating Entity-Level Unlearning for Large Language Models via Optimal TransportCode0
Hierarchical Modular Framework for Long Horizon Instruction FollowingCode0
Rate, Explain and Cite (REC): Enhanced Explanation and Attribution in Automatic Evaluation by Large Language ModelsCode0
Alignment-based compositional semantics for instruction followingCode0
Align^2LLaVA: Cascaded Human and Large Language Model Preference Alignment for Multi-modal Instruction CurationCode0
DialMAT: Dialogue-Enabled Transformer with Moment-Based Adversarial TrainingCode0
Compositional Image Retrieval via Instruction-Aware Contrastive LearningCode0
SOTOPIA-Ω: Dynamic Strategy Injection Learning and Social Instruction Following Evaluation for Social AgentsCode0
Implicit Cross-Lingual Rewarding for Efficient Multilingual Preference AlignmentCode0
Mapping Instructions to Actions in 3D Environments with Visual Goal PredictionCode0
Show:102550
← PrevPage 12 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified