SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 676700 of 1135 papers

TitleStatusHype
Natural Language-conditioned Reinforcement Learning with Inside-out Task Language Development and Translation0
Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs0
Boosting LLM Translation Skills without General Ability Loss via Rationale Distillation0
NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigation0
Navigating the Alpha Jungle: An LLM-Powered MCTS Framework for Formulaic Factor Mining0
Neural Semantic Parsing0
Nevermind: Instruction Override and Moderation in Large Language Models0
Zero-shot Object-Centric Instruction Following: Integrating Foundation Models with Traditional Navigation0
Triple Phase Transitions: Understanding the Learning Dynamics of Large Language Models from a Neuroscience Perspective0
TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models0
Nudging: Inference-time Alignment of LLMs via Guided Decoding0
BLSP-KD: Bootstrapping Language-Speech Pre-training via Knowledge Distillation0
TuneShield: Mitigating Toxicity in Conversational AI while Fine-tuning on Untrusted Data0
OmniGeo: Towards a Multimodal Large Language Models for Geospatial Artificial Intelligence0
OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents0
On Instruction-Finetuning Neural Machine Translation Models0
Two Experts Are All You Need for Steering Thinking: Reinforcing Cognitive Effort in MoE Reasoning Models Without Additional Training0
TypeScore: A Text Fidelity Metric for Text-to-Image Generative Models0
UAV-VLN: End-to-End Vision Language guided Navigation for UAVs0
UFT: Unifying Fine-Tuning of SFT and RLHF/DPO/UNA through a Generalized Implicit Reward Function0
On the Mechanism of Reasoning Pattern Selection in Reinforcement Learning for Language Models0
UGIF: UI Grounded Instruction Following0
BioMistral-NLU: Towards More Generalizable Medical Language Understanding through Instruction Tuning0
XIFBench: Evaluating Large Language Models on Multilingual Instruction Following0
OpenSearch-SQL: Enhancing Text-to-SQL with Dynamic Few-shot and Consistency Alignment0
Show:102550
← PrevPage 28 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified