SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 10011050 of 1135 papers

TitleStatusHype
Incorporating Visual Experts to Resolve the Information Loss in Multimodal Large Language Models0
Inference-Time Language Model Alignment via Integrated Value Guidance0
Teach Better or Show Smarter? On Instructions and Exemplars in Automatic Prompt Optimization0
Data Diversity Matters for Robust Instruction Tuning0
InSerter: Speech Instruction Following with Unsupervised Interleaved Pre-training0
InsightEdit: Towards Better Instruction Following for Image Editing0
DAFE: LLM-Based Evaluation Through Dynamic Arbitration for Free-Form Question-Answering0
Temporal Representation Alignment: Successor Features Enable Emergent Compositionality in Robot Instruction Following0
InstructBooth: Instruction-following Personalized Text-to-Image Generation0
Attend and Enrich: Enhanced Visual Prompt for Zero-Shot Learning0
Instructional Segment Embedding: Improving LLM Safety with Instruction Hierarchy0
InstructionCP: A fast approach to transfer Large Language Models into target language0
Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game0
Instruction Following by Boosting Attention of Large Language Models0
D3: Diversity, Difficulty, and Dependability-Aware Data Selection for Sample-Efficient LLM Instruction Tuning0
Instruction-following Evaluation through Verbalizer Manipulation0
Instruction-Following Pruning for Large Language Models0
Instruction-Following Speech Recognition0
Aligner: One Global Token is Worth Millions of Parameters When Aligning Large Language Models0
Instruction Mining: Instruction Data Selection for Tuning Large Language Models0
Tests as Prompt: A Test-Driven-Development Benchmark for LLM Code Generation0
Instruction Tuning on Public Government and Cultural Data for Low-Resource Language: a Case Study in Kazakh0
CycleAlign: Iterative Distillation from Black-box LLM to White-box Models for Better Human Alignment0
Text as Image: Learning Transferable Adapter for Multi-Label Classification0
Only-IF:Revealing the Decisive Effect of Instruction Diversity on Generalization0
Integrating Arithmetic Learning Improves Mathematical Reasoning in Smaller Models0
Failures to Find Transferable Image Jailbreaks Between Vision-Language Models0
Internalized Self-Correction for Large Language Models0
InternLM-XComposer2.5-Reward: A Simple Yet Effective Multi-Modal Reward Model0
Refine Large Language Model Fine-tuning via Instruction Vector0
Inverse Reinforcement Learning with Natural Language Goals0
Investigating Multilingual Instruction-Tuning: Do Polyglot Models Demand for Multilingual Instructions?0
Investigating Non-Transitivity in LLM-as-a-Judge0
Investigating the Impact of Data Contamination of Large Language Models in Text-to-SQL Translation0
IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization0
Advancing Mathematical Reasoning in Language Models: The Impact of Problem-Solving Data, Data Synthesis Methods, and Training Stages0
Iterative Data Generation with Large Language Models for Aspect-based Sentiment Analysis0
Iterative Value Function Optimization for Guided Decoding0
Iterative Vision-and-Language Navigation0
JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent0
Adaptive Detoxification: Safeguarding General Capabilities of LLMs through Toxicity-Aware Knowledge Editing0
Joint Embeddings for Graph Instruction Tuning0
Joint Flashback Adaptation for Forgetting-Resistant Instruction Tuning0
The Hidden Space of Safety: Understanding Preference-Tuned LLMs in Multilingual context0
KAUCUS: Knowledge Augmented User Simulators for Training Language Model Assistants0
Keypoints-Integrated Instruction-Following Data Generation for Enhanced Human Pose Understanding in Multimodal Models0
KITE: Keypoint-Conditioned Policies for Semantic Manipulation0
KIT's Offline Speech Translation and Instruction Following Submission for IWSLT 20250
KIWI: A Dataset of Knowledge-Intensive Writing Instructions for Answering Research Questions0
CROME: Cross-Modal Adapters for Efficient Multimodal LLM0
Show:102550
← PrevPage 21 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified