SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 726750 of 1135 papers

TitleStatusHype
SlideChat: A Large Vision-Language Assistant for Whole-Slide Pathology Image Understanding0
Improving Instruction-Following in Language Models through Activation Steering0
Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling0
ForgeryGPT: Multimodal Large Language Model For Explainable Image Forgery Detection and Localization0
DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World Model0
Optimizing Instruction Synthesis: Effective Exploration of Evolutionary Space with Tree Search0
Balancing Continuous Pre-Training and Instruction Fine-Tuning: Optimizing Instruction-Following in LLMs0
How to Leverage Demonstration Data in Alignment for Large Language Model? A Self-Imitation Learning PerspectiveCode0
Thinking LLMs: General Instruction Following with Thought Generation0
Conversational Code Generation: a Case Study of Designing a Dialogue System for Generating Driving Scenarios for Testing Autonomous Vehicles0
Surgical-LLaVA: Toward Surgical Scenario Understanding via Large Language and Vision Models0
Are You Human? An Adversarial Benchmark to Expose LLMs0
SeRA: Self-Reviewing and Alignment of Large Language Models using Implicit Reward Margins0
Nudging: Inference-time Alignment of LLMs via Guided Decoding0
Evolutionary Contrastive Distillation for Language Model Alignment0
Instructional Segment Embedding: Improving LLM Safety with Instruction Hierarchy0
LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraints0
Self-Boosting Large Language Models with Synthetic Preference Data0
HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understanding0
Large Language Model Compression with Neural Architecture Search0
ReIFE: Re-evaluating Instruction-Following EvaluationCode0
Direct Preference Optimization for LLM-Enhanced Recommendation Systems0
Multimodal Situational Safety0
TOWER: Tree Organized Weighting for Evaluating Complex Instructions0
Only-IF:Revealing the Decisive Effect of Instruction Diversity on Generalization0
Show:102550
← PrevPage 30 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified