SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 2650 of 1135 papers

TitleStatusHype
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction ModelCode5
LiveBench: A Challenging, Contamination-Limited LLM BenchmarkCode5
Self-Instruct: Aligning Language Models with Self-Generated InstructionsCode5
Jamba-1.5: Hybrid Transformer-Mamba Models at ScaleCode5
Aria: An Open Multimodal Native Mixture-of-Experts ModelCode5
LAB: Large-Scale Alignment for ChatBotsCode5
ImageBind-LLM: Multi-modality Instruction TuningCode5
Instruction-Following Evaluation for Large Language ModelsCode5
Ranni: Taming Text-to-Image Diffusion for Accurate Instruction FollowingCode5
WizardLM: Empowering Large Language Models to Follow Complex InstructionsCode5
LeVo: High-Quality Song Generation with Multi-Preference AlignmentCode5
MMBench: Is Your Multi-modal Model an All-around Player?Code5
Towards Better Instruction Following Language Models for Chinese: Investigating the Impact of Training Data and EvaluationCode5
The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language ModelsCode5
LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One DayCode4
LLaMA Pro: Progressive LLaMA with Block ExpansionCode4
SimPO: Simple Preference Optimization with a Reference-Free RewardCode4
A Survey on Vision-Language-Action Models for Embodied AICode4
Kwai Keye-VL Technical ReportCode4
Instruction Tuning with GPT-4Code4
RewardBench 2: Advancing Reward Model EvaluationCode4
PromptFix: You Prompt and We Fix the PhotoCode4
AgentBench: Evaluating LLMs as AgentsCode4
Parameter Efficient Instruction Tuning: An Empirical StudyCode4
Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt InjectionCode4
Show:102550
← PrevPage 2 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified