SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 851875 of 1135 papers

TitleStatusHype
Instruction-Following Evaluation for Large Language ModelsCode5
MART: Improving LLM Safety with Multi-round Automatic Red-Teaming0
Generalization Analogies: A Testbed for Generalizing AI Oversight to Hard-To-Measure DomainsCode0
To See is to Believe: Prompting GPT-4V for Better Visual Instruction TuningCode2
WaterBench: Towards Holistic Evaluation of Watermarks for Large Language ModelsCode1
InfMLLM: A Unified Framework for Visual-Language TasksCode1
Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small ScorerCode1
DialMAT: Dialogue-Enabled Transformer with Moment-Based Adversarial TrainingCode0
u-LLaVA: Unifying Multi-Modal Tasks via Large Language ModelCode1
LLaVA-Plus: Learning to Use Tools for Creating Multimodal AgentsCode2
Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free LunchCode2
PhoGPT: Generative Pre-training for VietnameseCode2
ChEF: A Comprehensive Evaluation Framework for Standardized Assessment of Multimodal Large Language Models0
COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning0
Active Reasoning in an Open-World Environment0
FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language ModelsCode1
Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game0
Instructive Decoding: Instruction-Tuned Large Language Models are Self-Refiner from Noisy InstructionsCode1
FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language ModelsCode1
Making Large Language Models Better Data CreatorsCode1
Myriad: Large Multimodal Model by Applying Vision Experts for Industrial Anomaly DetectionCode1
Privately Aligning Language Models with Reinforcement Learning0
CycleAlign: Iterative Distillation from Black-box LLM to White-box Models for Better Human Alignment0
Multilingual Coarse Political Stance Classification of Media. The Editorial Line of a ChatGPT and Bard Newspaper0
Instruct and Extract: Instruction Tuning for On-Demand Information ExtractionCode1
Show:102550
← PrevPage 35 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified