SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 601610 of 1135 papers

TitleStatusHype
Investigating Non-Transitivity in LLM-as-a-Judge0
Instruction Tuning on Public Government and Cultural Data for Low-Resource Language: a Case Study in Kazakh0
TALKPLAY: Multimodal Music Recommendation with Large Language Models0
MMTEB: Massive Multilingual Text Embedding Benchmark0
Integrating Arithmetic Learning Improves Mathematical Reasoning in Smaller Models0
RoleMRC: A Fine-Grained Composite Benchmark for Role-Playing and Instruction-FollowingCode0
Learning to Keep a Promise: Scaling Language Model Decoding Parallelism with Learned Asynchronous Decoding0
MuSC: Improving Complex Instruction Following with Multi-granularity Self-Contrastive TrainingCode0
SAIF: A Sparse Autoencoder Framework for Interpreting and Steering Instruction Following of Language Models0
Do we Really Need Visual Instructions? Towards Visual Instruction-Free Fine-tuning for Large Vision-Language Models0
Show:102550
← PrevPage 61 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified