SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 211–220 of 1135 papers

TitleStatusHype
SOTOPIA-Ω: Dynamic Strategy Injection Learning and Social Instruction Following Evaluation for Social AgentsCode0
StructFlowBench: A Structured Flow Benchmark for Multi-turn Instruction FollowingCode1
OpenSearch-SQL: Enhancing Text-to-SQL with Dynamic Few-shot and Consistency Alignment—0
Investigating Non-Transitivity in LLM-as-a-Judge—0
TESS 2: A Large-Scale Generalist Diffusion Language ModelCode2
Instruction Tuning on Public Government and Cultural Data for Low-Resource Language: a Case Study in Kazakh—0
TALKPLAY: Multimodal Music Recommendation with Large Language Models—0
MMTEB: Massive Multilingual Text Embedding Benchmark—0
Integrating Arithmetic Learning Improves Mathematical Reasoning in Smaller Models—0
Do we Really Need Visual Instructions? Towards Visual Instruction-Free Fine-tuning for Large Vision-Language Models—0
Show:102550
← PrevPage 22 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified