SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 591–600 of 1135 papers

TitleStatusHype
URO-Bench: A Comprehensive Benchmark for End-to-End Spoken Dialogue Models—0
TextGames: Learning to Self-Play Text-Based Puzzle Games via Language Model ReasoningCode0
UrduLLaMA 1.0: Dataset Curation, Preprocessing, and Evaluation in Low-Resource Settings—0
Capability Instruction Tuning: A New Paradigm for Dynamic LLM RoutingCode0
ATEB: Evaluating and Improving Advanced NLP Tasks for Text Embedding Models—0
Order Matters: Investigate the Position Bias in Multi-constraint Instruction FollowingCode0
NatSGLD: A Dataset with Speech, Gesture, Logic, and Demonstration for Robot Learning in Natural Human-Robot InteractionCode0
Sequence-level Large Language Model Training with Contrastive Preference Optimization—0
SOTOPIA-Ω: Dynamic Strategy Injection Learning and Social Instruction Following Evaluation for Social AgentsCode0
OpenSearch-SQL: Enhancing Text-to-SQL with Dynamic Few-shot and Consistency Alignment—0
Show:102550
← PrevPage 60 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified