SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 10311040 of 1135 papers

TitleStatusHype
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init AttentionCode5
Large Language Model Instruction Following: A Survey of Progresses and ChallengesCode2
Lana: A Language-Capable Navigator for Instruction Following and GenerationCode1
CB2: Collaborative Natural Language Interaction Research PlatformCode1
ChatGPT may Pass the Bar Exam soon, but has a Long Way to Go for the LexGLUE benchmarkCode1
Alexa Arena: A User-Centric Interactive Platform for Embodied AICode1
Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw DatasetCode0
Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction FollowingCode1
Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt InjectionCode4
Natural Language-conditioned Reinforcement Learning with Inside-out Task Language Development and Translation0
Show:102550
← PrevPage 104 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified