SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 651675 of 1135 papers

TitleStatusHype
Instruction-Following Speech Recognition0
Aligner: One Global Token is Worth Millions of Parameters When Aligning Large Language Models0
Instruction Mining: Instruction Data Selection for Tuning Large Language Models0
Tests as Prompt: A Test-Driven-Development Benchmark for LLM Code Generation0
Instruction Tuning on Public Government and Cultural Data for Low-Resource Language: a Case Study in Kazakh0
CycleAlign: Iterative Distillation from Black-box LLM to White-box Models for Better Human Alignment0
Text as Image: Learning Transferable Adapter for Multi-Label Classification0
Only-IF:Revealing the Decisive Effect of Instruction Diversity on Generalization0
Integrating Arithmetic Learning Improves Mathematical Reasoning in Smaller Models0
Failures to Find Transferable Image Jailbreaks Between Vision-Language Models0
Internalized Self-Correction for Large Language Models0
InternLM-XComposer2.5-Reward: A Simple Yet Effective Multi-Modal Reward Model0
Refine Large Language Model Fine-tuning via Instruction Vector0
Inverse Reinforcement Learning with Natural Language Goals0
Investigating Multilingual Instruction-Tuning: Do Polyglot Models Demand for Multilingual Instructions?0
Investigating Non-Transitivity in LLM-as-a-Judge0
Investigating the Impact of Data Contamination of Large Language Models in Text-to-SQL Translation0
IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization0
Advancing Mathematical Reasoning in Language Models: The Impact of Problem-Solving Data, Data Synthesis Methods, and Training Stages0
Iterative Data Generation with Large Language Models for Aspect-based Sentiment Analysis0
Iterative Value Function Optimization for Guided Decoding0
Iterative Vision-and-Language Navigation0
JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent0
Adaptive Detoxification: Safeguarding General Capabilities of LLMs through Toxicity-Aware Knowledge Editing0
Joint Embeddings for Graph Instruction Tuning0
Show:102550
← PrevPage 27 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified