SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 201225 of 1135 papers

TitleStatusHype
BLSP-Emo: Towards Empathetic Large Speech-Language ModelsCode2
Learning to Decode Collaboratively with Multiple Language ModelsCode2
DrafterBench: Benchmarking Large Language Models for Tasks Automation in Civil EngineeringCode2
Aligning Modalities in Vision Large Language Models via Preference Fine-tuningCode2
FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsCode2
#InsTag: Instruction Tagging for Analyzing Supervised Fine-tuning of Large Language ModelsCode2
Lion: Adversarial Distillation of Proprietary Large Language ModelsCode2
LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction TuningCode2
ModuLoRA: Finetuning 2-Bit LLMs on Consumer GPUs by Integrating with Modular QuantizersCode2
Beyond Task Performance: Evaluating and Reducing the Flaws of Large Multimodal Models with In-Context LearningCode1
Adaptive Markup Language Generation for Contextually-Grounded Visual Document UnderstandingCode1
A Multi-Modal AI Copilot for Single-Cell Analysis with Instruction FollowingCode1
Language-Conditioned Reinforcement Learning to Solve Misunderstandings with Action CorrectionsCode1
A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language ModelsCode1
Language Imbalance Driven Rewarding for Multilingual Self-improvingCode1
BenchMAX: A Comprehensive Multilingual Evaluation Suite for Large Language ModelsCode1
Benchmarking Large Language Models on Controllable Generation under Diversified InstructionsCode1
Instruction Following without Instruction TuningCode1
Large Language Models as Evaluators for Recommendation ExplanationsCode1
Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable SummarizationCode1
A modular vision language navigation and manipulation framework for long horizon compositional tasks in indoor environmentCode1
Kun: Answer Polishment for Chinese Self-Alignment with Instruction Back-TranslationCode1
Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical StudyCode1
AlpaGasus: Training A Better Alpaca with Fewer DataCode1
KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language ModelsCode1
Show:102550
← PrevPage 9 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified