SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 1135 papers

TitleStatusHype
LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One DayCode4
Otter: A Multi-Modal Model with In-Context Instruction TuningCode4
Instruction Tuning with GPT-4Code4
Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt InjectionCode4
IFEval-Audio: Benchmarking Instruction-Following Capability in Audio-based Large Language ModelsCode3
LaViDa: A Large Diffusion Language Model for Multimodal UnderstandingCode3
LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech SynthesisCode3
VARGPT-v1.1: Improve Visual Autoregressive Large Unified Model via Iterative Instruction Tuning and Reinforcement LearningCode3
The Breeze 2 Herd of Models: Traditional Chinese LLMs Based on Llama with Vision-Aware and Function-Calling CapabilitiesCode3
VARGPT: Unified Understanding and Generation in a Visual Autoregressive Multimodal Large Language ModelCode3
Meta-Chunking: Learning Text Segmentation and Semantic Completion via Logical PerceptionCode3
ASFT: Aligned Supervised Fine-Tuning through Absolute LikelihoodCode3
ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI SystemsCode3
1.5-Pints Technical Report: Pretraining in Days, Not Months -- Your Language Model Thrives on Quality DataCode3
NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language ModelsCode3
AudioBench: A Universal Benchmark for Audio Large Language ModelsCode3
Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language ModelsCode3
Refusal in Language Models Is Mediated by a Single DirectionCode3
MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM FinetuningCode3
FlashFace: Human Image Personalization with High-fidelity Identity PreservationCode3
ShapeLLM: Universal 3D Object Understanding for Embodied InteractionCode3
SongComposer: A Large Language Model for Lyric and Melody Generation in Song CompositionCode3
EventRL: Enhancing Event Extraction with Outcome Supervision for Large Language ModelsCode3
Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-TuningCode3
OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated LearningCode3
DistiLLM: Towards Streamlined Distillation for Large Language ModelsCode3
LongAlign: A Recipe for Long Context Alignment of Large Language ModelsCode3
Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-AlignmentCode3
SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-ScalingCode3
Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language ModelsCode3
How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data CompositionCode3
How Can Recommender Systems Benefit from Large Language Models: A SurveyCode3
AlpacaFarm: A Simulation Framework for Methods that Learn from Human FeedbackCode3
MultiModal-GPT: A Vision and Language Model for Dialogue with HumansCode3
X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign LanguagesCode3
Panda LLM: Training Data and Evaluation for Open-Sourced Chinese Instruction-Following Large Language ModelsCode3
Caption Anything: Interactive Image Description with Diverse Multimodal ControlsCode3
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP TasksCode3
DrafterBench: Benchmarking Large Language Models for Tasks Automation in Civil EngineeringCode2
DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal AlignmentCode2
Meta SecAlign: A Secure Foundation LLM Against Prompt Injection AttacksCode2
VerIF: Verification Engineering for Reinforcement Learning in Instruction FollowingCode2
FusionAudio-1.2M: Towards Fine-grained Audio Captioning with Multimodal Contextual FusionCode2
When Large Multimodal Models Confront Evolving Knowledge:Challenges and PathwaysCode2
How Instruction and Reasoning Data shape Post-Training: Data Quality through the Lens of Layer-wise GradientsCode2
MM-IFEngine: Towards Multimodal Instruction FollowingCode2
Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language ModelsCode2
CrystalFormer-RL: Reinforcement Fine-Tuning for Materials DesignCode2
Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement LearningCode2
LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction TuningCode2
Show:102550
← PrevPage 2 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified