SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 501525 of 1135 papers

TitleStatusHype
1.5-Pints Technical Report: Pretraining in Days, Not Months -- Your Language Model Thrives on Quality DataCode3
Extend Model Merging from Fine-Tuned to Pre-Trained Large Language Models via Weight DisentanglementCode1
A Framework for Fine-Tuning LLMs using Heterogeneous Feedback0
Semantic Skill Grounding for Embodied Instruction-Following in Cross-Domain Environments0
Dancing in Chains: Reconciling Instruction Following and Faithfulness in Language ModelsCode0
Autonomous Improvement of Instruction Following Skills via Foundation ModelsCode2
SeaLLMs 3: Open Foundation and Chat Multilingual Large Language Models for Southeast Asian LanguagesCode2
SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domain0
ReALFRED: An Embodied Instruction Following Benchmark in Photo-Realistic EnvironmentsCode1
Efficient Inference of Vision Instruction-Following Models with Elastic CacheCode1
HAPFI: History-Aware Planning based on Fused Information0
PrimeGuard: Safe and Helpful LLMs through Tuning-Free RoutingCode0
Failures to Find Transferable Image Jailbreaks Between Vision-Language Models0
DISCO: Embodied Navigation and Interaction via Differentiable Scene Semantics and Dual-level ControlCode1
ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities0
EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote SensingCode1
NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language ModelsCode3
SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic FinetuningCode1
Situated Instruction Following0
Qwen2-Audio Technical ReportCode7
Empowering Persian LLMs for Instruction Following: A Novel Dataset and Training ApproachCode0
Instruction Following with Goal-Conditioned Reinforcement Learning in Virtual EnvironmentsCode0
Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Models0
LIONs: An Empirically Optimized Approach to Align Language ModelsCode1
LVLM-empowered Multi-modal Representation Learning for Visual Place Recognition0
Show:102550
← PrevPage 21 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified