SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 276300 of 1135 papers

TitleStatusHype
Demystifying Domain-adaptive Post-training for Financial LLMsCode1
LongViTU: Instruction Tuning for Long-Form Video Understanding0
Language and Planning in Robotic Navigation: A Multilingual Evaluation of State-of-the-Art Models0
DPO Kernels: A Semantically-Aware, Kernel-Enhanced, and Divergence-Rich Paradigm for Direct Preference Optimization0
Instruction-Following Pruning for Large Language Models0
ProgCo: Program Helps Self-Correction of Large Language ModelsCode0
Towards Interactive Deepfake AnalysisCode0
SLADE: Shielding against Dual Exploits in Large Vision-Language Models0
HSI-GPT: A General-Purpose Large Scene-Motion-Language Model for Human Scene Interaction0
MIMO: A Medical Vision Language Model with Visual Referring Multimodal Input and Pixel Grounding Multimodal OutputCode0
TinyHelen's First Curriculum: Training and Evaluating Tiny Language Models in a Simpler Language EnvironmentCode1
Hindsight Planner: A Closed-Loop Few-Shot Planner for Embodied Instruction Following0
Find the Intention of Instruction: Comprehensive Evaluation of Instruction Understanding for Large Language ModelsCode0
Internalized Self-Correction for Large Language Models0
LearnLM: Improving Gemini for Learning0
Align Anything: Training All-Modality Models to Follow Instructions with Language FeedbackCode7
HREF: Human Response-Guided Evaluation of Instruction Following in Language ModelsCode0
Length Controlled Generation for Black-box LLMs0
Qwen2.5 Technical ReportCode13
Systematic Evaluation of Long-Context LLMs on Financial Concepts0
A Systematic Examination of Preference Learning through the Lens of Instruction-Following0
MetaMorph: Multimodal Understanding and Generation via Instruction Tuning0
Pipeline Analysis for Developing Instruct LLMs in Low-Resource Languages: A Case Study on Basque0
Question: How do Large Language Models perform on the Question Answering tasks? Answer:0
LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-SteeringCode0
Show:102550
← PrevPage 12 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified