SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 651700 of 1135 papers

TitleStatusHype
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models0
From Persona to Personalization: A Survey on Role-Playing Language Agents0
URL: Universal Referential Knowledge Linking via Task-instructed Representation CompressionCode0
From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Language ModelsCode2
Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models0
GSCo: Towards Generalizable AI in Medicine via Generalist-Specialist CollaborationCode2
Socratic Planner: Self-QA-Based Zero-Shot Planning for Embodied Instruction Following0
The Instruction Hierarchy: Training LLMs to Prioritize Privileged InstructionsCode1
Look Before You Decide: Prompting Active Deduction of MLLMs for Assumptive Reasoning0
Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V0
Unveiling the Misuse Potential of Base Large Language Models via In-Context Learning0
Sketch-Plan-Generalize: Learning and Planning with Neuro-Symbolic Programmatic Representations for Inductive Spatial Concepts0
CodecLM: Aligning Language Models with Tailored Synthetic Data0
Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs0
Facial Affective Behavior Analysis with Instruction TuningCode1
Teaching Llama a New Language Through Cross-Lingual Knowledge TransferCode0
CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues0
Evaluating LLMs at Detecting Errors in LLM ResponsesCode1
An Incomplete Loop: Deductive, Inductive, and Abductive Learning in Large Language Models0
Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language ModelsCode2
HyperCLOVA X Technical Report0
Learning by Correction: Efficient Tuning Task for Zero-Shot Generative Vision-Language ReasoningCode0
LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction0
Token-Efficient Leverage Learning in Large Language ModelsCode0
Direct Preference Optimization of Video Large Multimodal Models from Language Model RewardCode2
CoDa: Constrained Generation based Data Augmentation for Low-Resource NLPCode0
Small Language Models Learn Enhanced Reasoning Skills from Medical Textbooks0
Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You WantCode2
Plug-and-Play Grounding of Reasoning in Multimodal Large Language Models0
Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLMCode2
LITA: Language Instructed Temporal-Localization AssistantCode2
RL for Consistency Models: Faster Reward Guided Text-to-Image Generation0
FlashFace: Human Image Personalization with High-fidelity Identity PreservationCode3
InstUPR : Instruction-based Unsupervised Passage Reranking with Large Language ModelsCode0
Argument Quality Assessment in the Age of Instruction-Following Large Language Models0
WangchanLion and WangchanX MRC EvalCode0
Few-shot Dialogue Strategy Learning for Motivational Interviewing via Inductive Reasoning0
Building Accurate Translation-Tailored LLMs with Language Aware Instruction TuningCode0
Improving the Robustness of Large Language Models via Consistency Alignment0
MMIDR: Teaching Large Language Model to Interpret Multimodal Misinformation via Knowledge DistillationCode1
RewardBench: Evaluating Reward Models for Language ModelingCode4
WoLF: Wide-scope Large Language Model Framework for CXR Understanding0
VisualCritic: Making LMMs Perceive Visual Quality Like Humans0
Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language ModelsCode2
Third-Party Language Model Performance Prediction from InstructionCode0
MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World ControlCode2
Mitigating Dialogue Hallucination for Large Vision Language Models via Adversarial Instruction Tuning0
Don't Half-listen: Capturing Key-part Information in Continual Instruction Tuning0
ChartInstruct: Instruction Tuning for Chart Comprehension and ReasoningCode1
CoIN: A Benchmark of Continual Instruction tuNing for Multimodel Large Language ModelCode2
Show:102550
← PrevPage 14 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified