SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 326350 of 1135 papers

TitleStatusHype
Inferring Rewards from Language in ContextCode1
Evaluating Correctness and Faithfulness of Instruction-Following Models for Question AnsweringCode1
IDA-Bench: Evaluating LLMs on Interactive Guided Data AnalysisCode1
MM-CamObj: A Comprehensive Multimodal Dataset for Camouflaged Object ScenariosCode1
Instruct and Extract: Instruction Tuning for On-Demand Information ExtractionCode1
ChartInstruct: Instruction Tuning for Chart Comprehension and ReasoningCode1
MMIDR: Teaching Large Language Model to Interpret Multimodal Misinformation via Knowledge DistillationCode1
DocLens: Multi-aspect Fine-grained Evaluation for Medical Text GenerationCode1
Facial Affective Behavior Analysis with Instruction TuningCode1
Enhancing Cross-Tokenizer Knowledge Distillation with Contextual Dynamical MappingCode1
AlchemistCoder: Harmonizing and Eliciting Code Capability by Hindsight Tuning on Multi-source DataCode1
FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language ModelsCode1
Investigating Instruction Tuning Large Language Models on GraphsCode1
CB2: Collaborative Natural Language Interaction Research PlatformCode1
Instruction Position Matters in Sequence Generation with Large Language ModelsCode1
Hybrid Alignment Training for Large Language ModelsCode1
Instruction-Tuning Data Synthesis from Scratch via Web ReconstructionCode1
Few-shot Object Grounding and Mapping for Natural Language Robot Instruction FollowingCode1
Alexa Arena: A User-Centric Interactive Platform for Embodied AICode1
FILM: Following Instructions in Language with Modular MethodsCode1
Finding Blind Spots in Evaluator LLMs with Interpretable ChecklistsCode1
MM-Instruct: Generated Visual Instructions for Large Multimodal Model AlignmentCode1
Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play ApproachCode1
InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset ConstructionCode1
Monte Carlo Thought Search: Large Language Model Querying for Complex Scientific Reasoning in Catalyst DesignCode1
Show:102550
← PrevPage 14 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified