SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 281–290 of 1135 papers

TitleStatusHype
Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation ExtractorsCode1
AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language ModelsCode1
Context-Aware Planning and Environment-Aware Memory for Instruction Following Embodied AgentsCode1
Constraint Back-translation Improves Complex Instruction Following of Large Language ModelsCode1
LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMsCode1
IHEval: Evaluating Language Models on Following the Instruction HierarchyCode1
LoGU: Long-form Generation with Uncertainty ExpressionsCode1
Monte Carlo Thought Search: Large Language Model Querying for Complex Scientific Reasoning in Catalyst DesignCode1
LLaSA: A Multimodal LLM for Human Activity Analysis Through Wearable and Smartphone SensorsCode1
HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction DataCode1
Show:102550
← PrevPage 29 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified