SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 876–900 of 1135 papers

TitleStatusHype
Analyzing Multilingual Competency of LLMs in Multi-Turn Instruction Following: A Case Study of Arabic—0
AlpaCare:Instruction-tuned Large Language Models for Medical ApplicationCode1
Monte Carlo Thought Search: Large Language Model Querying for Complex Scientific Reasoning in Catalyst DesignCode1
BotChat: Evaluating LLMs' Capabilities of Having Multi-Turn DialoguesCode1
Democratizing Reasoning Ability: Tailored Learning from Large Language ModelCode1
An Emulator for Fine-Tuning Large Language Models using Small Language ModelsCode1
LACMA: Language-Aligning Contrastive Learning with Meta-Actions for Embodied Instruction FollowingCode0
LoHoRavens: A Long-Horizon Language-Conditioned Benchmark for Robotic Tabletop Manipulation—0
Quantifying Self-diagnostic Atomic Knowledge in Chinese Medical Foundation Model: A Computational AnalysisCode0
VeRA: Vector-based Random Matrix Adaptation—0
Gaining Wisdom from Setbacks: Aligning Large Language Models via Mistake Analysis—0
Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning—0
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization—0
GROOT: Learning to Follow Instructions by Watching Gameplay Videos—0
Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models—0
Evaluating Large Language Models at Evaluating Instruction FollowingCode1
From Supervised to Generative: A Novel Paradigm for Tabular Deep Learning with Large Language ModelsCode0
LLark: A Multimodal Instruction-Following Language Model for MusicCode2
TRACE: A Comprehensive Benchmark for Continual Learning in Large Language ModelsCode1
Understanding the Effects of RLHF on LLM Generalisation and DiversityCode1
How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data CompositionCode3
Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New LanguagesCode1
SteP: Stacked LLM Policies for Web Actions—0
Benchmarking and Improving Generator-Validator Consistency of Language Models—0
Use Your INSTINCT: INSTruction optimization for LLMs usIng Neural bandits Coupled with TransformersCode1
Show:102550
← PrevPage 36 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified