SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1001–1050 of 1135 papers

TitleStatusHype
DialMAT: Dialogue-Enabled Transformer with Moment-Based Adversarial TrainingCode0
ChEF: A Comprehensive Evaluation Framework for Standardized Assessment of Multimodal Large Language Models—0
COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning—0
Active Reasoning in an Open-World Environment—0
Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game—0
Multilingual Coarse Political Stance Classification of Media. The Editorial Line of a ChatGPT and Bard Newspaper—0
CycleAlign: Iterative Distillation from Black-box LLM to White-box Models for Better Human Alignment—0
Privately Aligning Language Models with Reinforcement Learning—0
Analyzing Multilingual Competency of LLMs in Multi-Turn Instruction Following: A Case Study of Arabic—0
LACMA: Language-Aligning Contrastive Learning with Meta-Actions for Embodied Instruction FollowingCode0
Quantifying Self-diagnostic Atomic Knowledge in Chinese Medical Foundation Model: A Computational AnalysisCode0
LoHoRavens: A Long-Horizon Language-Conditioned Benchmark for Robotic Tabletop Manipulation—0
VeRA: Vector-based Random Matrix Adaptation—0
Gaining Wisdom from Setbacks: Aligning Large Language Models via Mistake Analysis—0
Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning—0
GROOT: Learning to Follow Instructions by Watching Gameplay Videos—0
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization—0
From Supervised to Generative: A Novel Paradigm for Tabular Deep Learning with Large Language ModelsCode0
Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models—0
SteP: Stacked LLM Policies for Web Actions—0
Benchmarking and Improving Generator-Validator Consistency of Language Models—0
PACIT: Unlocking the Power of Examples for Better In-Context Instruction TuningCode0
SLM: Bridge the thin gap between speech and text foundation models—0
Self-Specialization: Uncovering Latent Expertise within Large Language Models—0
Towards LLM-guided Causal Explainability for Black-box Text Classifiers—0
Frustrated with Code Quality Issues? LLMs can Help!—0
Instruction-Following Speech Recognition—0
Monolingual or Multilingual Instruction Tuning: Which Makes a Better AlpacaCode0
Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference—0
Quantifying and Attributing the Hallucination of Large Language Models via Association Analysis—0
DoG-Instruct: Towards Premium Instruction-Tuning Data via Text-Grounded Instruction WrappingCode0
Efficient Finetuning Large Language Models For Vietnamese Chatbot—0
Improving Open Information Extraction with Large Language Models: A Study on Demonstration Uncertainty—0
Self-driven Grounding: Large Language Model Agents with Automatical Language-aligned Skill Learning—0
FactLLaMA: Optimizing Instruction-Following Language Models with External Knowledge for Automated Fact-Checking—0
Language-Conditioned Change-point Detection to Identify Sub-Tasks in Robotics DomainsCode0
Evaluating the Robustness to Instructions of Large Language Models—0
Empowering Cross-lingual Abilities of Instruction-tuned Large Language Models by Translation-following demonstrationsCode0
MedAlign: A Clinician-Generated Dataset for Instruction Following with Electronic Medical Records—0
UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understanding—0
PUMGPT: A Large Vision-Language Model for Product Understanding—0
Multi-Level Compositional Reasoning for Interactive Instruction FollowingCode0
Evaluating the Instruction-Following Robustness of Large Language Models to Prompt InjectionCode0
LLaMA-E: Empowering E-commerce Authoring with Object-Interleaved Instruction Following—0
Toward Zero-Shot Instruction FollowingCode0
ETHER: Aligning Emergent Communication for Hindsight Experience Replay—0
Instruction-following Evaluation through Verbalizer Manipulation—0
LLM Censorship: A Machine Learning Challenge or a Computer Security Problem?—0
ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuning—0
Exploring the Integration of Large Language Models into Automatic Speech Recognition Systems: An Empirical Study—0
Show:102550
← PrevPage 21 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified