SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 901950 of 1135 papers

TitleStatusHype
Unveiling the Misuse Potential of Base Large Language Models via In-Context Learning0
Sketch-Plan-Generalize: Learning and Planning with Neuro-Symbolic Programmatic Representations for Inductive Spatial Concepts0
CodecLM: Aligning Language Models with Tailored Synthetic Data0
Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs0
Teaching Llama a New Language Through Cross-Lingual Knowledge TransferCode0
CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues0
An Incomplete Loop: Deductive, Inductive, and Abductive Learning in Large Language Models0
HyperCLOVA X Technical Report0
Token-Efficient Leverage Learning in Large Language ModelsCode0
LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction0
Learning by Correction: Efficient Tuning Task for Zero-Shot Generative Vision-Language ReasoningCode0
CoDa: Constrained Generation based Data Augmentation for Low-Resource NLPCode0
Small Language Models Learn Enhanced Reasoning Skills from Medical Textbooks0
Plug-and-Play Grounding of Reasoning in Multimodal Large Language Models0
InstUPR : Instruction-based Unsupervised Passage Reranking with Large Language ModelsCode0
RL for Consistency Models: Faster Reward Guided Text-to-Image Generation0
WangchanLion and WangchanX MRC EvalCode0
Argument Quality Assessment in the Age of Instruction-Following Large Language Models0
Few-shot Dialogue Strategy Learning for Motivational Interviewing via Inductive Reasoning0
Improving the Robustness of Large Language Models via Consistency Alignment0
Building Accurate Translation-Tailored LLMs with Language Aware Instruction TuningCode0
VisualCritic: Making LMMs Perceive Visual Quality Like Humans0
WoLF: Wide-scope Large Language Model Framework for CXR Understanding0
Third-Party Language Model Performance Prediction from InstructionCode0
Don't Half-listen: Capturing Key-part Information in Continual Instruction Tuning0
Mitigating Dialogue Hallucination for Large Vision Language Models via Adversarial Instruction Tuning0
DiffChat: Learning to Chat with Text-to-Image Synthesis Models for Interactive Image Creation0
CoTBal: Comprehensive Task Balancing for Multi-Task Visual Instruction Tuning0
Aligners: Decoupling LLMs and AlignmentCode0
KIWI: A Dataset of Knowledge-Intensive Writing Instructions for Answering Research Questions0
X-Shot: A Unified System to Handle Frequent, Few-shot and Zero-shot Learning Simultaneously in ClassificationCode0
CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following0
OPEx: A Component-Wise Analysis of LLM-Centric Agents in Embodied Instruction Following0
Collaborative decoding of critical tokens for boosting factuality of large language models0
Think Big, Generate Quick: LLM-to-SLM for Fast Autoregressive Decoding0
NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigation0
Towards Robust Instruction Tuning on Multimodal Large Language ModelsCode0
Zero-shot cross-lingual transfer in instruction tuning of large language models0
Unintended Impacts of LLM Alignment on Global RepresentationCode0
Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking0
RefuteBench: Evaluating Refuting Instruction-Following for Large Language ModelsCode0
VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Models0
Investigating Multilingual Instruction-Tuning: Do Polyglot Models Demand for Multilingual Instructions?0
CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models0
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models0
The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional AnalysisCode0
Transformer-based Causal Language Models Perform Clustering0
Aligning Large Language Models by On-Policy Self-JudgmentCode0
AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility EstimationCode0
Efficient Prompt Optimization Through the Lens of Best Arm Identification0
Show:102550
← PrevPage 19 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified