SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1001–1050 of 1135 papers

TitleStatusHype
Schema-Driven Information Extraction from Heterogeneous TablesCode1
AlpacaFarm: A Simulation Framework for Methods that Learn from Human FeedbackCode3
Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A Preliminary Study on Writing Assistance—0
Lion: Adversarial Distillation of Proprietary Large Language ModelsCode2
LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and GenerationCode1
Multimodal Web Navigation with Instruction-Finetuned Foundation Models—0
Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation ExtractorsCode1
M3KE: A Massive Multi-Level Multi-Subject Knowledge Evaluation Benchmark for Chinese Large Language ModelsCode1
Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach—0
Accessible Instruction-Following Agent—0
Knowledge-enhanced Agents for Interactive Text Games—0
MultiModal-GPT: A Vision and Language Model for Dialogue with HumansCode3
X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign LanguagesCode3
Otter: A Multi-Modal Model with In-Context Instruction TuningCode4
Retrieval Augmented Chest X-Ray Report Generation using OpenAI GPT models—0
Panda LLM: Training Data and Evaluation for Open-Sourced Chinese Instruction-Following Large Language ModelsCode3
Caption Anything: Interactive Image Description with Diverse Multimodal ControlsCode3
Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents—0
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction ModelCode5
Enhancing Large Language Model with Self-Controlled Memory FrameworkCode1
WizardLM: Empowering Large Language Models to Follow Complex InstructionsCode5
Generation-driven Contrastive Self-training for Zero-shot Text Classification with Instruction-following LLMCode1
Visual Instruction TuningCode6
A Comparative Study between Full-Parameter and LoRA-based Fine-Tuning on Chinese Instruction Data for Instruction Following Large Language Model—0
Towards Better Instruction Following Language Models for Chinese: Investigating the Impact of Training Data and EvaluationCode5
Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction Following—0
Instruction Tuning with GPT-4Code4
ParroT: Translating during Chat using Large Language Models tuned with Human Translation and FeedbackCode1
CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model SocietyCode6
ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Models—0
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init AttentionCode5
Large Language Model Instruction Following: A Survey of Progresses and ChallengesCode2
Lana: A Language-Capable Navigator for Instruction Following and GenerationCode1
CB2: Collaborative Natural Language Interaction Research PlatformCode1
ChatGPT may Pass the Bar Exam soon, but has a Long Way to Go for the LexGLUE benchmarkCode1
Alexa Arena: A User-Centric Interactive Platform for Embodied AICode1
Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw DatasetCode0
Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction FollowingCode1
Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt InjectionCode4
Natural Language-conditioned Reinforcement Learning with Inside-out Task Language Development and Translation—0
Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks—0
Distilling Internet-Scale Vision-Language Models into Embodied Agents—0
"No, to the Right" -- Online Language Corrections for Robotic Manipulation via Shared AutonomyCode1
Multimodal Sequential Generative Models for Semi-Supervised Language Instruction Following—0
Precise Zero-Shot Dense Retrieval without Relevance LabelsCode2
Self-Instruct: Aligning Language Models with Self-Generated InstructionsCode5
Continual Learning for Instruction Following from Realtime FeedbackCode0
On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot ReasoningCode1
CLIP-Nav: Using CLIP for Zero-Shot Vision-and-Language Navigation—0
Language-Conditioned Reinforcement Learning to Solve Misunderstandings with Action CorrectionsCode1
Show:102550
← PrevPage 21 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4—Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88—Unverified
3GPT-4Inst-level loose-accuracy85.37—Unverified
4PaLM 2 SInst-level loose-accuracy59.11—Unverified