Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1111–1120 of 1135 papers

Title	Date	Tasks	Status	Hype
Automated curriculum generation for Policy Gradients from Demonstrations	Dec 1, 2019	Instruction Following	CodeCode Available	0
Language-guided Semantic Mapping and Mobile Manipulation in Partially Observable Environments	Oct 22, 2019	Instruction Following	—Unverified	0
Learning to Map Natural Language Instructions to Physical Quadcopter Control using Simulated Flight	Oct 21, 2019	continuous-controlContinuous Control	CodeCode Available	1
HIGhER : Improving instruction following with Hindsight Generation for Experience Replay	Oct 21, 2019	Instruction FollowingLanguage Acquisition	—Unverified	0
Guided Adaptive Credit Assignment for Sample Efficient Policy Optimization	Sep 25, 2019	Instruction FollowingPolicy Gradient Methods	—Unverified	0
Robust Instruction-Following in a Situated Agent via Transfer-Learning from Text	Sep 25, 2019	Instruction FollowingRepresentation Learning	—Unverified	0
Self-Educated Language Agent with Hindsight Experience Replay for Instruction Following	Sep 25, 2019	Instruction FollowingLanguage Acquisition	—Unverified	0
Pre-Learning Environment Representations for Data-Efficient Neural Instruction Following	Jul 23, 2019	Instruction Following	CodeCode Available	0
Chasing Ghosts: Instruction Following as Bayesian State Tracking	Jul 3, 2019	Instruction FollowingVision and Language Navigation	CodeCode Available	0
Language as an Abstraction for Hierarchical Deep Reinforcement Learning	Jun 18, 2019	Deep Reinforcement LearningInstruction Following	CodeCode Available	0

Show:10 25 50

← PrevPage 112 of 114Next →

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AutoIF (Llama3 70B)	Inst-level loose-accuracy	90.4	—	Unverified
2	AutoIF (Qwen2 72B)	Inst-level loose-accuracy	88	—	Unverified
3	GPT-4	Inst-level loose-accuracy	85.37	—	Unverified
4	PaLM 2 S	Inst-level loose-accuracy	59.11	—	Unverified