Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 881–890 of 1135 papers

Title	Date	Tasks	Status	Hype
An Emulator for Fine-Tuning Large Language Models using Small Language Models	Oct 19, 2023	Instruction Following	CodeCode Available	1
LACMA: Language-Aligning Contrastive Learning with Meta-Actions for Embodied Instruction Following	Oct 18, 2023	Contrastive LearningInstruction Following	CodeCode Available	0
LoHoRavens: A Long-Horizon Language-Conditioned Benchmark for Robotic Tabletop Manipulation	Oct 18, 2023	Caption GenerationInstruction Following	—Unverified	0
Quantifying Self-diagnostic Atomic Knowledge in Chinese Medical Foundation Model: A Computational Analysis	Oct 18, 2023	DiagnosticInstruction Following	CodeCode Available	0
VeRA: Vector-based Random Matrix Adaptation	Oct 17, 2023	image-classificationImage Classification	—Unverified	0
Gaining Wisdom from Setbacks: Aligning Large Language Models via Mistake Analysis	Oct 16, 2023	Instruction Following	—Unverified	0
Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning	Oct 14, 2023	In-Context LearningInstruction Following	—Unverified	0
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization	Oct 12, 2023	Instruction Following	—Unverified	0
GROOT: Learning to Follow Instructions by Watching Gameplay Videos	Oct 12, 2023	DecoderInstruction Following	—Unverified	0
Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models	Oct 11, 2023	AttributeInstruction Following	—Unverified	0

Show:10 25 50

← PrevPage 89 of 114Next →

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AutoIF (Llama3 70B)	Inst-level loose-accuracy	90.4	—	Unverified
2	AutoIF (Qwen2 72B)	Inst-level loose-accuracy	88	—	Unverified
3	GPT-4	Inst-level loose-accuracy	85.37	—	Unverified
4	PaLM 2 S	Inst-level loose-accuracy	59.11	—	Unverified