Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 951–960 of 1135 papers

Title	Date	Tasks	Status	Hype
Fine-tuning Multimodal LLMs to Follow Zero-shot Demonstrative Instructions	Aug 8, 2023	Caption GenerationImage Captioning	CodeCode Available	2
Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialogue	Aug 7, 2023	Instruction FollowingLanguage Modeling	CodeCode Available	2
AgentBench: Evaluating LLMs as Agents	Aug 7, 2023	Decision MakingInstruction Following	CodeCode Available	4
Toward Zero-Shot Instruction Following	Aug 4, 2023	Instruction Following	CodeCode Available	0
Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering	Jul 31, 2023	Instruction FollowingQuestion Answering	CodeCode Available	1
ETHER: Aligning Emergent Communication for Hindsight Experience Replay	Jul 28, 2023	Inductive BiasInstruction Following	—Unverified	0
L-Eval: Instituting Standardized Evaluation for Long Context Language Models	Jul 20, 2023	Instruction Following	CodeCode Available	6
Instruction-following Evaluation through Verbalizer Manipulation	Jul 20, 2023	Instruction Following	—Unverified	0
FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets	Jul 20, 2023	Instruction FollowingLanguage Model Evaluation	CodeCode Available	2
LLM Censorship: A Machine Learning Challenge or a Computer Security Problem?	Jul 20, 2023	Computer SecurityInstruction Following	—Unverified	0

Show:10 25 50

← PrevPage 96 of 114Next →

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AutoIF (Llama3 70B)	Inst-level loose-accuracy	90.4	—	Unverified
2	AutoIF (Qwen2 72B)	Inst-level loose-accuracy	88	—	Unverified
3	GPT-4	Inst-level loose-accuracy	85.37	—	Unverified
4	PaLM 2 S	Inst-level loose-accuracy	59.11	—	Unverified