More Agents Is All You Need

Code

• github.com/moreagentsisallyouneed/agentforest
  OfficialIn papernone★ 142
• github.com/cklwanfifa/kddcup2024-pst
  none★ 0

Abstract

We find that, simply via a sampling-and-voting method, the performance of large language models (LLMs) scales with the number of agents instantiated. Also, this method, termed as Agent Forest, is orthogonal to existing complicated methods to further enhance LLMs, while the degree of enhancement is correlated to the task difficulty. We conduct comprehensive experiments on a wide range of LLM benchmarks to verify the presence of our finding, and to study the properties that can facilitate its occurrence. Our code is publicly available at: https://github.com/MoreAgentsIsAllYouNeed/AgentForest

Tasks

Reproductions