SOTAVerified

The Arcade Learning Environment: An Evaluation Platform for General Agents

2012-07-19Code Available0· sign in to hype

Marc G. Bellemare, Yavar Naddaf, Joel Veness, Michael Bowling

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

In this article we introduce the Arcade Learning Environment (ALE): both a challenge problem and a platform and methodology for evaluating the development of general, domain-independent AI technology. ALE provides an interface to hundreds of Atari 2600 game environments, each one different, interesting, and designed to be a challenge for human players. ALE presents significant research challenges for reinforcement learning, model learning, model-based planning, imitation learning, transfer learning, and intrinsic motivation. Most importantly, it provides a rigorous testbed for evaluating and comparing approaches to these problems. We illustrate the promise of ALE by developing and benchmarking domain-independent agents designed using well-established AI techniques for both reinforcement learning and planning. In doing so, we also propose an evaluation methodology made possible by ALE, reporting empirical results on over 55 different games. All of the software, including the benchmark agents, is publicly available.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
Atari 2600 AlienUCTScore7,785Unverified
Atari 2600 AlienBest LearnerScore939.2Unverified
Atari 2600 AmidarBest LearnerScore103.4Unverified
Atari 2600 AmidarUCTScore180.3Unverified
Atari 2600 AssaultUCTScore1,512.2Unverified
Atari 2600 AssaultBest LearnerScore628Unverified
Atari 2600 AsterixBest LearnerScore987.3Unverified
Atari 2600 AsterixUCTScore290,700Unverified
Atari 2600 AsteroidsBest LearnerScore907.3Unverified
Atari 2600 AsteroidsUCTScore4,660.6Unverified
Atari 2600 AtlantisBest LearnerScore62,687Unverified
Atari 2600 AtlantisUCTScore193,858Unverified
Atari 2600 Bank HeistUCTScore497.8Unverified
Atari 2600 Bank HeistBest LearnerScore190.8Unverified
Atari 2600 Battle ZoneUCTScore70,333.3Unverified
Atari 2600 Battle ZoneBest LearnerScore15,819.7Unverified
Atari 2600 Beam RiderBest LearnerScore929.4Unverified
Atari 2600 Beam RiderUCTScore6,624.6Unverified
Atari 2600 BerzerkBest BaselineScore670Unverified
Atari 2600 BerzerkBest LearnerScore501.3Unverified
Atari 2600 BowlingBest LearnerScore43.9Unverified
Atari 2600 BoxingUCTScore100Unverified
Atari 2600 BoxingBest LearnerScore44Unverified
Atari 2600 BreakoutBest LearnerScore5.2Unverified
Atari 2600 BreakoutUCTScore364.4Unverified
Atari 2600 CarnivalUCTScore5,132Unverified
Atari 2600 CentipedeBest LearnerScore8,803.8Unverified
Atari 2600 CentipedeFull TreeScore125,123Unverified
Atari 2600 Chopper CommandUCTScore34,018.8Unverified
Atari 2600 Chopper CommandBest LearnerScore1,581.5Unverified
Atari 2600 Crazy ClimberBest LearnerScore23,410.6Unverified
Atari 2600 Crazy ClimberUCTScore98,172.2Unverified
Atari 2600 Demon AttackBest LearnerScore520.5Unverified
Atari 2600 Demon AttackUCTScore28,158.8Unverified
Atari 2600 Double DunkBest LearnerScore-13.1Unverified
Atari 2600 Double DunkUCTScore24Unverified
Atari 2600 Elevator ActionUCTScore18,100Unverified
Atari 2600 EnduroBest LearnerScore129.1Unverified
Atari 2600 EnduroUCTScore286.3Unverified
Atari 2600 Fishing DerbyUCTScore37.8Unverified
Atari 2600 Fishing DerbyBest LearnerScore-89.5Unverified
Atari 2600 FreewayBest LearnerScore19.1Unverified
Atari 2600 FreewayBest BaselineScore22.5Unverified
Atari 2600 FreewayUCTScore0.4Unverified
Atari 2600 FrostbiteBest LearnerScore216.9Unverified
Atari 2600 FrostbiteUCTScore270.5Unverified
Atari 2600 GopherBest LearnerScore1,288.3Unverified
Atari 2600 GopherUCTScore20,560Unverified
Atari 2600 GravitarBest LearnerScore387.7Unverified
Atari 2600 GravitarUCTScore2,850Unverified

Reproductions