Evolving simple programs for playing Atari games
Dennis G Wilson, Sylvain Cussat-Blanc, Hervé Luga, Julian F. Miller
Code Available — Be the first to reproduce this paper.
ReproduceCode
Abstract
Cartesian Genetic Programming (CGP) has previously shown capabilities in image processing tasks by evolving programs with a function set specialized for computer vision. A similar approach can be applied to Atari playing. Programs are evolved using mixed type CGP with a function set suited for matrix operations, including image processing, but allowing for controller behavior to emerge. While the programs are relatively small, many controllers are competitive with state of the art methods for the Atari benchmark set and require less training time. By evaluating the programs of the best evolved individuals, simple but effective strategies can be found.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| Atari 2600 Alien | CGP | Score | 1,978 | — | Unverified |
| Atari 2600 Amidar | CGP | Score | 199 | — | Unverified |
| Atari 2600 Assault | CGP | Score | 890.4 | — | Unverified |
| Atari 2600 Asterix | CGP | Score | 1,880 | — | Unverified |
| Atari 2600 Asteroids | CGP | Score | 9,412 | — | Unverified |
| Atari 2600 Atlantis | CGP | Score | 99,240 | — | Unverified |
| Atari 2600 Bank Heist | CGP | Score | 148 | — | Unverified |
| Atari 2600 Battle Zone | CGP | Score | 34,200 | — | Unverified |
| Atari 2600 Beam Rider | CGP | Score | 1,341.6 | — | Unverified |
| Atari 2600 Berzerk | CGP | Score | 1,138 | — | Unverified |
| Atari 2600 Bowling | CGP | Score | 85.8 | — | Unverified |
| Atari 2600 Boxing | CGP | Score | 38.4 | — | Unverified |
| Atari 2600 Breakout | CGP | Score | 13.2 | — | Unverified |
| Atari 2600 Centipede | CGP | Score | 24,708 | — | Unverified |
| Atari 2600 Chopper Command | CGP | Score | 3,580 | — | Unverified |
| Atari 2600 Crazy Climber | CGP | Score | 12,900 | — | Unverified |
| Atari 2600 Defender | CGP | Score | 993,010 | — | Unverified |
| Atari 2600 Demon Attack | CGP | Score | 2,387 | — | Unverified |
| Atari 2600 Double Dunk | CGP | Score | 2 | — | Unverified |
| Atari 2600 Enduro | CGP | Score | 56.8 | — | Unverified |
| Atari 2600 Fishing Derby | CGP | Score | -51 | — | Unverified |
| Atari 2600 Freeway | CGP | Score | 28.2 | — | Unverified |
| Atari 2600 Frostbite | CGP | Score | 782 | — | Unverified |
| Atari 2600 Gopher | CGP | Score | 1,696 | — | Unverified |
| Atari 2600 Gravitar | CGP | Score | 2,350 | — | Unverified |
| Atari 2600 HERO | CGP | Score | 2,974 | — | Unverified |
| Atari 2600 Ice Hockey | CGP | Score | 4 | — | Unverified |
| Atari 2600 James Bond | CGP | Score | 6,130 | — | Unverified |
| Atari 2600 Kangaroo | CGP | Score | 1,400 | — | Unverified |
| Atari 2600 Krull | CGP | Score | 9,086.8 | — | Unverified |
| Atari 2600 Kung-Fu Master | CGP | Score | 57,400 | — | Unverified |
| Atari 2600 Montezuma's Revenge | CGP | Score | 0 | — | Unverified |
| Atari 2600 Ms. Pacman | CGP | Score | 2,568 | — | Unverified |
| Atari 2600 Name This Game | CGP | Score | 3,696 | — | Unverified |
| Atari 2600 Phoenix | CGP | Score | 7,520 | — | Unverified |
| Atari 2600 Pitfall! | CGP | Score | 0 | — | Unverified |
| Atari 2600 Pong | CGP | Score | 20 | — | Unverified |
| Atari 2600 Private Eye | CGP | Score | 12,702.2 | — | Unverified |
| Atari 2600 Q*Bert | CGP | Score | 770 | — | Unverified |
| Atari 2600 River Raid | CGP | Score | 2,914 | — | Unverified |
| Atari 2600 Road Runner | CGP | Score | 8,960 | — | Unverified |
| Atari 2600 Robotank | CGP | Score | 24.2 | — | Unverified |
| Atari 2600 Seaquest | CGP | Score | 724 | — | Unverified |
| Atari 2600 Skiing | CGP | Score | -9,011 | — | Unverified |
| Atari 2600 Solaris | CGP | Score | 8,324 | — | Unverified |
| Atari 2600 Space Invaders | CGP | Score | 1,001 | — | Unverified |
| Atari 2600 Star Gunner | CGP | Score | 2,320 | — | Unverified |
| Atari 2600 Tennis | CGP | Score | 0 | — | Unverified |
| Atari 2600 Time Pilot | CGP | Score | 12,040 | — | Unverified |
| Atari 2600 Tutankham | CGP | Score | 0 | — | Unverified |