SOTAVerified

Optimizing the Neural Architecture of Reinforcement Learning Agents

2020-11-30Code Available0· sign in to hype

N. Mazyavkina, S. Moustafa, I. Trofimov, E. Burnaev

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Reinforcement learning (RL) enjoyed significant progress over the last years. One of the most important steps forward was the wide application of neural networks. However, architectures of these neural networks are typically constructed manually. In this work, we study recently proposed neural architecture search (NAS) methods for optimizing the architecture of RL agents. We carry out experiments on the Atari benchmark and conclude that modern NAS methods find architectures of RL agents outperforming a manually selected one.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
Atari 2600 BreakoutSPOSScore180.6Unverified
Atari 2600 BreakoutENAS Search space 1Score161.1Unverified
Atari 2600 BreakoutSPOS Search space 1Score144.4Unverified
Atari 2600 BreakoutENASScore91.4Unverified
Atari 2600 FreewayENASScore22Unverified
Atari 2600 FreewaySPOSScore22Unverified

Reproductions