Fast Context Adaptation via Meta-Learning

2018-10-08Code Available1· sign in to hype

Luisa M. Zintgraf, Kyriacos Shiarlis, Vitaly Kurin, Katja Hofmann, Shimon Whiteson

Code Available — Be the first to reproduce this paper.

Code

github.com/lmzintgraf/cavia
OfficialIn paperpytorch★ 145

Abstract

We propose CAVIA for meta-learning, a simple extension to MAML that is less prone to meta-overfitting, easier to parallelise, and more interpretable. CAVIA partitions the model parameters into two parts: context parameters that serve as additional input to the model and are adapted on individual tasks, and shared parameters that are meta-trained and shared across tasks. At test time, only the context parameters are updated, leading to a low-dimensional task representation. We show empirically that CAVIA outperforms MAML for regression, classification, and reinforcement learning. Our experiments also highlight weaknesses in current benchmarks, in that the amount of adaptation needed in some cases is small.

Tasks

General Classification Meta-Learning regression reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Fast Context Adaptation via Meta-Learning

Code

Abstract

Tasks

Reproductions