Sleep Deprivation in the Forward-Forward Algorithm
2023-10-28Code Available0· sign in to hype
Mircea-Tudor Lică, David Dinucu-Jianu
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/mirceatlx/ffOfficialIn paperpytorch★ 3
Abstract
This paper aims to explore the separation of the two forward passes in the Forward-Forward algorithm from a biological perspective in the context of sleep. We show the size of the gap between the sleep and awake phase influences the learning capabilities of the algorithm and highlight the importance of negative data in diminishing the devastating effects of sleep deprivation.