Retrodiction as Delayed Recurrence: the Case of Adjectives in Italian and English

Code

• github.com/rgalhama/retro_adjs
  OfficialIn paperpytorch★ 0

Abstract

We address the question of how to account for both forward and backward dependencies in an online processing account of human language acquisition. We focus on descriptive adjectives in English and Italian, and show that the acquisition of adjectives in these languages likely relies on tracking both forward and backward regularities. Our simulations confirm that forward-predicting models like standard Recurrent Neural Networks (RNN) cannot account for this phenomenon due to the lack of backward prediction, but the addition of a small delay (as proposed in Turek et al., 2019) endows the RNN with the ability to not only predict but also retrodict.

Tasks

Reproductions