SOTAVerified

Modeling Naive Psychology of Characters in Simple Commonsense Stories

2018-05-16ACL 2018Unverified0· sign in to hype

Hannah Rashkin, Antoine Bosselut, Maarten Sap, Kevin Knight, Yejin Choi

Unverified — Be the first to reproduce this paper.

Reproduce

Abstract

Understanding a narrative requires reading between the lines and reasoning about the unspoken but obvious implications about events and people's mental states - a capability that is trivial for humans but remarkably hard for machines. To facilitate research addressing this challenge, we introduce a new annotation framework to explain naive psychology of story characters as fully-specified chains of mental states with respect to motivations and emotional reactions. Our work presents a new large-scale dataset with rich low-level annotations and establishes baseline performance on several new tasks, suggesting avenues for future research.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
ROCStoriesNPN + Explanation TrainingF130.29Unverified

Reproductions