SOTAVerified

ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehension

2018-10-30Unverified0· sign in to hype

Sheng Zhang, Xiaodong Liu, Jingjing Liu, Jianfeng Gao, Kevin Duh, Benjamin Van Durme

Unverified — Be the first to reproduce this paper.

Reproduce

Abstract

We present a large-scale dataset, ReCoRD, for machine reading comprehension requiring commonsense reasoning. Experiments on this dataset demonstrate that the performance of state-of-the-art MRC systems fall far behind human performance. ReCoRD represents a challenge for future research to bridge the gap between human and machine commonsense reading comprehension. ReCoRD is available at http://nlp.jhu.edu/record.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
ReCoRDDocQA + ELMoEM45.4Unverified

Reproductions