ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehension
2018-10-30Unverified0· sign in to hype
Sheng Zhang, Xiaodong Liu, Jingjing Liu, Jianfeng Gao, Kevin Duh, Benjamin Van Durme
Unverified — Be the first to reproduce this paper.
ReproduceAbstract
We present a large-scale dataset, ReCoRD, for machine reading comprehension requiring commonsense reasoning. Experiments on this dataset demonstrate that the performance of state-of-the-art MRC systems fall far behind human performance. ReCoRD represents a challenge for future research to bridge the gap between human and machine commonsense reading comprehension. ReCoRD is available at http://nlp.jhu.edu/record.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| ReCoRD | DocQA + ELMo | EM | 45.4 | — | Unverified |