SOTAVerified

A Multi-Type Multi-Span Network for Reading Comprehension that Requires Discrete Reasoning

2019-08-15IJCNLP 2019Code Available0· sign in to hype

Minghao Hu, Yuxing Peng, Zhen Huang, Dongsheng Li

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Rapid progress has been made in the field of reading comprehension and question answering, where several systems have achieved human parity in some simplified settings. However, the performance of these models degrades significantly when they are applied to more realistic scenarios, such as answers involve various types, multiple text strings are correct answers, or discrete reasoning abilities are required. In this paper, we introduce the Multi-Type Multi-Span Network (MTMSN), a neural reading comprehension model that combines a multi-type answer predictor designed to support various answer types (e.g., span, count, negation, and arithmetic expression) with a multi-span extraction method for dynamically producing one or multiple text spans. In addition, an arithmetic expression reranking mechanism is proposed to rank expression candidates for further confirming the prediction. Experiments show that our model achieves 79.9 F1 on the DROP hidden test set, creating new state-of-the-art results. Source code https://github.com/huminghao16/MTMSN is released to facilitate future work.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
DROP TestMTMSN LargeF179.88Unverified

Reproductions