SOTAVerified

Cognitive Graph for Multi-Hop Reading Comprehension at Scale

2019-05-14ACL 2019Code Available0· sign in to hype

Ming Ding, Chang Zhou, Qibin Chen, Hongxia Yang, Jie Tang

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

We propose a new CogQA framework for multi-hop question answering in web-scale documents. Inspired by the dual process theory in cognitive science, the framework gradually builds a cognitive graph in an iterative process by coordinating an implicit extraction module (System 1) and an explicit reasoning module (System 2). While giving accurate answers, our framework further provides explainable reasoning paths. Specifically, our implementation based on BERT and graph neural network efficiently handles millions of documents for multi-hop reasoning questions in the HotpotQA fullwiki dataset, achieving a winning joint F_1 score of 34.9 on the leaderboard, compared to 23.6 of the best competitor.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
HotpotQACognitive Graph QAJOINT-F10.35Unverified

Reproductions