SOTAVerified

Improving Evidence Retrieval for Automated Explainable Fact-Checking

2021-06-01NAACL 2021Code Available1· sign in to hype

Chris Samarinas, Wynne Hsu, Mong Li Lee

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Automated fact-checking on a large-scale is a challenging task that has not been studied systematically until recently. Large noisy document collections like the web or news articles make the task more difficult. We describe a three-stage automated fact-checking system, named Quin+, using evidence retrieval and selection methods. We demonstrate that using dense passage representations leads to much higher evidence recall in a noisy setting. We also propose two sentence selection approaches, an embedding-based selection using a dense retrieval model, and a sequence labeling approach for context-aware selection. Quin+ is able to verify open-domain claims using results from web search engines.

Tasks

Reproductions