SOTAVerified

SolomonLab at SemEval-2019 Task 8: Question Factuality and Answer Veracity Prediction in Community Forums

2019-06-01SEMEVAL 2019Unverified0· sign in to hype

Ankita Gupta, Sudeep Kumar Sahoo, Divya Prakash, Rohit R. R, Vertika Srivastava, Yeon Hyang Kim

Unverified — Be the first to reproduce this paper.

Reproduce

Abstract

We describe our system for SemEval-2019, Task 8 on ``Fact-Checking in Community Question Answering Forums (cQA)''. cQA forums are very prevalent nowadays, as they provide an effective means for communities to share knowledge. Unfortunately, this shared information is not always factual and fact-verified. In this task, we aim to identify factual questions posted on cQA and verify the veracity of answers to these questions. Our approach relies on data augmentation and aggregates cues from several dimensions such as semantics, linguistics, syntax, writing style and evidence obtained from trusted external sources. In subtask A, our submission is ranked 3rd, with an accuracy of 83.14\%. Our current best solution stands 1st on the leaderboard with 88\% accuracy. In subtask B, our present solution is ranked 2nd, with 58.33\% MAP score.

Tasks

Reproductions