SOTAVerified

Automatic Stance Detection Using End-to-End Memory Networks

2018-04-20NAACL 2018Unverified0· sign in to hype

Mitra Mohtarami, Ramy Baly, James Glass, Preslav Nakov, Lluis Marquez, Alessandro Moschitti

Unverified — Be the first to reproduce this paper.

Reproduce

Abstract

We present a novel end-to-end memory network for stance detection, which jointly (i) predicts whether a document agrees, disagrees, discusses or is unrelated with respect to a given target claim, and also (ii) extracts snippets of evidence for that prediction. The network operates at the paragraph level and integrates convolutional and recurrent neural networks, as well as a similarity matrix as part of the overall architecture. The experimental evaluation on the Fake News Challenge dataset shows state-of-the-art performance.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
FNC-1Neural method from Mohtarami et al. + TF-IDF (Mohtarami et al., 2018)Weighted Accuracy81.23Unverified
FNC-1Neural method from Mohtarami et al. (Mohtarami et al., 2018)Weighted Accuracy78.97Unverified

Reproductions