SOTAVerified

Fighting the COVID-19 Infodemic with a Holistic BERT Ensemble

2021-04-12NAACL (NLP4IF) 2021Code Available0· sign in to hype

Giorgos Tziafas, Konstantinos Kogkalidis, Tommaso Caselli

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

This paper describes the TOKOFOU system, an ensemble model for misinformation detection tasks based on six different transformer-based pre-trained encoders, implemented in the context of the COVID-19 Infodemic Shared Task for English. We fine tune each model on each of the task's questions and aggregate their prediction scores using a majority voting approach. TOKOFOU obtains an overall F1 score of 89.7%, ranking first.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
NLP4IF-2021--Fighting the COVID-19 InfodemicTOKOFOUAverage F189.7Unverified

Reproductions