NutCracker at WNUT-2020 Task 2: Robustly Identifying Informative COVID-19 Tweets using Ensembling and Adversarial Training
2020-10-09EMNLP (WNUT) 2020Code Available0· sign in to hype
Priyanshu Kumar, Aadarsh Singh
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/kpriyanshu256/WNUT-2020-Task-2OfficialIn papernone★ 6
Abstract
We experiment with COVID-Twitter-BERT and RoBERTa models to identify informative COVID-19 tweets. We further experiment with adversarial training to make our models robust. The ensemble of COVID-Twitter-BERT and RoBERTa obtains a F1-score of 0.9096 (on the positive class) on the test data of WNUT-2020 Task 2 and ranks 1st on the leaderboard. The ensemble of the models trained using adversarial training also produces similar result.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| WNUT-2020 Task 2 | NutCracker | F1 | 0.91 | — | Unverified |