Fine-Tuning Transformers for Identifying Self-Reporting Potential Cases and Symptoms of COVID-19 in Tweets
2021-04-12NAACL (SMM4H) 2021Code Available0· sign in to hype
Max Fleming, Priyanka Dondeti, Caitlin N. Dreisbach, Adam Poliak
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/mfleming99/SMM4H_2021OfficialIn paperpytorch★ 0
Abstract
We describe our straight-forward approach for Tasks 5 and 6 of 2021 Social Media Mining for Health Applications (SMM4H) shared tasks. Our system is based on fine-tuning Distill- BERT on each task, as well as first fine-tuning the model on the other task. We explore how much fine-tuning is necessary for accurately classifying tweets as containing self-reported COVID-19 symptoms (Task 5) or whether a tweet related to COVID-19 is self-reporting, non-personal reporting, or a literature/news mention of the virus (Task 6).