Detecting and Extracting of Adverse Drug Reaction Mentioning Tweets with Multi-Head Self Attention
2019-08-01WS 2019Unverified0· sign in to hype
Suyu Ge, Tao Qi, Chuhan Wu, Yongfeng Huang
Unverified — Be the first to reproduce this paper.
ReproduceAbstract
This paper describes our system for the first and second shared tasks of the fourth Social Media Mining for Health Applications (SMM4H) workshop. We enhance tweet representation with a language model and distinguish the importance of different words with Multi-Head Self-Attention. In addition, transfer learning is exploited to make up for the data shortage. Our system achieved competitive results on both tasks with an F1-score of 0.5718 for task 1 and 0.653 (overlap) / 0.357 (strict) for task 2.