LED down the rabbit hole: exploring the potential of global attention for biomedical multi-document summarisation
2022-09-19sdp (COLING) 2022Code Available0· sign in to hype
Yulia Otmakhova, Hung Thinh Truong, Timothy Baldwin, Trevor Cohn, Karin Verspoor, Jey Han Lau
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/joey234/primer-pico-attnOfficialIn paperpytorch★ 4
Abstract
In this paper we report on our submission to the Multidocument Summarisation for Literature Review (MSLR) shared task. Specifically, we adapt PRIMERA (Xiao et al., 2022) to the biomedical domain by placing global attention on important biomedical entities in several ways. We analyse the outputs of the 23 resulting models, and report patterns in the results related to the presence of additional global attention, number of training steps, and the input configuration.