Proposal Report for the 2nd SciCAP Competition 2024
Pengpeng Li, Tingmin Li, Jingyuan Wang, Boyuan Wang, Yang Yang
Unverified — Be the first to reproduce this paper.
ReproduceAbstract
In this paper, we propose a method for document summarization using auxiliary information. This approach effectively summarizes descriptions related to specific images, tables, and appendices within lengthy texts. Our experiments demonstrate that leveraging high-quality OCR data and initially extracted information from the original text enables efficient summarization of the content related to described objects. Based on these findings, we enhanced popular text generation model models by incorporating additional auxiliary branches to improve summarization performance. Our method achieved top scores of 4.33 and 4.66 in the long caption and short caption tracks, respectively, of the 2024 SciCAP competition, ranking highest in both categories.