SOTAVerified

Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization

2018-08-27EMNLP 2018Code Available0· sign in to hype

Shashi Narayan, Shay B. Cohen, Mirella Lapata

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

We introduce extreme summarization, a new single-document summarization task which does not favor extractive strategies and calls for an abstractive modeling approach. The idea is to create a short, one-sentence news summary answering the question "What is the article about?". We collect a real-world, large-scale dataset for this task by harvesting online articles from the British Broadcasting Corporation (BBC). We propose a novel abstractive model which is conditioned on the article's topics and based entirely on convolutional neural networks. We demonstrate experimentally that this architecture captures long-range dependencies in a document and recognizes pertinent content, outperforming an oracle extractive system and state-of-the-art abstractive approaches when evaluated automatically and by humans.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
X-SumT-ConvS2SROUGE-131.89Unverified
X-SumBaseline : Extractive OracleROUGE-129.79Unverified
X-SumPtGenROUGE-129.7Unverified
X-SumSeq2SeqROUGE-128.42Unverified
X-SumPtGen-CovgROUGE-128.1Unverified
X-SumBaseline : Lead-3ROUGE-116.3Unverified
X-SumBaseline : RandomROUGE-115.16Unverified

Reproductions