Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 3726–3750 of 5335 papers

Title	Date	Tasks	Status
EXPLORING VULNERABILITIES OF BERT-BASED APIS	Jan 1, 2021	AttributeInference Attack	—Unverified
Synthesizer: Rethinking Self-Attention for Transformer Models	Jan 1, 2021	Language ModelingLanguage Modelling	—Unverified
Promoting Graph Awareness in Linearized Graph-to-Text Generation	Dec 31, 2020	DenoisingText Generation	—Unverified
Directed Beam Search: Plug-and-Play Lexically Constrained Language Generation	Dec 31, 2020	Language ModelingLanguage Modelling	CodeCode Available
Interpretable NLG for Task-oriented Dialogue Systems with Heterogeneous Rendering Machines	Dec 29, 2020	DecoderTask-Oriented Dialogue Systems	—Unverified
BURT: BERT-inspired Universal Representation from Learning Meaningful Segment	Dec 28, 2020	Information RetrievalQuestion Answering	—Unverified
Neural Text Generation with Artificial Negative Examples	Dec 28, 2020	Image CaptioningMachine Translation	—Unverified
Lexically-constrained Text Generation through Commonsense Knowledge Extraction and Injection	Dec 19, 2020	Common Sense ReasoningConditional Text Generation	—Unverified
Breaking Writer's Block: Low-cost Fine-tuning of Natural Language Generation Models	Dec 19, 2020	Text GenerationTransfer Learning	—Unverified
AutoCaption: Image Captioning with Neural Architecture Search	Dec 16, 2020	DecoderImage Captioning	—Unverified
Query expansion with artificially generated texts	Dec 16, 2020	RetrievalText Generation	—Unverified
Generating Math Word Problems from Equations with Topic Controlling and Commonsense Enforcement	Dec 14, 2020	MathText Generation	—Unverified
AffectON: Incorporating Affect Into Dialog Generation	Dec 12, 2020	Language ModelingLanguage Modelling	—Unverified
Research Challenges in Designing Differentially Private Text Generation Mechanisms	Dec 10, 2020	Privacy PreservingText Generation	—Unverified
Facts2Story: Controlling Text Generation by Key Facts	Dec 8, 2020	Text Generation	CodeCode Available
Cross-lingual Transfer of Abstractive Summarizer to Less-resource Language	Dec 8, 2020	Abstractive Text SummarizationArticles	—Unverified
Robust Image Captioning	Dec 6, 2020	Image CaptioningText Generation	—Unverified
NILC at WebNLG+: Pretrained Sequence-to-Sequence Models on RDF-to-Text Generation	Dec 1, 2020	Data-to-Text GenerationText Generation	—Unverified
NILC at SR’20: Exploring Pre-Trained Models in Surface Realisation	Dec 1, 2020	Data-to-Text GenerationText Generation	—Unverified
NUIG-DSI at the WebNLG+ challenge: Leveraging Transfer Learning for RDF-to-text generation	Dec 1, 2020	Text GenerationTransfer Learning	—Unverified
Referring to what you know and do not know: Making Referring Expression Generation Models Generalize To Unseen Entities	Dec 1, 2020	DecoderReferring Expression	—Unverified
Transformer based Natural Language Generation for Question-Answering	Dec 1, 2020	Question AnsweringText Generation	—Unverified
WebNLG Challenge 2020: Language Agnostic Delexicalisation for Multilingual RDF-to-text generation	Dec 1, 2020	Text Generation	—Unverified
Surface Realization Using Pretrained Language Models	Dec 1, 2020	DecoderLanguage Modeling	—Unverified
CollFrEn: Rich Bilingual English–French Collocation Resource	Dec 1, 2020	Machine TranslationRelation Classification	CodeCode Available

Show:10 25 50

← PrevPage 150 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified