Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 926–950 of 5335 papers

Title	Date	Tasks	Status	Hype
GenWiki: A Dataset of 1.3 Million Content-Sharing Text and Graphs for Unsupervised Graph-to-Text Generation	Dec 1, 2020	Knowledge GraphsText Generation	CodeCode Available	1
TaylorGAN: Neighbor-Augmented Policy Update Towards Sample-Efficient Natural Language Generation	Dec 1, 2020	DiversityText Generation	CodeCode Available	1
Refining Deep Generative Models via Discriminator Gradient Flow	Dec 1, 2020	Image GenerationText Generation	CodeCode Available	1
TableGPT: Few-shot Table-to-Text Generation with Table Structure Reconstruction and Content Matching	Dec 1, 2020	Few-Shot LearningLanguage Modeling	CodeCode Available	1
Latent Template Induction with Gumbel-CRFs	Nov 29, 2020	Data-to-Text GenerationDecoder	CodeCode Available	1
TaylorGAN: Neighbor-Augmented Policy Update for Sample-Efficient Natural Language Generation	Nov 27, 2020	DiversityText Generation	CodeCode Available	1
GLGE: A New General Language Generation Evaluation Benchmark	Nov 24, 2020	Natural Language UnderstandingText Generation	CodeCode Available	1
Adapting a Language Model for Controlled Affective Text Generation	Nov 8, 2020	Language ModelingLanguage Modelling	CodeCode Available	1
Conditioned Text Generation with Transfer for Closed-Domain Dialogue Systems	Nov 3, 2020	Data AugmentationDiversity	CodeCode Available	1
Data-to-Text Generation with Iterative Text Editing	Nov 3, 2020	Data-to-Text GenerationDomain Adaptation	CodeCode Available	1
Generating Radiology Reports via Memory-driven Transformer	Oct 30, 2020	DecoderText Generation	CodeCode Available	1
Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training	Oct 23, 2020	Data-to-Text GenerationLanguage Modeling	CodeCode Available	1
A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation	Oct 21, 2020	Dialogue GenerationLanguage Modelling	CodeCode Available	1
PARENTing via Model-Agnostic Reinforcement Learning to Correct Pathological Behaviors in Data-to-Text Generation	Oct 21, 2020	Data-to-Text Generationreinforcement-learning	CodeCode Available	1
Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation	Oct 20, 2020	Image to textNatural Language Inference	CodeCode Available	1
CR-Walker: Tree-Structured Graph Reasoning and Dialog Acts for Conversational Recommendation	Oct 20, 2020	Conversational RecommendationRecommendation Systems	CodeCode Available	1
Chart-to-Text: Generating Natural Language Descriptions for Charts by Adapting the Transformer Model	Oct 18, 2020	Data-to-Text GenerationDecoder	CodeCode Available	1
RiSAWOZ: A Large-Scale Multi-Domain Wizard-of-Oz Dataset with Rich Semantic Annotations for Task-Oriented Dialogue Modeling	Oct 17, 2020	Dialogue State TrackingIntent Detection	CodeCode Available	1
Understanding Neural Abstractive Summarization Models via Uncertainty	Oct 15, 2020	Abstractive Text SummarizationDecoder	CodeCode Available	1
Re-evaluating Evaluation in Text Summarization	Oct 14, 2020	Text GenerationText Summarization	CodeCode Available	1
Incorporating BERT into Parallel Sequence Decoding with Adapters	Oct 13, 2020	Machine TranslationNatural Language Understanding	CodeCode Available	1
A BERT-based Distractor Generation Scheme with Multi-tasking and Negative Answer Training Strategies	Oct 12, 2020	Distractor GenerationMultiple-choice	CodeCode Available	1
Back to the Future: Unsupervised Backprop-based Decoding for Counterfactual and Abductive Commonsense Reasoning	Oct 12, 2020	counterfactualCounterfactual Reasoning	CodeCode Available	1
Evaluating Factuality in Generation with Dependency-level Entailment	Oct 12, 2020	ARCNatural Language Inference	CodeCode Available	1
On Long-Tailed Phenomena in Neural Machine Translation	Oct 10, 2020	Conditional Text GenerationMachine Translation	CodeCode Available	1

Show:10 25 50

← PrevPage 38 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified