Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 3626–3650 of 5335 papers

Title	Date	Tasks	Status	Hype
Latent Template Induction with Gumbel-CRFs	Nov 29, 2020	Data-to-Text GenerationDecoder	CodeCode Available	1
TaylorGAN: Neighbor-Augmented Policy Update for Sample-Efficient Natural Language Generation	Nov 27, 2020	DiversityText Generation	CodeCode Available	1
Automatic coding of students' writing via Contrastive Representation Learning in the Wasserstein space	Nov 26, 2020	BIG-bench Machine LearningContrastive Learning	—Unverified	0
Language Generation via Combinatorial Constraint Satisfaction: A Tree Search Enhanced Monte-Carlo Approach	Nov 24, 2020	Language ModelingLanguage Modelling	CodeCode Available	0
GLGE: A New General Language Generation Evaluation Benchmark	Nov 24, 2020	Natural Language UnderstandingText Generation	CodeCode Available	1
Generating Intelligible Plumitifs Descriptions: Use Case Application with Ethical Considerations	Nov 24, 2020	Text Generation	—Unverified	0
Evaluating Semantic Accuracy of Data-to-Text Generation with Natural Language Inference	Nov 21, 2020	Data-to-Text GenerationNatural Language Inference	CodeCode Available	0
Attention Mechanism, Transformers, BERT, and GPT: Tutorial and Survey	Nov 17, 2020	DecoderDeep Attention	—Unverified	0
DORB: Dynamically Optimizing Multiple Rewards with Bandits	Nov 15, 2020	Data-to-Text GenerationQuestion Generation	—Unverified	0
Conditioned Natural Language Generation using only Unconditioned Language Model: An Exploration	Nov 14, 2020	AttributeDiversity	—Unverified	0
Meaningful Answer Generation of E-Commerce Question-Answering	Nov 14, 2020	Answer GenerationQuestion Answering	—Unverified	0
E-commerce Query-based Generation based on User Review	Nov 11, 2020	Text Generation	—Unverified	0
From Unsupervised Machine Translation To Adversarial Text Generation	Nov 10, 2020	Adversarial TextDecoder	—Unverified	0
Multilingual AMR-to-Text Generation	Nov 10, 2020	AMR-to-Text GenerationText Generation	—Unverified	0
Best Practices for Data-Efficient Modeling in NLG:How to Train Production-Ready Neural Models with Less Data	Nov 8, 2020	Text Generation	—Unverified	0
Adapting a Language Model for Controlled Affective Text Generation	Nov 8, 2020	Language ModelingLanguage Modelling	CodeCode Available	1
A Gold Standard Methodology for Evaluating Accuracy in Data-To-Text Systems	Nov 8, 2020	Text Generation	CodeCode Available	0
Template Controllable keywords-to-text Generation	Nov 7, 2020	DecoderMachine Translation	—Unverified	0
SeqGenSQL -- A Robust Sequence Generation Model for Structured Query Language	Nov 7, 2020	Text GenerationText to SQL	CodeCode Available	2
The ApposCorpus: A new multilingual, multi-domain dataset for factual appositive generation	Nov 6, 2020	ArticlesImage Captioning	—Unverified	0
Topic-Centric Unsupervised Multi-Document Summarization of Scientific and News Articles	Nov 3, 2020	Abstractive Text SummarizationArticles	—Unverified	0
Data-to-Text Generation with Iterative Text Editing	Nov 3, 2020	Data-to-Text GenerationDomain Adaptation	CodeCode Available	1
Conditioned Text Generation with Transfer for Closed-Domain Dialogue Systems	Nov 3, 2020	Data AugmentationDiversity	CodeCode Available	1
Improving Variational Autoencoder for Text Modelling with Timestep-Wise Regularisation	Nov 2, 2020	Language ModelingLanguage Modelling	CodeCode Available	0
Towards Harnessing Natural Language Generation to Explain Black-box Models	Nov 1, 2020	Decision MakingExplainable artificial intelligence	—Unverified	0

Show:10 25 50

← PrevPage 146 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified