Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 3451–3475 of 5335 papers

Title	Date	Tasks	Status	Hype
Modelling Context Emotions using Multi-task Learning for Emotion Controlled Dialog Generation	Apr 1, 2021	DecoderMulti-Task Learning	—Unverified	0
Making Use of Latent Space in Language GANs for Generating Diverse Text without Pre-training	Apr 1, 2021	DiversityImage Captioning	—Unverified	0
Analyzing the Forgetting Problem in Pretrain-Finetuning of Open-domain Dialogue Response Models	Apr 1, 2021	DecoderResponse Generation	—Unverified	0
Structural Encoding and Pre-training Matter: Adapting BERT for Table-Based Fact Verification	Apr 1, 2021	Fact VerificationGraph Neural Network	—Unverified	0
"TL;DR:" Out-of-Context Adversarial Text Summarization and Hashtag Recommendation	Apr 1, 2021	Adversarial TextArticles	—Unverified	0
FeTaQA: Free-form Table Question Answering	Apr 1, 2021	FormQuestion Answering	CodeCode Available	1
WakaVT: A Sequential Variational Transformer for Waka Generation	Apr 1, 2021	DiversityText Generation	—Unverified	0
AfriKI: Machine-in-the-Loop Afrikaans Poetry Generation	Mar 30, 2021	Language ModelingLanguage Modelling	—Unverified	0
Evaluating the Morphosyntactic Well-formedness of Generated Texts	Mar 30, 2021	Machine TranslationText Generation	CodeCode Available	0
Changing the Mind of Transformers for Topically-Controllable Language Generation	Mar 29, 2021	ClusteringText Generation	CodeCode Available	1
On Hallucination and Predictive Uncertainty in Conditional Language Generation	Mar 28, 2021	Data-to-Text GenerationHallucination	—Unverified	0
Data Augmentation in Natural Language Processing: A Novel Text Generation Approach for Long and Short Text Classifiers	Mar 26, 2021	Data AugmentationText Generation	—Unverified	0
Finetuning Pretrained Transformers into RNNs	Mar 24, 2021	Language ModellingMachine Translation	CodeCode Available	1
The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures	Mar 23, 2021	Information RetrievalKnowledge Distillation	—Unverified	0
Plug-and-Blend: A Framework for Controllable Story Generation with Blended Control Codes	Mar 23, 2021	Story GenerationText Generation	CodeCode Available	1
SparseGAN: Sparse Generative Adversarial Network for Text Generation	Mar 22, 2021	Generative Adversarial NetworkSentence	—Unverified	0
Non-Autoregressive Translation by Learning Target Categorical Codes	Mar 21, 2021	AttributeDecoder	CodeCode Available	1
Attribute Alignment: Controlling Text Generation from Pre-trained Language Models	Mar 20, 2021	AttributeDiversity	CodeCode Available	0
Controllable Generation from Pre-trained Language Models via Inverse Prompting	Mar 19, 2021	Language ModelingLanguage Modelling	CodeCode Available	1
Model Extraction and Adversarial Transferability, Your BERT is Vulnerable!	Mar 18, 2021	Model extractiontext-classification	CodeCode Available	1
ENCONTER: Entity Constrained Progressive Sequence Generation via Insertion-based Transformer	Mar 17, 2021	Text Generation	CodeCode Available	0
Structural Adapters in Pretrained Language Models for AMR-to-text Generation	Mar 16, 2021	AMR-to-Text GenerationData-to-Text Generation	CodeCode Available	1
Knowledge driven Description Synthesis for Floor Plan Interpretation	Mar 15, 2021	Caption GenerationDescriptive	—Unverified	0
Get Your Vitamin C! Robust Fact Verification with Contrastive Evidence	Mar 15, 2021	Adversarial Natural Language InferenceFact Checking	CodeCode Available	1
A Study of Automatic Metrics for the Evaluation of Natural Language Explanations	Mar 15, 2021	nlg evaluationText Generation	CodeCode Available	0

Show:10 25 50

← PrevPage 139 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified