Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 3226–3250 of 5335 papers

Title	Date	Tasks	Status
PLANET: Dynamic Content Planning in Autoregressive Transformers for Long-form Text Generation	Mar 17, 2022	Contrastive LearningDecoder	—Unverified
TegTok: Augmenting Text Generation via Task-specific and Open-world Knowledge	Mar 16, 2022	Dialogue GenerationKnowledge Graphs	CodeCode Available
Learning to Infer Belief Embedded Communication	Mar 15, 2022	Text Generation	—Unverified
Pruned Graph Neural Network for Short Story Ordering	Mar 13, 2022	Graph Neural NetworkSentence	—Unverified
Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods	Mar 10, 2022	Abstractive Text SummarizationData-to-Text Generation	—Unverified
IndicNLG Benchmark: Multilingual Datasets for Diverse NLG Tasks in Indic Languages	Mar 10, 2022	ArticlesBenchmarking	—Unverified
Compilable Neural Code Generation with Compiler Feedback	Mar 10, 2022	Code CompletionCode Generation	—Unverified
Input-Tuning: Adapting Unfamiliar Inputs to Frozen Pretrained Models	Mar 7, 2022	Language ModelingLanguage Modelling	—Unverified
Recent Advances in Neural Text Generation: A Task-Agnostic Survey	Mar 6, 2022	SurveyText Generation	—Unverified
The Proof is in the Pudding: Using Automated Theorem Proving to Generate Cooking Recipes	Mar 5, 2022	Automated Theorem ProvingText Generation	CodeCode Available
Deep Latent-Variable Models for Text Generation	Mar 3, 2022	DecoderDialogue Generation	—Unverified
Controlling the Focus of Pretrained Language Generation Models	Mar 2, 2022	Abstractive Text SummarizationResponse Generation	CodeCode Available
Attend, Memorize and Generate: Towards Faithful Table-to-Text Generation in Few Shots	Mar 1, 2022	Table-to-Text GenerationText Generation	CodeCode Available
Rethinking and Refining the Distinct Metric	Feb 28, 2022	DiversityText Generation	CodeCode Available
Variational Autoencoder with Disentanglement Priors for Low-Resource Task-Specific Natural Language Generation	Feb 27, 2022	Data AugmentationDisentanglement	CodeCode Available
Controllable Natural Language Generation with Contrastive Prefixes	Feb 27, 2022	AttributeLanguage Modeling	—Unverified
Reward Modeling for Mitigating Toxicity in Transformer-based Language Models	Feb 19, 2022	Language ModelingLanguage Modelling	—Unverified
CLSEG: Contrastive Learning of Story Ending Generation	Feb 18, 2022	Contrastive LearningText Generation	CodeCode Available
XFBoost: Improving Text Generation with Controllable Decoders	Feb 16, 2022	DescriptiveLanguage Modeling	—Unverified
C IS^2: A Simplified Commonsense Inference Evaluation for Story Prose	Feb 16, 2022	SentenceText Generation	CodeCode Available
Integrating AI Planning with Natural Language Processing: A Combination of Explicit and Tacit Knowledge	Feb 15, 2022	Text Generation	—Unverified
Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text	Feb 14, 2022	nlg evaluationText Generation	—Unverified
Including Facial Expressions in Contextual Embeddings for Sign Language Generation	Feb 11, 2022	Text Generation	—Unverified
Survey of Hallucination in Natural Language Generation	Feb 8, 2022	Abstractive Text SummarizationData-to-Text Generation	—Unverified
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework	Feb 7, 2022	Image Captioningimage-classification	CodeCode Available

Show:10 25 50

← PrevPage 130 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified