Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 351–375 of 5335 papers

Title	Date	Tasks	Status	Hype
Empowering Diffusion Models on the Embedding Space for Text Generation	Dec 19, 2022	DenoisingMachine Translation	CodeCode Available	1
Diffusion Models for Non-autoregressive Text Generation: A Survey	Mar 12, 2023	SurveyText Generation	CodeCode Available	1
DeCap: Decoding CLIP Latents for Zero-Shot Captioning via Text-Only Training	Mar 6, 2023	DecoderImage Captioning	CodeCode Available	1
Deep Graph Convolutional Encoders for Structured Data to Text Generation	Oct 23, 2018	Data-to-Text GenerationGraph-to-Sequence	CodeCode Available	1
Data-to-text Generation with Macro Planning	Feb 4, 2021	Data-to-Text GenerationDecoder	CodeCode Available	1
Data-to-text Generation with Variational Sequential Planning	Feb 28, 2022	Data-to-Text GenerationText Generation	CodeCode Available	1
Data-QuestEval: A Referenceless Metric for Data-to-Text Semantic Evaluation	Apr 15, 2021	Data-to-Text GenerationQuestion Generation	CodeCode Available	1
Data Generation for Post-OCR correction of Cyrillic handwriting	Nov 27, 2023	Handwriting generationHandwritten Text Recognition	CodeCode Available	1
Defending Against Backdoor Attacks in Natural Language Generation	Jun 3, 2021	Backdoor AttackDialogue Generation	CodeCode Available	1
Defending Against Unforeseen Failure Modes with Latent Adversarial Training	Mar 8, 2024	image-classificationImage Classification	CodeCode Available	1
DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLM	Oct 23, 2023	DecoderText Generation	CodeCode Available	1
Differentiable Tree Operations Promote Compositional Generalization	Jun 1, 2023	Semantic ParsingText Generation	CodeCode Available	1
Data-to-Text Bilingual Generation	Nov 24, 2023	Text Generation	CodeCode Available	1
DART: Open-Domain Structured Data Record to Text Generation	Jul 6, 2020	Domain GeneralizationSemantic Parsing	CodeCode Available	1
A BERT-based Distractor Generation Scheme with Multi-tasking and Negative Answer Training Strategies	Oct 12, 2020	Distractor GenerationMultiple-choice	CodeCode Available	1
Data Feedback Loops: Model-driven Amplification of Dataset Biases	Sep 8, 2022	image-classificationImage Classification	CodeCode Available	1
Abg-CoQA: Clarifying Ambiguity in Conversational Question Answering	Jun 22, 2021	4kConversational Question Answering	CodeCode Available	1
Directed Acyclic Transformer Pre-training for High-quality Non-autoregressive Text Generation	Apr 24, 2023	Machine TranslationText Generation	CodeCode Available	1
DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational Transformer	Oct 12, 2021	Story GenerationText Generation	CodeCode Available	1
DISCOS: Bridging the Gap between Discourse Knowledge and Commonsense Knowledge	Jan 1, 2021	DiversityText Generation	CodeCode Available	1
Data-to-Text Generation with Iterative Text Editing	Nov 3, 2020	Data-to-Text GenerationDomain Adaptation	CodeCode Available	1
DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Generation	Oct 18, 2022	AttributeDiversity	CodeCode Available	1
Diverse Text Generation via Variational Encoder-Decoder Models with Gaussian Process Priors	Apr 4, 2022	DecoderDiversity	CodeCode Available	1
An Overview on Controllable Text Generation via Variational Auto-Encoders	Nov 15, 2022	Text Generation	CodeCode Available	1
CROW: Eliminating Backdoors from Large Language Models via Internal Consistency Regularization	Nov 18, 2024	backdoor defenseText Generation	CodeCode Available	1

Show:10 25 50

← PrevPage 15 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified