Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 701–725 of 5335 papers

Title	Date	Tasks	Status	Hype	Score
Controllable Data Augmentation for Few-Shot Text Mining with Chain-of-Thought Attribute Manipulation	Jul 14, 2023	Aspect-Based Sentiment AnalysisAttribute	CodeCode Available	1	5
ICE-Score: Instructing Large Language Models to Evaluate Code	Apr 27, 2023	Code GenerationMachine Translation	CodeCode Available	1	5
Generating Summaries with Controllable Readability Levels	Oct 16, 2023	Lay SummarizationNews Summarization	CodeCode Available	1	5
Dependency-based Mixture Language Models	Mar 19, 2022	Language ModelingLanguage Modelling	CodeCode Available	1	5
GENIUS: Sketch-based Language Model Pre-training via Extreme and Selective Masking for Text Generation and Augmentation	Nov 18, 2022	Conditional Text GenerationData Augmentation	CodeCode Available	1	5
DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLM	Oct 23, 2023	DecoderText Generation	CodeCode Available	1	5
Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and Classification	Aug 26, 2021	DiversityText Generation	CodeCode Available	1	5
Latent Template Induction with Gumbel-CRFs	Nov 29, 2020	Data-to-Text GenerationDecoder	CodeCode Available	1	5
Learning Compact Metrics for MT	Oct 12, 2021	Cross-Lingual TransferLanguage Modeling	CodeCode Available	1	5
Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agents	Feb 18, 2024	Mathematical ReasoningMulti-hop Question Answering	CodeCode Available	1	5
Retrieval augmentation of large language models for lay language generation	Nov 7, 2022	Explanation GenerationRetrieval	CodeCode Available	1	5
Differentially Private Fine-tuning of Language Models	Oct 13, 2021	Text Generation	CodeCode Available	1	5
Beyond Opinion Mining: Summarizing Opinions of Customer Reviews	Jun 3, 2022	Opinion MiningOpinion Summarization	CodeCode Available	1	5
Empowering Diffusion Models on the Embedding Space for Text Generation	Dec 19, 2022	DenoisingMachine Translation	CodeCode Available	1	5
GenARM: Reward Guided Generation with Autoregressive Reward Model for Test-time Alignment	Oct 10, 2024	Text Generation	CodeCode Available	1	5
GenAug: Data Augmentation for Finetuning Text Generators	Oct 5, 2020	Data AugmentationDiversity	CodeCode Available	1	5
Diffusion Guided Language Modeling	Aug 8, 2024	AttributeLanguage Modeling	CodeCode Available	1	5
Learning to Generate Better Than Your LLM	Jun 20, 2023	Conditional Text Generationreinforcement-learning	CodeCode Available	1	5
DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence	Jan 26, 2022	Document Level Machine TranslationMachine Translation	CodeCode Available	1	5
Directed Acyclic Transformer Pre-training for High-quality Non-autoregressive Text Generation	Apr 24, 2023	Machine TranslationText Generation	CodeCode Available	1	5
Direct speech-to-speech translation with discrete units	Jul 12, 2021	Speech-to-Speech TranslationText Generation	CodeCode Available	1	5
DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational Transformer	Oct 12, 2021	Story GenerationText Generation	CodeCode Available	1	5
Adversarial Illusions in Multi-Modal Embeddings	Aug 22, 2023	Image GenerationText Generation	CodeCode Available	1	5
Learning to Transfer Prompts for Text Generation	May 3, 2022	Text Generation	CodeCode Available	1	5
Certifiably Robust RAG against Retrieval Corruption	May 24, 2024	RAGRetrieval	CodeCode Available	1	5

Show:10 25 50

← PrevPage 29 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified