Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 2926–2950 of 5335 papers

Title	Date	Tasks	Status	Hype
PPLM Revisited: Steering and Beaming a Lumbering Mammoth to Control Text Generation	Jan 17, 2022	Language ModelingLanguage Modelling	—Unverified	0
Classification or Generation? Understanding Paradigm Shift for Knowledge-Intensive Tasks	Jan 17, 2022	ClassificationEntity Retrieval	—Unverified	0
Sequentially Controlled Text Generation	Jan 16, 2022	ArticlesText Generation	—Unverified	0
A Study of Pre-trained Language Models for Analogy Generation	Jan 16, 2022	Text Generation	—Unverified	0
On the Anatomy of Latent-variable Generative Models for Conditional Text Generation	Jan 16, 2022	AnatomyConditional Text Generation	—Unverified	0
Provably Confidential Language Modelling	Jan 16, 2022	Language ModellingMemorization	—Unverified	0
Mix and Match: Learning-free Controllable Text Generation using Energy Language Models	Jan 16, 2022	AttributeLanguage Modeling	—Unverified	0
Don't Take It Literally: An Edit-Invariant Sequence Loss for Text Generation	Jan 16, 2022	Machine TranslationStyle Transfer	—Unverified	0
Don’t Forget About Pronouns: Removing Gender Bias in Language Models without Losing Factual Gender Information	Jan 16, 2022	Language ModelingLanguage Modelling	—Unverified	0
TD-ConE: An Information-Theoretic Approach to Assessing Parallel Text Generation Data	Jan 16, 2022	Paraphrase GenerationStyle Transfer	—Unverified	0
Auto-regressive Text Generation with Pre-Trained Language Models: An Empirical Study on Question-type Short Text Generation	Jan 16, 2022	MathText Generation	—Unverified	0
Pathway2Text: Dataset and Method for Biomedical Pathway Description Generation	Jan 16, 2022	Text Generation	—Unverified	0
Defending against Backdoor Attacks in Natural Language Generation	Jan 16, 2022	Backdoor AttackDialogue Generation	—Unverified	0
Controlling the Focus of Pretrained Language Generation Models	Jan 16, 2022	Abstractive Text SummarizationResponse Generation	—Unverified	0
Sonnet Generation by Training on Non-poetic Texts with Discourse-level Coherence and Poetic Features	Jan 16, 2022	Sonnet GenerationText Generation	—Unverified	0
Massive-scale Decoding for Text Generation using Lattices	Jan 16, 2022	Text Generation	—Unverified	0
Continual Learning for Seq2Seq Generations with Transformer Calibration	Jan 16, 2022	Continual LearningLifelong learning	—Unverified	0
Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand	Jan 16, 2022	Image CaptioningMachine Translation	—Unverified	0
Falsesum: Generating Document-level NLI Examples for Recognizing Factual Inconsistency in Summarization	Jan 16, 2022	Abstractive Text SummarizationNatural Language Inference	—Unverified	0
Discourse-Aware Prompt Design for Text Generation	Jan 16, 2022	BlockingConditional Text Generation	—Unverified	0
TRUE: Re-evaluating Factual Consistency Evaluation	Jan 16, 2022	Question GenerationQuestion-Generation	—Unverified	0
Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learning	Jan 16, 2022	Data AugmentationGraph Attention	—Unverified	0
WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation	Jan 16, 2022	DiversityNatural Language Inference	CodeCode Available	1
Pretrained Language Models for Text Generation: A Survey	Jan 14, 2022	SurveyText Generation	—Unverified	0
A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models	Jan 14, 2022	Text Generation	—Unverified	0

Show:10 25 50

← PrevPage 118 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified