Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 3151–3175 of 5335 papers

Title	Date	Tasks	Status	Hype
Topic Aware Neural Language Model: Domain Adaptation of Unconditional Text Generation Models	Sep 29, 2021	Domain AdaptationLanguage Modeling	—Unverified	0
TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generation	Sep 27, 2021	Authorship AttributionBinary text classification	CodeCode Available	1
Towards Reinforcement Learning for Pivot-based Neural Machine Translation with Non-autoregressive Transformer	Sep 27, 2021	Machine TranslationNMT	—Unverified	0
Parallel Refinements for Lexically Constrained Text Generation with BART	Sep 26, 2021	DecoderDiversity	CodeCode Available	1
Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation	Sep 25, 2021	Contrastive LearningDescriptive	CodeCode Available	1
Towards Brain-to-Text Generation: Neural Decoding with Pre-trained Encoder-Decoder Models	Sep 24, 2021	DecoderText Generation	—Unverified	0
Style Control for Schema-Guided Natural Language Generation	Sep 24, 2021	Task-Oriented Dialogue SystemsText Generation	—Unverified	0
Dependency Structure for News Document Summarization	Sep 23, 2021	Dependency ParsingDocument Summarization	—Unverified	0
Enriching and Controlling Global Semantics for Text Summarization	Sep 22, 2021	Abstractive Text SummarizationText Generation	—Unverified	0
Scalable and Efficient MoE Training for Multitask Multilingual Models	Sep 22, 2021	Machine TranslationMixture-of-Experts	—Unverified	0
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models	Sep 21, 2021	Handwritten Text RecognitionLanguage Modeling	CodeCode Available	1
A Plug-and-Play Method for Controlled Text Generation	Sep 20, 2021	SentenceStory Generation	CodeCode Available	1
Learning Natural Language Generation from Scratch	Sep 20, 2021	Language ModelingLanguage Modelling	—Unverified	0
PluGeN: Multi-Label Conditional Generation From Pre-Trained Models	Sep 18, 2021	AttributeText Generation	CodeCode Available	0
Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction	Sep 17, 2021	Cross-Lingual TransferEvent Argument Extraction	—Unverified	0
CDM: Combining Extraction and Generation for Definition Modeling	Sep 17, 2021	Text Generation	—Unverified	0
BART-light: One Decoder Layer Is Enough	Sep 17, 2021	DecoderLanguage Modeling	—Unverified	0
AMR-to-text Generation with Graph Structure Reconstruction and Coverage	Sep 17, 2021	AMR-to-Text GenerationGraph-to-Sequence	—Unverified	0
Relating Neural Text Degeneration to Exposure Bias	Sep 17, 2021	Language ModelingLanguage Modelling	—Unverified	0
Attention Is Indeed All You Need: Semantically Attention-Guided Decoding for Data-to-Text NLG	Sep 15, 2021	AllDecoder	CodeCode Available	0
Commonsense-Focused Dialogues for Response Generation: An Empirical Study	Sep 14, 2021	Response GenerationText Generation	CodeCode Available	1
The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation	Sep 14, 2021	Text Generation	—Unverified	0
A Temporal Variational Model for Story Generation	Sep 14, 2021	Diversitymodel	CodeCode Available	1
Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generation	Sep 14, 2021	nlg evaluationStyle Transfer	CodeCode Available	1
PETGEN: Personalized Text Generation Attack on Deep Sequence Embedding-based Classification Models	Sep 14, 2021	Adversarial AttackText Generation	CodeCode Available	1

Show:10 25 50

← PrevPage 127 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified