Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 2751–2775 of 5335 papers

Title	Date	Tasks	Status	Hype
Mitigating Toxic Degeneration with Empathetic Data: Exploring the Relationship Between Toxicity and Empathy	May 15, 2022	Text Generation	—Unverified	0
Classifiers are Better Experts for Controllable Text Generation	May 15, 2022	Text Generation	—Unverified	0
Near-Negative Distinction: Giving a Second Life to Human Evaluation Datasets	May 13, 2022	nlg evaluationQuestion Answering	CodeCode Available	0
Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications	May 13, 2022	nlg evaluationText Generation	—Unverified	0
ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language Generation	May 13, 2022	Abstractive Text SummarizationDecoder	CodeCode Available	1
Arithmetic-Based Pretraining -- Improving Numeracy of Pretrained Language Models	May 13, 2022	Contrastive LearningReading Comprehension	CodeCode Available	0
Exploiting Inductive Bias in Transformers for Unsupervised Disentanglement of Syntax and Semantics with VAEs	May 12, 2022	DecoderDisentanglement	CodeCode Available	1
Efficient and Training-Free Control of Language Generation	May 12, 2022	AttributeDiversity	—Unverified	0
AdaVAE: Exploring Adaptive GPT-2s in Variational Auto-Encoders for Language Modeling	May 12, 2022	Conditional Text GenerationDecoder	CodeCode Available	1
Falsesum: Generating Document-level NLI Examples for Recognizing Factual Inconsistency in Summarization	May 12, 2022	Abstractive Text SummarizationNatural Language Inference	CodeCode Available	0
Symphony Generation with Permutation Invariant Language Model	May 10, 2022	Audio GenerationDecoder	CodeCode Available	2
Extracting Latent Steering Vectors from Pretrained Language Models	May 10, 2022	Language ModelingLanguage Modelling	CodeCode Available	1
UL2: Unifying Language Learning Paradigms	May 10, 2022	Arithmetic ReasoningCommon Sense Reasoning	CodeCode Available	1
RoViST:Learning Robust Metrics for Visual Storytelling	May 8, 2022	SentenceText Generation	CodeCode Available	0
Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learning	May 8, 2022	Data AugmentationData-to-Text Generation	CodeCode Available	1
DxFormer: A Decoupled Automatic Diagnostic System Based on Decoder-Encoder Transformer with Dense Symptom Representations	May 8, 2022	DecoderDiagnostic	CodeCode Available	1
Attract me to Buy: Advertisement Copywriting Generation with Multimodal Multi-structured Information	May 7, 2022	Text GenerationVideo Captioning	—Unverified	0
Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention	May 7, 2022	Text GenerationTransfer Learning	CodeCode Available	1
Robust Conversational Agents against Imperceptible Toxicity Triggers	May 5, 2022	Language ModellingText Generation	CodeCode Available	0
Language Models Can See: Plugging Visual Controls in Text Generation	May 5, 2022	Image CaptioningImage-text matching	CodeCode Available	2
Towards Robust and Semantically Organised Latent Representations for Unsupervised Text Style Transfer	May 4, 2022	DenoisingSentence	CodeCode Available	0
Provably Confidential Language Modelling	May 4, 2022	Language ModellingMemorization	CodeCode Available	0
Zero-shot Sonnet Generation with Discourse-level Planning and Aesthetics Features	May 3, 2022	Sonnet GenerationText Generation	CodeCode Available	0
Adversarial Training for High-Stakes Reliability	May 3, 2022	Text GenerationVocal Bursts Intensity Prediction	—Unverified	0
Learning to Transfer Prompts for Text Generation	May 3, 2022	Text Generation	CodeCode Available	1

Show:10 25 50

← PrevPage 111 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified