Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 3476–3500 of 5335 papers

Title	Date	Tasks	Status	Hype
Membership Inference Attacks on Machine Learning: A Survey	Mar 14, 2021	BIG-bench Machine LearningFairness	CodeCode Available	1
Simpson's Bias in NLP Training	Mar 13, 2021	Multi-class ClassificationSentence	—Unverified	0
Improving Diversity of Neural Text Generation via Inverse Probability Weighting	Mar 13, 2021	DiversityLanguage Modeling	—Unverified	0
Constrained Text Generation with Global Guidance -- Case Study on CommonGen	Mar 12, 2021	Common Sense Reasoningreinforcement-learning	—Unverified	0
Topical Language Generation using Transformers	Mar 11, 2021	DiversityText Generation	CodeCode Available	1
ENTRUST: Argument Reframing with Language Models and Entailment	Mar 11, 2021	Text Generation	—Unverified	0
Unified Pre-training for Program Understanding and Generation	Mar 10, 2021	Clone DetectionCode Generation	CodeCode Available	1
Hurdles to Progress in Long-form Question Answering	Mar 10, 2021	FormLong Form Question Answering	CodeCode Available	1
Causal-aware Safe Policy Improvement for Task-oriented dialogue	Mar 10, 2021	Dialogue ManagementManagement	CodeCode Available	1
InFillmore: Frame-Guided Language Generation with Bidirectional Context	Mar 8, 2021	Text GenerationText Infilling	—Unverified	0
Empathetic BERT2BERT Conversational Model: Learning Arabic Language Generation with Little Data	Mar 7, 2021	DecoderEmpathetic Response Generation	CodeCode Available	1
Measuring Mathematical Problem Solving With the MATH Dataset	Mar 5, 2021	MathMathematical Problem-Solving	CodeCode Available	2
Towards Conversational Humor Analysis and Design	Feb 28, 2021	Text Generation	—Unverified	0
Topic Modelling Meets Deep Neural Networks: A Survey	Feb 28, 2021	NavigateSurvey	—Unverified	0
Learning Transferable Visual Models From Natural Language Supervision	Feb 26, 2021	Action RecognitionBenchmarking	CodeCode Available	2
Enhanced Modality Transition for Image Captioning	Feb 23, 2021	DecoderImage Captioning	—Unverified	0
Controllable and Diverse Text Generation in E-commerce	Feb 23, 2021	DiversityText Generation	—Unverified	0
Exploring Supervised and Unsupervised Rewards in Machine Translation	Feb 22, 2021	Machine TranslationReinforcement Learning (RL)	CodeCode Available	1
Towards Automatic Evaluation of Dialog Systems: A Model-Free Off-Policy Evaluation Approach	Feb 20, 2021	Model-based Reinforcement LearningOff-policy evaluation	—Unverified	0
Progressive Transformer-Based Generation of Radiology Reports	Feb 19, 2021	Image to textText Generation	CodeCode Available	1
Towards Faithfulness in Open Domain Table-to-text Generation from an Entity-centric View	Feb 17, 2021	Few-Shot LearningTable-to-Text Generation	—Unverified	0
Searching for Search Errors in Neural Morphological Inflection	Feb 16, 2021	Morphological InflectionText Generation	—Unverified	0
Non-Autoregressive Text Generation with Pre-trained Language Models	Feb 16, 2021	Machine TranslationSentence	CodeCode Available	1
Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNet	Feb 16, 2021	Text Generation	CodeCode Available	0
Generating Diversified Comments via Reader-Aware Topic Modeling and Saliency Detection	Feb 13, 2021	ArticlesClustering	—Unverified	0

Show:10 25 50

← PrevPage 140 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified