Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 3376–3400 of 5335 papers

Title	Date	Tasks	Status	Hype
Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation	May 31, 2021	DescriptiveTable-to-Text Generation	—Unverified	0
A Compression-Compilation Framework for On-mobile Real-time BERT Applications	May 30, 2021	Question AnsweringText Generation	—Unverified	0
Annotation Inconsistency and Entity Bias in MultiWOZ	May 29, 2021	dialog state trackingMemorization	—Unverified	0
Grammar Accuracy Evaluation (GAE): Quantifiable Quantitative Evaluation of Machine Translation Models	May 29, 2021	Machine TranslationSentence	—Unverified	0
SciFive: a text-to-text transformer model for biomedical literature	May 28, 2021	Document ClassificationDrug–drug Interaction Extraction	CodeCode Available	1
OTTers: One-turn Topic Transitions for Open-Domain Dialogue	May 28, 2021	Text Generation	CodeCode Available	1
Data Augmentation for Text Generation Without Any Augmented Data	May 28, 2021	Data AugmentationText Generation	—Unverified	0
Generative Adversarial Imitation Learning for Empathy-based AI	May 27, 2021	Imitation LearningLanguage Modelling	—Unverified	0
Argument Undermining: Counter-Argument Generation by Attacking Weak Premises	May 25, 2021	Text Generation	CodeCode Available	0
Personalized Transformer for Explainable Recommendation	May 25, 2021	Explainable RecommendationLanguage Modeling	CodeCode Available	1
VANiLLa : Verbalized Answers in Natural Language at Large Scale	May 24, 2021	BIG-bench Machine LearningKnowledge Graphs	CodeCode Available	0
Retrieval Enhanced Model for Commonsense Generation	May 24, 2021	modelRetrieval	CodeCode Available	1
Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Training	May 24, 2021	Image CaptioningMedical Visual Question Answering	CodeCode Available	1
Controlling Text Edition by Changing Answers of Specific Questions	May 23, 2021	Table-to-Text GenerationText Generation	CodeCode Available	0
Killing One Bird with Two Stones: Model Extraction and Attribute Inference Attacks against BERT-based APIs	May 23, 2021	AttributeInference Attack	—Unverified	0
Automated Knee X-ray Report Generation	May 22, 2021	DiagnosticText Generation	—Unverified	0
Towards a Universal NLG for Dialogue Systems and Simulators with Future Bridging	May 21, 2021	Text Generation	—Unverified	0
SmartPatch: Improving Handwritten Word Imitation with Patch Discriminators	May 21, 2021	Data AugmentationHandwritten Text Recognition	CodeCode Available	1
Pretrained Language Models for Text Generation: A Survey	May 21, 2021	SurveyText Generation	—Unverified	0
Retrieval-Augmented Transformer-XL for Close-Domain Dialog Generation	May 19, 2021	Response GenerationRetrieval	—Unverified	0
OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metrics	May 19, 2021	Story GenerationText Generation	CodeCode Available	1
Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherence	May 19, 2021	DecoderSemantic Similarity	CodeCode Available	1
One SPRING to Rule Them Both: Symmetric AMR Semantic Parsing and Generation without a Complex Pipeline	May 18, 2021	AMR ParsingAMR-to-Text Generation	CodeCode Available	1
CoTexT: Multi-task Learning with Code-Text Transformer	May 18, 2021	Code GenerationCode Summarization	CodeCode Available	1
Stylized Story Generation with Style-Guided Planning	May 18, 2021	Story GenerationText Generation	—Unverified	0

Show:10 25 50

← PrevPage 136 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified