Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 3201–3225 of 5335 papers

Title	Date	Tasks	Status
Efficient Reinforcement Learning for Unsupervised Controlled Text Generation	Apr 16, 2022	reinforcement-learningReinforcement Learning	—Unverified
Bridging Cross-Lingual Gaps During Leveraging the Multilingual Sequence-to-Sequence Pretraining for Text Generation and Understanding	Apr 16, 2022	Cross-Lingual Natural Language InferenceNatural Language Inference	CodeCode Available
Text Revision by On-the-Fly Representation Optimization	Apr 15, 2022	AttributeLanguage Modeling	CodeCode Available
On the Role of Pre-trained Language Models in Word Ordering: A Case Study with BART	Apr 15, 2022	Text Generation	CodeCode Available
Rows from Many Sources: Enriching row completions from Wikidata with a pre-trained Language Model	Apr 14, 2022	DiversityLanguage Modeling	—Unverified
Regularization-based Pruning of Irrelevant Weights in Deep Neural Architectures	Apr 11, 2022	image-classificationImage Classification	CodeCode Available
Uniform Complexity for Text Generation	Apr 11, 2022	Machine TranslationQuestion Answering	CodeCode Available
Toward More Effective Human Evaluation for Machine Translation	Apr 11, 2022	Machine TranslationText Generation	—Unverified
PSP: Pre-trained Soft Prompts for Few-Shot Abstractive Summarization	Apr 9, 2022	Abstractive Text SummarizationDecoder	—Unverified
Enhance Incomplete Utterance Restoration by Joint Learning Token Extraction and Text Generation	Apr 8, 2022	Language ModelingLanguage Modelling	CodeCode Available
Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generation	Apr 3, 2022	Imitation LearningText Generation	CodeCode Available
Entity-Centric Query Refinement	Apr 2, 2022	Language ModellingRecommendation Systems	—Unverified
On the probability-quality paradox in language generation	Mar 31, 2022	Text Generation	—Unverified
Reproducibility Issues for BERT-based Evaluation Metrics	Mar 30, 2022	Machine TranslationText Generation	CodeCode Available
On Decoding Strategies for Neural Text Generators	Mar 29, 2022	DiversityMachine Translation	—Unverified
Generative Design Ideation: A Natural Language Generation Approach	Mar 28, 2022	Text Generation	—Unverified
A Roadmap for Big Model	Mar 26, 2022	Language ModelingLanguage Modelling	—Unverified
Reshaping Robot Trajectories Using Natural Language Commands: A Study of Multi-Modal Data Alignment Using Transformers	Mar 25, 2022	Imitation LearningText Generation	—Unverified
Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal	Mar 23, 2022	counterfactualFairness	—Unverified
Linearizing Transformer with Key-Value Memory	Mar 23, 2022	Abstractive Text SummarizationLanguage Modeling	—Unverified
An Empirical Study on Learning and Improving the Search Objective for Unsupervised Paraphrasing	Mar 23, 2022	Heuristic SearchSentence	—Unverified
Immersive Text Game and Personality Classification	Mar 20, 2022	ClassificationLanguage Modeling	—Unverified
Are You Robert or RoBERTa? Deceiving Online Authorship Attribution Models Using Neural Text Generators	Mar 18, 2022	Authorship AttributionQuestion Answering	—Unverified
GRS: Combining Generation and Revision in Unsupervised Sentence Simplification	Mar 18, 2022	SentenceText Generation	CodeCode Available
DU-VLG: Unifying Vision-and-Language Generation via Dual Sequence-to-Sequence Pre-training	Mar 17, 2022	DenoisingImage Captioning	—Unverified

Show:10 25 50

← PrevPage 129 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified