Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 2976–3000 of 5335 papers

Title	Date	Tasks	Status
A Non-monotonic Self-terminating Language Model	Oct 3, 2022	Language ModelingLanguage Modelling	CodeCode Available
Comparing BERT-based Reward Functions for Deep Reinforcement Learning in Machine Translation	Oct 1, 2022	Deep Reinforcement LearningMachine Translation	—Unverified
Enhancing Task-Specific Distillation in Small Data Regimes through Language Generation	Oct 1, 2022	Data AugmentationMRPC	—Unverified
Using Structured Content Plans for Fine-grained Syntactic Control in Pretrained Language Model Generation	Oct 1, 2022	Abstract Meaning RepresentationLanguage Modeling	—Unverified
Building Joint Relationship Attention Network for Image-Text Generation	Oct 1, 2022	Text Generation	—Unverified
Improving Code-switched ASR with Linguistic Information	Oct 1, 2022	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	—Unverified
The COVID That Wasn’t: Counterfactual Journalism Using GPT	Oct 1, 2022	Articlescounterfactual	—Unverified
BiBL: AMR Parsing and Generation with Bidirectional Bayesian Learning	Oct 1, 2022	Abstract Meaning RepresentationAMR Parsing	CodeCode Available
War and Pieces: Comparing Perspectives About World War I and II Across Wikipedia Language Communities	Oct 1, 2022	Articlesnamed-entity-recognition	—Unverified
Topicalization in Language Models: A Case Study on Japanese	Oct 1, 2022	PositionSentence	—Unverified
Does Meta-learning Help mBERT for Few-shot Question Generation in a Cross-lingual Transfer Setting for Indic Languages?	Oct 1, 2022	Cross-Lingual TransferLanguage Modeling	—Unverified
Analyzing Persuasion Strategies of Debaters on Social Media	Oct 1, 2022	Persuasion StrategiesText Generation	—Unverified
Multi-Attribute Controlled Text Generation with Contrastive-Generator and External-Discriminator	Oct 1, 2022	AttributeComment Generation	—Unverified
Programmable Annotation with Diversed Heuristics and Data Denoising	Oct 1, 2022	DenoisingText Generation	—Unverified
CoCGAN: Contrastive Learning for Adversarial Category Text Generation	Oct 1, 2022	Contrastive LearningText Generation	—Unverified
Few-Shot Pidgin Text Adaptation via Contrastive Fine-Tuning	Oct 1, 2022	Text Generation	—Unverified
Quantifying Bias from Decoding Techniques in Natural Language Generation	Oct 1, 2022	DecoderText Generation	CodeCode Available
Content Type Profiling of Data-to-Text Generation Datasets	Oct 1, 2022	Data-to-Text GenerationText Generation	CodeCode Available
QSTS: A Question-Sensitive Text Similarity Measure for Question Generation	Oct 1, 2022	Question GenerationQuestion-Generation	—Unverified
NLG-Metricverse: An End-to-End Library for Evaluating Natural Language Generation	Oct 1, 2022	Managementnlg evaluation	—Unverified
Faithful Abstractive Summarization via Fact-aware Consistency-constrained Transformer	Oct 1, 2022	Abstractive Text SummarizationText Generation	CodeCode Available
CodeDSI: Differentiable Code Search	Oct 1, 2022	Code GenerationCode Search	—Unverified
FRE at SocialDisNER: Joint Learning of Language Models for Named Entity Recognition	Oct 1, 2022	named-entity-recognitionNamed Entity Recognition	—Unverified
Investigating Metric Diversity for Evaluating Long Document Summarisation	Oct 1, 2022	DiversityText Generation	CodeCode Available
Improving Zero-Shot Multilingual Text Generation via Iterative Distillation	Oct 1, 2022	Knowledge DistillationText Generation	—Unverified

Show:10 25 50

← PrevPage 120 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified