Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 2726–2750 of 5335 papers

Title	Date	Tasks	Status	Hype
Gradient-Based Constrained Sampling from Language Models	May 25, 2022	Language ModelingLanguage Modelling	CodeCode Available	1
The Dialog Must Go On: Improving Visual Dialog via Generative Self-Training	May 25, 2022	Conditional Text GenerationOut-of-Distribution Detection	CodeCode Available	1
R2D2: Robust Data-to-Text with Replacement Detection	May 25, 2022	Data-to-Text GenerationEntity Retrieval	CodeCode Available	0
Automatic question generation based on sentence structure analysis using machine learning approach	May 25, 2022	BIG-bench Machine LearningNatural Language Understanding	—Unverified	0
Leveraging Locality in Abstractive Text Summarization	May 25, 2022	Abstractive Text SummarizationText Generation	CodeCode Available	1
A Zipf's Law-based Text Generation Approach for Addressing Imbalance in Entity Extraction	May 25, 2022	Text Generation	—Unverified	0
PLOG: Table-to-Logic Pretraining for Logical Table-to-Text Generation	May 25, 2022	Table-to-Text GenerationText Generation	CodeCode Available	1
Medical Scientific Table-to-Text Generation with Human-in-the-Loop under the Data Sparsity Constraint	May 24, 2022	Data AugmentationTable-to-Text Generation	—Unverified	0
On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization	May 24, 2022	DescriptiveImage Captioning	—Unverified	0
Reassessing Evaluation Practices in Visual Question Answering: A Case Study on Out-of-Distribution Generalization	May 24, 2022	Image CaptioningOut-of-Distribution Generalization	—Unverified	0
A Self-Paced Mixed Distillation Method for Non-Autoregressive Generation	May 23, 2022	Question GenerationQuestion-Generation	—Unverified	0
BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla	May 23, 2022	Conditional Text GenerationDialogue Generation	CodeCode Available	1
Challenges in Measuring Bias via Open-Ended Language Generation	May 23, 2022	Language ModelingLanguage Modelling	CodeCode Available	0
TempLM: Distilling Language Models into Template-Based Generators	May 23, 2022	Text Generation	CodeCode Available	1
What Makes Data-to-Text Generation Hard for Pretrained Language Models?	May 23, 2022	Data-to-Text GenerationFew-Shot Learning	—Unverified	0
Diversity Enhanced Table-to-Text Generation via Type Control	May 22, 2022	DiversityTable-to-Text Generation	—Unverified	0
CORAL: Contextual Response Retrievability Loss Function for Training Dialog Generation Models	May 21, 2022	Reinforcement Learning (RL)Text Generation	—Unverified	0
Few-Shot Natural Language Inference Generation with PDD: Prompt and Dynamic Demonstration	May 21, 2022	Data AugmentationNatural Language Inference	—Unverified	0
Towards Understanding Gender-Seniority Compound Bias in Natural Language Generation	May 19, 2022	Text Generation	CodeCode Available	0
Why GANs are overkill for NLP	May 19, 2022	Text Generation	—Unverified	0
Twist Decoding: Diverse Generators Guide Each Other	May 19, 2022	Machine TranslationReranking	CodeCode Available	1
Learning from Bootstrapping and Stepwise Reinforcement Reward: A Semi-Supervised Framework for Text Style Transfer	May 19, 2022	SentenceStyle Transfer	CodeCode Available	0
Self-training with Two-phase Self-augmentation for Few-shot Dialogue Generation	May 19, 2022	Dialogue GenerationLanguage Modelling	CodeCode Available	0
RankGen: Improving Text Generation with Large Ranking Models	May 19, 2022	Contrastive LearningLanguage Modeling	CodeCode Available	1
CREATER: CTR-driven Advertising Text Generation with Controlled Pre-Training and Contrastive Fine-Tuning	May 18, 2022	Contrastive LearningText Generation	—Unverified	0

Show:10 25 50

← PrevPage 110 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified