Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 2276–2300 of 5335 papers

Title	Date	Tasks	Status	Hype
Inseq: An Interpretability Toolkit for Sequence Generation Models	Feb 27, 2023	DecoderFeature Importance	CodeCode Available	2
Tailoring Language Generation Models under Total Variation Distance	Feb 26, 2023	DiversityText Generation	CodeCode Available	1
Navigating the Grey Area: How Expressions of Uncertainty and Overconfidence Affect Language Models	Feb 26, 2023	Decision MakingQuestion Answering	—Unverified	0
Toward Fairness in Text Generation via Mutual Information Minimization based on Importance Sampling	Feb 25, 2023	FairnessLanguage Modeling	—Unverified	0
Adapting Knowledge for Few-shot Table-to-Text Generation	Feb 24, 2023	Table-to-Text GenerationText Generation	CodeCode Available	0
Language-Driven Representation Learning for Robotics	Feb 24, 2023	Contrastive LearningImitation Learning	CodeCode Available	2
Improved Training of Mixture-of-Experts Language GANs	Feb 23, 2023	Adversarial TextImage Generation	—Unverified	0
How Does In-Context Learning Help Prompt Tuning?	Feb 22, 2023	In-Context LearningText Generation	—Unverified	0
Improving User Controlled Table-To-Text Generation Robustness	Feb 20, 2023	Table-to-Text GenerationText Generation	CodeCode Available	0
Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation	Feb 19, 2023	Question AnsweringText Generation	CodeCode Available	1
How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation	Feb 18, 2023	Machine TranslationText Generation	CodeCode Available	1
Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints	Feb 17, 2023	Text Generation	CodeCode Available	1
Towards Unifying Medical Vision-and-Language Pre-training via Soft Prompts	Feb 17, 2023	Image RetrievalImage-text Classification	CodeCode Available	1
Role of Bias Terms in Dot-Product Attention	Feb 16, 2023	Language ModelingLanguage Modelling	—Unverified	0
For Generated Text, Is NLI-Neutral Text the Best Text?	Feb 16, 2023	Natural Language InferenceSentence	CodeCode Available	0
The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systems	Feb 16, 2023	Text Generation	CodeCode Available	0
Retrieval-augmented Image Captioning	Feb 16, 2023	DecoderImage Captioning	CodeCode Available	1
Speculative Decoding with Big Little Decoder	Feb 15, 2023	Decoderde-en	CodeCode Available	1
BiasTestGPT: Using ChatGPT for Social Bias Testing of Language Models	Feb 14, 2023	SentenceText Generation	—Unverified	0
The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation	Feb 14, 2023	DiversityStory Generation	—Unverified	0
Large Scale Multi-Lingual Multi-Modal Summarization Dataset	Feb 13, 2023	ArticlesDecoder	CodeCode Available	0
Investigating the Effect of Relative Positional Embeddings on AMR-to-Text Generation with Structural Adapters	Feb 12, 2023	Abstract Meaning RepresentationAMR-to-Text Generation	—Unverified	0
A Reparameterized Discrete Diffusion Model for Text Generation	Feb 11, 2023	modelText Generation	CodeCode Available	1
POSGen: Personalized Opening Sentence Generation for Online Insurance Sales	Feb 10, 2023	ChatbotManagement	—Unverified	0
Plan-then-Seam: Towards Efficient Table-to-Text Generation	Feb 10, 2023	Table-to-Text GenerationText Generation	CodeCode Available	0

Show:10 25 50

← PrevPage 92 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified