Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 2026–2050 of 5335 papers

Title	Date	Tasks	Status	Hype
Exposing Bias in Online Communities through Large-Scale Language Models	Jun 4, 2023	Text Generation	—Unverified	0
Modular Transformers: Compressing Transformers into Modularized Layers for Flexible Efficient Inference	Jun 4, 2023	DecoderKnowledge Distillation	—Unverified	0
Long Text Generation Challenge	Jun 4, 2023	Text Generation	—Unverified	0
A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models	Jun 4, 2023	ChatbotQuestion Answering	—Unverified	0
Adaptive and Personalized Exercise Generation for Online Language Learning	Jun 4, 2023	Knowledge TracingText Generation	CodeCode Available	1
A two-way translation system of Chinese sign language based on computer vision	Jun 3, 2023	SentenceSign Language Recognition	—Unverified	0
Fine-Grained Human Feedback Gives Better Rewards for Language Model Training	Jun 2, 2023	Language ModelingLanguage Modelling	CodeCode Available	2
Binary and Ternary Natural Language Generation	Jun 2, 2023	Machine TranslationQuantization	CodeCode Available	1
Preference-grounded Token-level Guidance for Language Model Fine-tuning	Jun 1, 2023	Imitation LearningLanguage Modeling	CodeCode Available	1
Multi-Dimensional Evaluation of Text Summarization with In-Context Learning	Jun 1, 2023	In-Context LearningText Generation	CodeCode Available	0
Focused Prefix Tuning for Controllable Text Generation	Jun 1, 2023	AttributeText Generation	—Unverified	0
FlexRound: Learnable Rounding based on Element-wise Division for Post-Training Quantization	Jun 1, 2023	image-classificationImage Classification	CodeCode Available	0
CFL: Causally Fair Language Models Through Token-level Attribute Controlled Generation	Jun 1, 2023	Attributecounterfactual	—Unverified	0
EEL: Efficiently Encoding Lattices for Reranking	Jun 1, 2023	Conditional Text GenerationReranking	CodeCode Available	0
Differentiable Tree Operations Promote Compositional Generalization	Jun 1, 2023	Semantic ParsingText Generation	CodeCode Available	1
Factually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedback	May 31, 2023	Abstractive Text SummarizationNatural Language Inference	—Unverified	0
An Invariant Learning Characterization of Controlled Text Generation	May 31, 2023	AttributeLanguage Modeling	CodeCode Available	0
Pre-Trained Language-Meaning Models for Multilingual Parsing and Generation	May 31, 2023	Cross-Lingual TransferDRS Parsing	CodeCode Available	0
Fine-grained Text Style Transfer with Diffusion-Based Language Models	May 31, 2023	Style TransferText Generation	CodeCode Available	1
Speaking the Language of Your Listener: Audience-Aware Adaptation via Plug-and-Play Theory of Mind	May 31, 2023	Language ModelingLanguage Modelling	CodeCode Available	0
Scalable Learning of Latent Language Structure With Logical Offline Cycle Consistency	May 31, 2023	Self-LearningText Generation	—Unverified	0
Deliberate then Generate: Enhanced Prompting Framework for Text Generation	May 31, 2023	Text Generation	—Unverified	0
Less Likely Brainstorming: Using Language Models to Generate Alternative Hypotheses	May 30, 2023	Contrastive LearningDecision Making	—Unverified	0
KEYword based Sampling (KEYS) for Large Language Models	May 30, 2023	Knowledge DistillationLanguage Modeling	—Unverified	0
Unsupervised Melody-to-Lyric Generation	May 30, 2023	DisentanglementRhythm	CodeCode Available	1

Show:10 25 50

← PrevPage 82 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified