Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 601–625 of 5335 papers

Title	Date	Tasks	Status	Hype
How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation	Feb 18, 2023	Machine TranslationText Generation	CodeCode Available	1
Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints	Feb 17, 2023	Text Generation	CodeCode Available	1
Towards Unifying Medical Vision-and-Language Pre-training via Soft Prompts	Feb 17, 2023	Image RetrievalImage-text Classification	CodeCode Available	1
Retrieval-augmented Image Captioning	Feb 16, 2023	DecoderImage Captioning	CodeCode Available	1
Speculative Decoding with Big Little Decoder	Feb 15, 2023	Decoderde-en	CodeCode Available	1
A Reparameterized Discrete Diffusion Model for Text Generation	Feb 11, 2023	modelText Generation	CodeCode Available	1
Bag of Tricks for Training Data Extraction from Language Models	Feb 9, 2023	Text Generation	CodeCode Available	1
Black Box Adversarial Prompting for Foundation Models	Feb 8, 2023	Text Generation	CodeCode Available	1
LoFT: Enhancing Faithfulness and Diversity for Table-to-Text Generation via Logic Form Control	Feb 6, 2023	DiversityForm	CodeCode Available	1
Protecting Language Generation Models via Invisible Watermarking	Feb 6, 2023	Model extractionText Generation	CodeCode Available	1
Unleashing the True Potential of Sequence-to-Sequence Models for Sequence Tagging and Structure Parsing	Feb 5, 2023	Dependency Parsingnamed-entity-recognition	CodeCode Available	1
Execution-based Code Generation using Deep Reinforcement Learning	Jan 31, 2023	Code CompletionCode Generation	CodeCode Available	1
Adaptive Machine Translation with Large Language Models	Jan 30, 2023	DecoderDomain Adaptation	CodeCode Available	1
Input Perturbation Reduces Exposure Bias in Diffusion Models	Jan 27, 2023	DenoisingImage Generation	CodeCode Available	1
MTTN: Multi-Pair Text to Text Narratives for Prompt Generation	Jan 21, 2023	Text2text GenerationText Generation	CodeCode Available	1
UserSimCRS: A User Simulation Toolkit for Evaluating Conversational Recommender Systems	Jan 13, 2023	Recommendation SystemsText Generation	CodeCode Available	1
Fusing Pre-Trained Language Models With Multimodal Prompts Through Reinforcement Learning	Jan 1, 2023	Language ModelingLanguage Modelling	CodeCode Available	1
On Realization of Intelligent Decision-Making in the Real World: A Foundation Decision Model Perspective	Dec 24, 2022	Decision MakingImage Captioning	CodeCode Available	1
Critic-Guided Decoding for Controlled Text Generation	Dec 21, 2022	Language ModelingLanguage Modelling	CodeCode Available	1
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation	Dec 20, 2022	Text Generation	CodeCode Available	1
On Improving Summarization Factual Consistency from Natural Language Feedback	Dec 20, 2022	Text GenerationZero-Shot Learning	CodeCode Available	1
Toward Human-Like Evaluation for Natural Language Generation with Error Analysis	Dec 20, 2022	Language ModelingLanguage Modelling	CodeCode Available	1
SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers	Dec 20, 2022	DecoderDenoising	CodeCode Available	1
SESCORE2: Learning Text Generation Evaluation via Synthesizing Realistic Mistakes	Dec 19, 2022	Dialogue GenerationMachine Translation	CodeCode Available	1
Latent Diffusion for Language Generation	Dec 19, 2022	DecoderText Generation	CodeCode Available	1

Show:10 25 50

← PrevPage 25 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified