Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 2401–2425 of 5335 papers

Title	Date	Tasks	Status	Hype
Towards Robust NLG Bias Evaluation with Syntactically-diverse Prompts	Dec 3, 2022	FairnessText Generation	CodeCode Available	0
CliMedBERT: A Pre-trained Language Model for Climate and Health-related Text	Dec 1, 2022	Fact CheckingLanguage Modeling	—Unverified	0
What do you MEME? Generating Explanations for Visual Semantic Role Labelling in Memes	Dec 1, 2022	MarketingMulti-Task Learning	CodeCode Available	1
Soft Alignment Objectives for Robust Adaptation of Language Generation	Nov 29, 2022	Domain AdaptationMachine Translation	CodeCode Available	0
Controlled Language Generation for Language Learning Items	Nov 28, 2022	Text Generation	CodeCode Available	0
DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models	Nov 28, 2022	DenoisingLanguage Modeling	CodeCode Available	2
Unified Discrete Diffusion for Simultaneous Vision-Language Generation	Nov 27, 2022	multimodal generationText Generation	CodeCode Available	1
Understanding BLOOM: An empirical study on diverse NLP tasks	Nov 27, 2022	DecoderFew-Shot Text Classification	—Unverified	0
Lexical Complexity Controlled Sentence Generation	Nov 26, 2022	SentenceText Generation	—Unverified	0
CodeExp: Explanatory Code Document Generation	Nov 25, 2022	Explanation GenerationText Generation	CodeCode Available	1
On the Importance of Image Encoding in Automated Chest X-Ray Report Generation	Nov 24, 2022	DecoderText Generation	CodeCode Available	1
Look, Read and Ask: Learning to Ask Questions by Reading Text in Images	Nov 23, 2022	Optical Character Recognition (OCR)Question Answering	—Unverified	0
Retrieval-Augmented Multimodal Language Modeling	Nov 22, 2022	Caption GenerationImage Captioning	—Unverified	0
Best-k Search Algorithm for Neural Text Generation	Nov 22, 2022	DiversityQuestion Generation	—Unverified	0
Linear Interpolation In Parameter Space is Good Enough for Fine-Tuned Language Models	Nov 22, 2022	AttributeText Generation	—Unverified	0
In-sample Curriculum Learning by Sequence Completion for Natural Language Generation	Nov 21, 2022	Text Generation	CodeCode Available	0
How to Describe Images in a More Funny Way? Towards a Modular Approach to Cross-Modal Sarcasm Generation	Nov 20, 2022	DescriptiveSentence	—Unverified	0
Artificial Interrogation for Attributing Language Models	Nov 20, 2022	Machine TranslationMulti Class Text Classification	CodeCode Available	0
An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation	Nov 19, 2022	DiversityText Generation	CodeCode Available	1
GENIUS: Sketch-based Language Model Pre-training via Extreme and Selective Masking for Text Generation and Augmentation	Nov 18, 2022	Conditional Text GenerationData Augmentation	CodeCode Available	1
Reducing Hallucinations in Neural Machine Translation with Feature Attribution	Nov 17, 2022	Machine TranslationNMT	—Unverified	0
Reward Gaming in Conditional Text Generation	Nov 16, 2022	Conditional Text GenerationReinforcement Learning (RL)	—Unverified	0
An Overview on Controllable Text Generation via Variational Auto-Encoders	Nov 15, 2022	Text Generation	CodeCode Available	1
kogito: A Commonsense Knowledge Inference Toolkit	Nov 15, 2022	Text Generation	CodeCode Available	1
AutoTemplate: A Simple Recipe for Lexically Constrained Text Generation	Nov 15, 2022	SentenceText Generation	CodeCode Available	0

Show:10 25 50

← PrevPage 97 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified