Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 2976–3000 of 5335 papers

Title	Date	Tasks	Status	Hype
Tackling Query-Focused Summarization as A Knowledge-Intensive Task: A Pilot Study	Dec 14, 2021	Open-Domain Question AnsweringPassage Retrieval	—Unverified	0
Massive-scale Decoding for Text Generation using Lattices	Dec 14, 2021	Document SummarizationMachine Translation	CodeCode Available	1
Step-unrolled Denoising Autoencoders for Text Generation	Dec 13, 2021	DenoisingLanguage Modeling	CodeCode Available	1
Controlled Cue Generation for Play Scripts	Dec 13, 2021	AttributeLanguage Modeling	—Unverified	0
Contextualized Scene Imagination for Generative Commonsense Reasoning	Dec 12, 2021	Common Sense ReasoningDescriptive	CodeCode Available	0
Towards More Efficient Insertion Transformer with Fractional Positional Encoding	Dec 12, 2021	Text Generation	CodeCode Available	0
Improving Logical-Level Natural Language Generation with Topic-Conditioned Data Augmentation and Logical Form Generation	Dec 12, 2021	Data AugmentationForm	—Unverified	0
Show, Write, and Retrieve: Entity-aware Article Generation and Retrieval	Dec 11, 2021	ArticlesNews Generation	CodeCode Available	0
VUT: Versatile UI Transformer for Multi-Modal Multi-Task User Interface Modeling	Dec 10, 2021	object-detectionObject Detection	—Unverified	0
Sampling from Discrete Energy-Based Models with Quality/Efficiency Trade-offs	Dec 10, 2021	Paraphrase GenerationText Generation	—Unverified	0
Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation	Dec 10, 2021	Image-text matchingImage-text Retrieval	—Unverified	0
Discourse-Aware Soft Prompting for Text Generation	Dec 10, 2021	BlockingConditional Text Generation	—Unverified	0
Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasures	Dec 9, 2021	Text Generation	CodeCode Available	1
Self-Supervised Image-to-Text and Text-to-Image Synthesis	Dec 9, 2021	Image GenerationImage to text	CodeCode Available	0
Does Structure Matter? Leveraging Data-to-Text Generation for Answering Complex Information Needs	Dec 8, 2021	Data-to-Text GenerationRetrieval	CodeCode Available	0
Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand	Dec 8, 2021	Image CaptioningMachine Translation	CodeCode Available	1
Natural Answer Generation: From Factoid Answer to Full-length Answer using Grammar Correction	Dec 7, 2021	Answer GenerationQuestion Answering	—Unverified	0
Search and Learn: Improving Semantic Coverage for Data-to-Text Generation	Dec 6, 2021	Data-to-Text GenerationText Generation	CodeCode Available	0
Protecting Intellectual Property of Language Generation APIs with Lexical Watermark	Dec 5, 2021	Document SummarizationImage Captioning	CodeCode Available	0
Global Context with Discrete Diffusion in Vector Quantised Modelling for Image Generation	Dec 3, 2021	DenoisingImage Generation	—Unverified	0
InfoLM: A New Metric to Evaluate Summarization & Data2Text Generation	Dec 2, 2021	Language ModelingLanguage Modelling	CodeCode Available	1
LOGEN: Few-shot Logical Knowledge-Conditioned Text Generation with Self-training	Dec 2, 2021	Text Generation	—Unverified	0
Stylistic MR-to-Text Generation Using Pre-trained Language Models	Dec 1, 2021	DecoderPOS	—Unverified	0
An Efficient Keyframes Selection Based Framework for Video Captioning	Dec 1, 2021	Text GenerationVideo Captioning	—Unverified	0
Cross-lingual Alignment of Knowledge Graph Triples with Sentences	Dec 1, 2021	Data-to-Text GenerationKnowledge Graph Completion	—Unverified	0

Show:10 25 50

← PrevPage 120 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified