Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 3176–3200 of 5335 papers

Title	Date	Tasks	Status	Hype
Controllable Dialogue Generation with Disentangled Multi-grained Style Specification and Attribute Consistency Reward	Sep 14, 2021	AttributeDecoder	—Unverified	0
KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning	Sep 14, 2021	Contrastive LearningDecoder	—Unverified	0
End-to-end argumentation knowledge graph construction	Sep 13, 2021	16kFake News Detection	—Unverified	0
UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation	Sep 13, 2021	Abstractive Text SummarizationDecoder	—Unverified	0
Perturbation CheckLists for Evaluating NLG Evaluation Metrics	Sep 13, 2021	Data-to-Text Generationnlg evaluation	CodeCode Available	0
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation	Sep 13, 2021	DecoderDenoising	CodeCode Available	1
Implicit Premise Generation with Discourse-aware Commonsense Knowledge Models	Sep 11, 2021	Text Generation	CodeCode Available	0
COSMic: A Coherence-Aware Generation Metric for Image Descriptions	Sep 11, 2021	Caption GenerationImage Captioning	CodeCode Available	1
Generating Self-Contained and Summary-Centric Question Answer Pairs via Differentiable Reward Imitation Learning	Sep 10, 2021	ArticlesImitation Learning	CodeCode Available	0
Controlled Neural Sentence-Level Reframing of News Articles	Sep 10, 2021	ArticlesSentence	—Unverified	0
Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization	Sep 10, 2021	Abstractive Dialogue SummarizationArticles	CodeCode Available	1
CINS: Comprehensive Instruction for Few-shot Learning in Task-oriented Dialog Systems	Sep 10, 2021	dialog state trackingFew-Shot Learning	—Unverified	0
Graphine: A Dataset for Graph-aware Terminology Definition Generation	Sep 9, 2021	Graph Neural NetworkGraph Representation Learning	CodeCode Available	0
Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Models	Sep 8, 2021	Concept-To-Text GenerationSpecificity	—Unverified	0
Sequence Level Contrastive Learning for Text Summarization	Sep 8, 2021	Abstractive Text SummarizationContrastive Learning	CodeCode Available	1
Smelting Gold and Silver for Improved Multilingual AMR-to-Text Generation	Sep 8, 2021	AMR-to-Text GenerationData Augmentation	CodeCode Available	0
IndicBART: A Pre-trained Model for Indic Natural Language Generation	Sep 7, 2021	Extreme SummarizationMachine Translation	CodeCode Available	1
Naturalness Evaluation of Natural Language Generation in Task-oriented Dialogues using BERT	Sep 7, 2021	InformativenessText Generation	—Unverified	0
Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings	Sep 7, 2021	AllLanguage Modeling	—Unverified	0
Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization	Sep 6, 2021	Abstractive Text SummarizationText Generation	CodeCode Available	1
Towards Retrieval-based Conversational Recommendation	Sep 6, 2021	Conversational RecommendationRecommendation Systems	CodeCode Available	0
Transformer Models for Text Coherence Assessment	Sep 5, 2021	Coherence EvaluationMachine Translation	CodeCode Available	1
Biomedical Data-to-Text Generation via Fine-Tuning Transformers	Sep 3, 2021	BenchmarkingData-to-Text Generation	CodeCode Available	1
Multimodal Conditionality for Natural Language Generation	Sep 2, 2021	DescriptiveLanguage Modeling	—Unverified	0
ConQX: Semantic Expansion of Spoken Queries for Intent Detection based on Conditioned Text Generation	Sep 2, 2021	Few-Shot LearningIntent Detection	—Unverified	0

Show:10 25 50

← PrevPage 128 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified