Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 351–375 of 5335 papers

Title	Date	Tasks	Status	Hype	Score
Content-Based Collaborative Generation for Recommender Systems	Mar 27, 2024	Collaborative FilteringLanguage Modelling	CodeCode Available	1	5
Enhancing Contextual Understanding in Large Language Models through Contrastive Decoding	May 4, 2024	Open-Domain Question AnsweringQuestion Answering	CodeCode Available	1	5
ELMER: A Non-Autoregressive Pre-trained Language Model for Efficient and Effective Text Generation	Oct 24, 2022	Language ModelingLanguage Modelling	CodeCode Available	1	5
Bootstrapping Interactive Image-Text Alignment for Remote Sensing Image Captioning	Dec 2, 2023	Causal Language ModelingContrastive Learning	CodeCode Available	1	5
Elucidating the design space of language models for image generation	Oct 21, 2024	Image GenerationText Generation	CodeCode Available	1	5
Coherence boosting: When your pretrained language model is not paying enough attention	Oct 15, 2021	Language ModelingLanguage Modelling	CodeCode Available	1	5
Efficient Task-Oriented Dialogue Systems with Response Selection as an Auxiliary Task	Aug 15, 2022	Task-Oriented Dialogue SystemsText Generation	CodeCode Available	1	5
EmoDynamiX: Emotional Support Dialogue Strategy Prediction by Modelling MiXed Emotions and Discourse Dynamics	Aug 16, 2024	Decision MakingEmotion Recognition	CodeCode Available	1	5
Building Efficient Universal Classifiers with Natural Language Inference	Dec 29, 2023	ClassificationNatural Language Inference	CodeCode Available	1	5
Brain2Word: Decoding Brain Activity for Language Generation	Sep 10, 2020	Brain DecodingText Generation	CodeCode Available	1	5
Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention	May 7, 2022	Text GenerationTransfer Learning	CodeCode Available	1	5
Leveraging Large Language Models for Node Generation in Few-Shot Learning on Text-Attributed Graphs	Oct 15, 2023	Few-Shot LearningGraph Learning	CodeCode Available	1	5
Black Box Adversarial Prompting for Foundation Models	Feb 8, 2023	Text Generation	CodeCode Available	1	5
CR-Walker: Tree-Structured Graph Reasoning and Dialog Acts for Conversational Recommendation	Oct 20, 2020	Conversational RecommendationRecommendation Systems	CodeCode Available	1	5
Bringing Stories Alive: Generating Interactive Fiction Worlds	Jan 28, 2020	Text Generation	CodeCode Available	1	5
BOLT: Fast Energy-based Controlled Text Generation with Tunable Biases	May 19, 2023	Text Generation	CodeCode Available	1	5
Abg-CoQA: Clarifying Ambiguity in Conversational Question Answering	Jun 22, 2021	4kConversational Question Answering	CodeCode Available	1	5
Calibrating Large Language Models Using Their Generations Only	Mar 9, 2024	Question AnsweringText Generation	CodeCode Available	1	5
C2-CRS: Coarse-to-Fine Contrastive Learning for Conversational Recommender System	Jan 4, 2022	Contrastive LearningRecommendation Systems	CodeCode Available	1	5
Cascaded Text Generation with Markov Transformers	Jun 1, 2020	Machine TranslationText Generation	CodeCode Available	1	5
Cascade Reward Sampling for Efficient Decoding-Time Alignment	Jun 24, 2024	Text Generation	CodeCode Available	1	5
A BERT-based Distractor Generation Scheme with Multi-tasking and Negative Answer Training Strategies	Oct 12, 2020	Distractor GenerationMultiple-choice	CodeCode Available	1	5
ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language Generation	Jan 26, 2020	Abstractive Text SummarizationDecoder	CodeCode Available	1	5
An Overview on Controllable Text Generation via Variational Auto-Encoders	Nov 15, 2022	Text Generation	CodeCode Available	1	5
Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints	Feb 17, 2023	Text Generation	CodeCode Available	1	5

Show:10 25 50

← PrevPage 15 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified