Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 476–500 of 5335 papers

Title	Date	Tasks	Status	Hype
Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic Enhancement	Oct 12, 2023	Contrastive LearningData Augmentation	CodeCode Available	1
Multimodal Graph Learning for Generative Tasks	Oct 11, 2023	Graph LearningText Generation	CodeCode Available	1
Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Models	Oct 11, 2023	RetrievalText Generation	CodeCode Available	1
Sparse Fine-tuning for Inference Acceleration of Large Language Models	Oct 10, 2023	CPUGPU	CodeCode Available	1
Generative quantum machine learning via denoising diffusion probabilistic models	Oct 9, 2023	DenoisingQuantum Machine Learning	CodeCode Available	1
Latent Diffusion Model for DNA Sequence Generation	Oct 9, 2023	modelText Generation	CodeCode Available	1
Aligning Language Models with Human Preferences via a Bayesian Approach	Oct 9, 2023	Contrastive LearningReinforcement Learning (RL)	CodeCode Available	1
SemStamp: A Semantic Watermark with Paraphrastic Robustness for Text Generation	Oct 6, 2023	SentenceText Generation	CodeCode Available	1
AGIR: Automating Cyber Threat Intelligence Reporting with Natural Language Generation	Oct 4, 2023	HallucinationText Generation	CodeCode Available	1
Integrating UMLS Knowledge into Large Language Models for Medical Question Answering	Oct 4, 2023	Medical Question AnsweringQuestion Answering	CodeCode Available	1
Label Supervised LLaMA Finetuning	Oct 2, 2023	GPUnamed-entity-recognition	CodeCode Available	1
Closing the Curious Case of Neural Text Degeneration	Oct 2, 2023	Text Generation	CodeCode Available	1
TIGERScore: Towards Building Explainable Metric for All Text Generation Tasks	Oct 1, 2023	AllText Generation	CodeCode Available	1
Controllable Text Generation with Residual Memory Transformer	Sep 28, 2023	DecoderText Generation	CodeCode Available	1
Striking Gold in Advertising: Standardization and Exploration of Ad Text Generation	Sep 21, 2023	Language ModellingText Generation	CodeCode Available	1
Less is More for Long Document Summary Evaluation by LLMs	Sep 14, 2023	SentenceText Generation	CodeCode Available	1
Cognitive Mirage: A Review of Hallucinations in Large Language Models	Sep 13, 2023	HallucinationText Generation	CodeCode Available	1
Auto-Regressive Next-Token Predictors are Universal Learners	Sep 13, 2023	Mathematical ReasoningText Generation	CodeCode Available	1
LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models	Aug 30, 2023	2k4k	CodeCode Available	1
Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP	Aug 27, 2023	Question AnsweringText Generation	CodeCode Available	1
Out of the Cage: How Stochastic Parrots Win in Cyber Security Environments	Aug 23, 2023	CyberBattleSimCyberBattleSim (RL) chain scenario	CodeCode Available	1
CiteTracker: Correlating Image and Text for Visual Tracking	Aug 22, 2023	AttributeDescriptive	CodeCode Available	1
Adversarial Illusions in Multi-Modal Embeddings	Aug 22, 2023	Image GenerationText Generation	CodeCode Available	1
Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment	Aug 18, 2023	MMLURed Teaming	CodeCode Available	1
A Methodology for Generative Spelling Correction via Natural Spelling Errors Emulation across Multiple Domains and Languages	Aug 18, 2023	Spelling CorrectionText Generation	CodeCode Available	1

Show:10 25 50

← PrevPage 20 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified