Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 2351–2375 of 5335 papers

Title	Date	Tasks	Status	Hype
Critic-Guided Decoding for Controlled Text Generation	Dec 21, 2022	Language ModelingLanguage Modelling	CodeCode Available	1
A Mutation-based Text Generation for Adversarial Machine Learning Applications	Dec 21, 2022	Text Generation	—Unverified	0
How Does Beam Search improve Span-Level Confidence Estimation in Generative Sequence Labeling?	Dec 21, 2022	slot-fillingSlot Filling	—Unverified	0
A survey on text generation using generative adversarial networks	Dec 20, 2022	Adversarial TextSurvey	—Unverified	0
Ontologically Faithful Generation of Non-Player Character Dialogues	Dec 20, 2022	Dialogue GenerationIn-Context Learning	—Unverified	0
SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers	Dec 20, 2022	DecoderDenoising	CodeCode Available	1
PairReranker: Pairwise Reranking for Natural Language Generation	Dec 20, 2022	Machine TranslationReranking	—Unverified	0
On Improving Summarization Factual Consistency from Natural Language Feedback	Dec 20, 2022	Text GenerationZero-Shot Learning	CodeCode Available	1
WeCheck: Strong Factual Consistency Checker via Weakly Supervised Learning	Dec 20, 2022	Natural Language InferenceQuestion Answering	CodeCode Available	0
Toward Human-Like Evaluation for Natural Language Generation with Error Analysis	Dec 20, 2022	Language ModelingLanguage Modelling	CodeCode Available	1
SimpleStyle: An Adaptable Style Transfer Approach	Dec 20, 2022	AttributeDenoising	—Unverified	0
BMX: Boosting Natural Language Generation Metrics with Explainability	Dec 20, 2022	Feature ImportanceMachine Translation	CodeCode Available	0
Diffusion Glancing Transformer for Parallel Sequence to Sequence Learning	Dec 20, 2022	Knowledge DistillationMachine Translation	—Unverified	0
I Cast Detect Thoughts: Learning to Converse and Guide with Intents and Theory-of-Mind in Dungeons and Dragons	Dec 20, 2022	Reinforcement Learning (RL)Text Generation	—Unverified	0
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation	Dec 20, 2022	Text Generation	CodeCode Available	1
Identifying and Manipulating the Personality Traits of Language Models	Dec 20, 2022	DiagnosticLanguage Modeling	—Unverified	0
Controllable Text Generation with Language Constraints	Dec 20, 2022	AttributeLanguage Modeling	—Unverified	0
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator	Dec 20, 2022	DecoderDenoising	CodeCode Available	0
Latent Diffusion for Language Generation	Dec 19, 2022	DecoderText Generation	CodeCode Available	1
CiteBench: A benchmark for Scientific Citation Text Generation	Dec 19, 2022	Text Generation	CodeCode Available	0
Explanation Regeneration via Information Bottleneck	Dec 19, 2022	Explanation GenerationLanguage Modeling	CodeCode Available	0
A Natural Bias for Language Generation Models	Dec 19, 2022	Machine TranslationText Generation	—Unverified	0
One Embedder, Any Task: Instruction-Finetuned Text Embeddings	Dec 19, 2022	Information RetrievalLearning Word Embeddings	CodeCode Available	4
SESCORE2: Learning Text Generation Evaluation via Synthesizing Realistic Mistakes	Dec 19, 2022	Dialogue GenerationMachine Translation	CodeCode Available	1
An Extensible Plug-and-Play Method for Multi-Aspect Controllable Text Generation	Dec 19, 2022	Machine TranslationText Generation	CodeCode Available	1

Show:10 25 50

← PrevPage 95 of 214Next →

All datasets DART COCO Captions EMNLP2017 WMT ReDial CommonGen ROCStories Chinese Poems Czech restaurant information OpenWebText SciQ Yahoo Questions ADGEN

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	T5B Baseline	BLEU	48.74	—	Unverified
2	FactT5B	BLEU	48.37	—	Unverified
3	JointGT Baseline	BLEU	47.51	—	Unverified
4	FactJointGT	BLEU	47.39	—	Unverified
5	Control Prefixes (T5-large)	METEOR	0.41	—	Unverified
6	T5	METEOR	0.12	—	Unverified
7	BART	METEOR	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.95	—	Unverified
2	partGAN	BLEU-2	0.91	—	Unverified
3	RankGAN	BLEU-2	0.85	—	Unverified
4	RelGAN (100)	BLEU-2	0.85	—	Unverified
5	SeqGAN	BLEU-2	0.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LeakGAN	BLEU-2	0.96	—	Unverified
2	PPOGAN	BLEU-2	0.91	—	Unverified
3	RelGAN	BLEU-2	0.88	—	Unverified
4	SeqGAN	BLEU-2	0.86	—	Unverified
5	RankGAN	BLEU-2	0.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniCRS	Distinct-3	0.65	—	Unverified
2	CRFR	Distinct-3	0.52	—	Unverified
3	KGSF	Distinct-3	0.43	—	Unverified
4	C2CRS	Distinct-3	0.33	—	Unverified
5	KBRD	Distinct-3	0.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	UniLM	CIDEr	14.92	—	Unverified
2	BART (TextBox 2.0)	CIDEr	12.98	—	Unverified
3	BART	METEOR	0.3	—	Unverified
4	T5	METEOR	0.29	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Beam search + A*esque (beam)	BLEU-1	34.4	—	Unverified
2	Beam search + A*esque (sample)	BLEU-1	34.4	—	Unverified
3	Beam search + A*esque (greedy)	BLEU-1	34.3	—	Unverified
4	Beam search	BLEU-1	33.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RankGAN	BLEU-2	0.81	—	Unverified
2	SeqGAN	BLEU-2	0.74	—	Unverified
3	LeakGAN	BLEU-2	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TGen++	METEOR	0.17	—	Unverified
2	TGen	METEOR	0.15	—	Unverified
3	TGen+	METEOR	0.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT2-124M	eval_loss	3.12	—	Unverified
2	GPT2-81M-LOOP	eval_loss	3.11	—	Unverified
3	GPT2-Hermite	eval_loss	2.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA-65B+CFG (zero-shot)	Accuracy	96.6	—	Unverified
2	LLaMA-30B+CFG (zero-shot)	Accuracy	96.4	—	Unverified
3	LLaMA-13B+CFG (zero-shot)	Accuracy	95.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN-VAE	NLL	332.1	—	Unverified
2	SA-VAE	NLL	327.5	—	Unverified
3	Aggressive VAE	NLL	326.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	BLEU-4	10.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	STWGAN-GP	BLEU-3	0.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PALM	ROUGE-L	41.41	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	64.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AEM+Attention	BLEU-1	14.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	ASR	65.1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BART (TextBox 2.0)	ROUGE-L	42.96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Graph2Seq	BLEU	22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WGANGP + DGflow	JS-4	0.19	—	Unverified