SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3101–3150 of 5335 papers

TitleStatusHype
Hate a Little Less, Love a Little More! Proactively Curbing Online Hatred via Hate Speech NormalizationCode1
Can Language Models Take A Hint? Prompting for Controllable Contextualized Commonsense Inference—0
Attending to Visual Differences for Situated Language Generation in Changing Scenes—0
MTG: A Benchmarking Suite for Multilingual Text Generation—0
Attention as Grounding: Exploring Textual and Cross-Modal Attention on Entities and Relations in Language-and-Vision Transformer—0
HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generation—0
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metricsfor Automatic Text GenerationCode1
How Well Do You Know Your Audience? Toward Socially-aware Question Generation—0
Open Domain Question Answering with A Unified Knowledge InterfaceCode1
Improving Compositional Generalization with Self-Training for Data-to-Text Generation—0
Coherence boosting: When your pretrained language model is not paying enough attentionCode1
Control Prefixes for Parameter-Efficient Text GenerationCode1
End-to-End Segmentation-based News Summarization—0
Jurassic is (almost) All You Need: Few-Shot Meaning-to-Text Generation for Open-Domain Dialogue—0
Hindsight: Posterior-guided training of retrievers for improved open-ended generation—0
MReD: A Meta-Review Dataset for Structure-Controllable Text GenerationCode1
RecInDial: A Unified Framework for Conversational Recommendation with Pretrained Language Models—0
Plug-Tagger: A Pluggable Sequence Labeling Framework Using Language Models—0
Rethinking Self-Supervision Objectives for Generalizable Coherence Modeling—0
Solving Aspect Category Sentiment Analysis as a Text Generation TaskCode1
Bag-of-Vectors Autoencoders for Unsupervised Conditional Text Generation—0
Differentially Private Fine-tuning of Language ModelsCode1
CLIP4Caption: CLIP for Video Caption—0
Federated Natural Language Generation for Personalized Dialogue System—0
DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational TransformerCode1
Learning Compact Metrics for MTCode1
Småprat: DialoGPT for Natural Language Generation of Swedish Dialogue by Transfer Learning—0
A Comparative Study on Non-Autoregressive Modelings for Speech-to-Text Generation—0
SP-GPT2: Semantics Improvement in Vietnamese Poetry GenerationCode1
Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot LearningCode1
Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic FactorsCode1
VieSum: How Robust Are Transformer-based Models on Vietnamese Summarization?—0
On the Latent Holes of VAEs for Text Generation—0
Cut the CARP: Fishing for zero-shot story evaluation—0
Exploring Conditional Text Generation for Aspect-Based Sentiment AnalysisCode0
Simulated annealing for optimization of graphs and sequences—0
Self-conditioning pre-trained language modelsCode1
Adversarial Training: A simple and efficient technique to Improving NLP Robustness—0
On Reward Maximization and Distribution Matching for Fine-Tuning Language Models—0
OUMG: Objective and Universal Metric for Text Generation with Guiding Ability—0
GSD: Generalized Stochastic DecodingCode0
On the Latent Holes 🧀 of VAEs for Text Generation—0
Not-so fine-tuning: Measures of Common Sense for Language Models—0
Selective Token Generation for Few-shot Language Modeling—0
VUT: Versatile UI Transformer for Multimodal Multi-Task User Interface Modeling—0
Ensembles and Cocktails: Robust Finetuning for Natural Language Generation—0
Evolutionary perspective on model fine-tuning—0
Text Generation with Efficient (Soft) Q-Learning—0
SeqPATE: Differentially Private Text Generation via Knowledge Distillation—0
A Step-Wise Weighting Approach for Controllable Text Generation—0
Show:102550
← PrevPage 63 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified