SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2451–2500 of 5335 papers

TitleStatusHype
Towards Attribute-Entangled Controllable Text Generation: A Pilot Study of Blessing GenerationCode0
Diverse Parallel Data Synthesis for Cross-Database Adaptation of Text-to-SQL Parsers—0
Contrastive Decoding: Open-ended Text Generation as OptimizationCode2
SentBS: Sentence-level Beam Search for Controllable SummarizationCode0
Categorical SDEs with Simplex Diffusion—0
MOCHA: A Multi-Task Training Approach for Coherent Text Generation from Cognitive PerspectiveCode0
N-gram Is Back: Residual Learning of Neural Text Generation with n-gram Language ModelCode1
Cloning Ideology and Style using Deep Learning—0
Synthetic Text Generation with Differential Privacy: A Simple and Practical RecipeCode1
IFDID: Information Filter upon Diversity-Improved Decoding for Diversity-Faithfulness Tradeoff in NLG—0
Contrastive Search Is What You Need For Neural Text GenerationCode2
Finding Memo: Extractive Memorization in Constrained Sequence Generation TasksCode0
Are Current Decoding Strategies Capable of Facing the Challenges of Visual Dialogue?—0
ELMER: A Non-Autoregressive Pre-trained Language Model for Efficient and Effective Text GenerationCode1
On the Effectiveness of Automated Metrics for Text Generation Systems—0
RuCoLA: Russian Corpus of Linguistic AcceptabilityCode1
Towards Pragmatic Production Strategies for Natural Language Generation Tasks—0
Mapping Process for the Task: Wikidata Statements to Text as Wikipedia Sentences—0
Adaptive Label Smoothing with Self-Knowledge in Natural Language Generation—0
ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning ExamplesCode1
Recurrence Boosts Diversity! Revisiting Recurrent Latent Variable in Transformer-Based Variational AutoEncoder for Diverse Text Generation—0
Hard Gate Knowledge Distillation -- Leverage Calibration for Robust and Reliable Language Model—0
Precisely the Point: Adversarial Augmentations for Faithful and Informative Text Generation—0
Optimizing Bilingual Neural Transducer with Synthetic Code-switching Text Generation—0
Bootstrapping NLP tools across low-resourced African languages: an overview and prospects—0
Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text GenerationCode1
Boosting Natural Language Generation from Instructions with Meta-Learning—0
The University of Edinburgh's Submission to the WMT22 Code-Mixing Shared Task (MixMT)—0
Image Semantic Relation Generation—0
Language Detoxification with Attribute-Discriminative Latent SpaceCode0
Entity-to-Text based Data Augmentation for various Named Entity Recognition Tasks—0
NGEP: A Graph-based Event Planning Framework for Story GenerationCode0
BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and MiningCode4
Self-supervised Graph Masking Pre-training for Graph-to-Text GenerationCode1
Attribution and Obfuscation of Neural Text Authorship: A Data Mining Perspective—0
A Data-Driven Investigation of Noise-Adaptive Utterance Generation with Linguistic Modification—0
DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text GenerationCode1
Team Flow at DRC2022: Pipeline System for Travel Destination Recommendation Task in Spoken Dialogue—0
SafeText: A Benchmark for Exploring Physical Safety in Language Models—0
Table-To-Text generation and pre-training with TabT5—0
Social Biases in Automatic Evaluation Metrics for NLG—0
Teacher Forcing Recovers Reward Functions for Text GenerationCode1
DiffuSeq: Sequence to Sequence Text Generation with Diffusion ModelsCode2
RARR: Researching and Revising What Language Models Say, Using Language ModelsCode1
Model Criticism for Long-Form Text GenerationCode1
Investigating the Robustness of Natural Language Generation from Logical Forms via Counterfactual SamplesCode0
COFFEE: Counterfactual Fairness for Personalized Text Generation in Explainable Recommendation—0
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey—0
PCFG-based Natural Language Interface Improves Generalization for Controlled Text GenerationCode0
DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank AdaptationCode4
Show:102550
← PrevPage 50 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4—Unverified
2Beam search + A*esque (beam)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified