SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3951–4000 of 5335 papers

TitleStatusHype
Query-Variant Advertisement Text Generation with Association KnowledgeCode0
Reverse Engineering Configurations of Neural Text Generation Models—0
Explaining Question Answering Models through Text GenerationCode1
BLEURT: Learning Robust Metrics for Text GenerationCode1
SentiInc: Incorporating Sentiment Information into Sentiment Transfer Without Parallel Data—0
Have Your Text and Use It Too! End-to-End Neural Data-to-Text Generation with Semantic FidelityCode1
Generating Counter Narratives against Online Hate Speech: Data and Strategies—0
Generating Narrative Text in a Switching Dynamical SystemCode0
Exploring Versatile Generative Language Model Via Parameter-Efficient Transfer LearningCode1
TextGAIL: Generative Adversarial Imitation Learning for Text Generation—0
Inferential Text Generation with Multiple Knowledge Sources and Meta-Learning—0
Character-level Japanese Text Generation with Attention Mechanism for Chest Radiography Diagnosis—0
Evaluating the Evaluation of Diversity in Natural Language GenerationCode1
Sparse Text GenerationCode1
Optimus: Organizing Sentences via Pre-trained Modeling of a Latent SpaceCode1
Machine Translation Pre-training for Data-to-Text Generation -- A Case Study in Czech—0
Semantics of the Unwritten: The Effect of End of Paragraph and Sequence Tokens on Text Generation with GPT2Code0
Adding A Filter Based on The Discriminator to Improve Unconditional Text GenerationCode0
Syntax-driven Iterative Expansion Language Models for Controllable Text Generation—0
CG-BERT: Conditional Text Generation with BERT for Generalized Few-shot Intent Detection—0
Abstractive Summarization with Combination of Pre-trained Sequence-to-Sequence and Saliency Models—0
TLDR: Token Loss Dynamic Reweighting for Reducing Repetitive Utterance GenerationCode1
Heavy-tailed Representations, Text Polarity Classification & Data Augmentation—0
ScrabbleGAN: Semi-Supervised Varying Length Handwritten Text GenerationCode1
Unsupervised Pidgin Text Generation By Pivoting English Data and Self-Training—0
Generating Major Types of Chinese Classical Poetry in a Uniformed Framework—0
Meta-CoTGAN: A Meta Cooperative Training Paradigm for Improving Adversarial Text Generation—0
Generating Natural Language Adversarial Examples on a Large Scale with Generative Models—0
An Empirical Investigation of Pre-Trained Transformer Language Models for Open-Domain Dialogue GenerationCode1
EmpTransfo: A Multi-head Transformer Architecture for Creating Empathetic Dialog SystemsCode1
RecipeGPT: Generative Pre-training Based Cooking Recipe Generation and Evaluation SystemCode1
CLUECorpus2020: A Large-scale Chinese Corpus for Pre-training Language ModelCode2
Style Example-Guided Text Generation using Generative Adversarial Transformers—0
Towards information-rich, logical text generation with knowledge-enhanced neural models—0
Generating Followup Questions for Interpretable Multi-hop Question Answering—0
Few-shot Natural Language Generation for Task-Oriented DialogCode1
What BERT Sees: Cross-Modal Transfer for Visual Question Generation—0
GRET: Global Representation Enhanced Transformer—0
Modelling Latent Skills for Multitask Language Generation—0
Gaussian Smoothen Semantic Features (GSSF) -- Exploring the Linguistic Aspects of Visual Captioning in Indian Languages (Bengali) Using MSCOCO Framework—0
CBAG: Conditional Biomedical Abstract Generation—0
Learning to Compare for Better Training and Evaluation of Open Domain Natural Language Generation Models—0
Limits of Detecting Text Generated by Large-Scale Language Models—0
Multimodal Matching Transformer for Live Commenting—0
Variational Template Machine for Data-to-Text GenerationCode1
CoTK: An Open-Source Toolkit for Fast Development and Fair Evaluation of Text GenerationCode1
Explaining Relationships Between Scientific DocumentsCode1
Bridging Text and Video: A Universal Multimodal Transformer for Video-Audio Scene-Aware DialogCode1
Self-Adversarial Learning with Comparative Discrimination for Text Generation—0
Modeling Global and Local Node Contexts for Text Generation from Knowledge GraphsCode1
Show:102550
← PrevPage 80 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified