SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3251–3300 of 5335 papers

TitleStatusHype
A Benchmark Corpus for the Detection of Automatically Generated Text in Academic PublicationsCode0
A Survey on Retrieval-Augmented Text Generation—0
A Frustratingly Simple Approach for End-to-End Image Captioning—0
Generative Cooperative Networks for Natural Language Generation—0
Language Generation for Broad-Coverage, Explainable Cognitive Systems—0
Relational Memory Augmented Language Models—0
Gradient-guided Unsupervised Text Style Transfer via Contrastive Learning—0
An Application of Pseudo-Log-Likelihoods to Natural Language Scoring—0
A Causal Lens for Controllable Text Generation—0
Classroom Slide Narration System—0
What Makes the Story Forward? Inferring Commonsense Explanations as Prompts for Future Event Generation—0
Controllable Protein Design with Language Models—0
Youling: an AI-Assisted Lyrics Creation System—0
CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model CapabilitiesCode0
An Understanding of Learning from Demonstrations for Neural Text Generation—0
Deep dive into CoCon - A Self Supervised approach for Controlled Text Generation—0
PPLM Revisited: Steering and Beaming a Lumbering Mammoth to Control Text Generation—0
Discovering Non-Monotonic Autoregressive Ordering for Text Generation Models using Sinkhorn Distributions—0
Classification or Generation? Understanding Paradigm Shift for Knowledge-Intensive Tasks—0
Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learning—0
Continual Learning for Seq2Seq Generations with Transformer Calibration—0
Discourse-Aware Prompt Design for Text Generation—0
Defending against Backdoor Attacks in Natural Language Generation—0
Massive-scale Decoding for Text Generation using Lattices—0
Sonnet Generation by Training on Non-poetic Texts with Discourse-level Coherence and Poetic Features—0
On the Anatomy of Latent-variable Generative Models for Conditional Text Generation—0
Controlling the Focus of Pretrained Language Generation Models—0
Provably Confidential Language Modelling—0
Mix and Match: Learning-free Controllable Text Generation using Energy Language Models—0
Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand—0
Pathway2Text: Dataset and Method for Biomedical Pathway Description Generation—0
Don’t Forget About Pronouns: Removing Gender Bias in Language Models without Losing Factual Gender Information—0
Don't Take It Literally: An Edit-Invariant Sequence Loss for Text Generation—0
Sequentially Controlled Text Generation—0
TD-ConE: An Information-Theoretic Approach to Assessing Parallel Text Generation Data—0
A Study of Pre-trained Language Models for Analogy Generation—0
Falsesum: Generating Document-level NLI Examples for Recognizing Factual Inconsistency in Summarization—0
Auto-regressive Text Generation with Pre-Trained Language Models: An Empirical Study on Question-type Short Text Generation—0
TRUE: Re-evaluating Factual Consistency Evaluation—0
A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models—0
Pretrained Language Models for Text Generation: A Survey—0
Visual Storytelling with Hierarchical BERT Semantic Guidance—0
Latency Adjustable Transformer Encoder for Language Understanding—0
Imagined versus Remembered Stories: Quantifying Differences in Narrative Flow—0
Automatic Related Work Generation: A Meta Study—0
RabindraNet, Creating Literary Works in the Style of Rabindranath Tagore—0
What is Event Knowledge Graph: A Survey—0
Radiology Report Generation with a Learned Knowledge Base and Multi-modal Alignment—0
A Survey of Natural Language Generation—0
May the Force Be with Your Copy Mechanism: Enhanced Supervised-Copy Method for Natural Language Generation—0
Show:102550
← PrevPage 66 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified