SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2901–2950 of 5335 papers

TitleStatusHype
Survey of Hallucination in Natural Language Generation—0
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning FrameworkCode0
A Benchmark Corpus for the Detection of Automatically Generated Text in Academic PublicationsCode0
A Survey on Retrieval-Augmented Text Generation—0
Regression Transformer: Concurrent sequence regression and generation for molecular language modelingCode1
Locally Typical SamplingCode4
XAlign: Cross-lingual Fact-to-Text Alignment and Generation for Low-Resource LanguagesCode1
A Frustratingly Simple Approach for End-to-End Image Captioning—0
Generative Cooperative Networks for Natural Language Generation—0
DiscoScore: Evaluating Text Generation with BERT and Discourse CoherenceCode1
Language Generation for Broad-Coverage, Explainable Cognitive Systems—0
Relational Memory Augmented Language Models—0
Improving Chest X-Ray Report Generation by Leveraging Warm StartingCode1
Gradient-guided Unsupervised Text Style Transfer via Contrastive Learning—0
An Application of Pseudo-Log-Likelihoods to Natural Language Scoring—0
A Causal Lens for Controllable Text Generation—0
Context-Tuning: Learning Contextualized Prompts for Natural Language GenerationCode1
Classroom Slide Narration System—0
CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model CapabilitiesCode0
Controllable Protein Design with Language Models—0
Youling: an AI-Assisted Lyrics Creation System—0
What Makes the Story Forward? Inferring Commonsense Explanations as Prompts for Future Event Generation—0
An Understanding of Learning from Demonstrations for Neural Text Generation—0
Deep dive into CoCon - A Self Supervised approach for Controlled Text Generation—0
Discovering Non-Monotonic Autoregressive Ordering for Text Generation Models using Sinkhorn Distributions—0
PPLM Revisited: Steering and Beaming a Lumbering Mammoth to Control Text Generation—0
Classification or Generation? Understanding Paradigm Shift for Knowledge-Intensive Tasks—0
Sequentially Controlled Text Generation—0
A Study of Pre-trained Language Models for Analogy Generation—0
On the Anatomy of Latent-variable Generative Models for Conditional Text Generation—0
Provably Confidential Language Modelling—0
Mix and Match: Learning-free Controllable Text Generation using Energy Language Models—0
Don't Take It Literally: An Edit-Invariant Sequence Loss for Text Generation—0
Don’t Forget About Pronouns: Removing Gender Bias in Language Models without Losing Factual Gender Information—0
TD-ConE: An Information-Theoretic Approach to Assessing Parallel Text Generation Data—0
Auto-regressive Text Generation with Pre-Trained Language Models: An Empirical Study on Question-type Short Text Generation—0
Pathway2Text: Dataset and Method for Biomedical Pathway Description Generation—0
Defending against Backdoor Attacks in Natural Language Generation—0
Controlling the Focus of Pretrained Language Generation Models—0
Sonnet Generation by Training on Non-poetic Texts with Discourse-level Coherence and Poetic Features—0
Massive-scale Decoding for Text Generation using Lattices—0
Continual Learning for Seq2Seq Generations with Transformer Calibration—0
Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand—0
Falsesum: Generating Document-level NLI Examples for Recognizing Factual Inconsistency in Summarization—0
Discourse-Aware Prompt Design for Text Generation—0
TRUE: Re-evaluating Factual Consistency Evaluation—0
Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learning—0
WANLI: Worker and AI Collaboration for Natural Language Inference Dataset CreationCode1
Pretrained Language Models for Text Generation: A Survey—0
A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models—0
Show:102550
← PrevPage 59 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified