SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3451–3500 of 5335 papers

TitleStatusHype
Modelling Context Emotions using Multi-task Learning for Emotion Controlled Dialog Generation—0
Making Use of Latent Space in Language GANs for Generating Diverse Text without Pre-training—0
Analyzing the Forgetting Problem in Pretrain-Finetuning of Open-domain Dialogue Response Models—0
Structural Encoding and Pre-training Matter: Adapting BERT for Table-Based Fact Verification—0
"TL;DR:" Out-of-Context Adversarial Text Summarization and Hashtag Recommendation—0
FeTaQA: Free-form Table Question AnsweringCode1
WakaVT: A Sequential Variational Transformer for Waka Generation—0
AfriKI: Machine-in-the-Loop Afrikaans Poetry Generation—0
Evaluating the Morphosyntactic Well-formedness of Generated TextsCode0
Changing the Mind of Transformers for Topically-Controllable Language GenerationCode1
On Hallucination and Predictive Uncertainty in Conditional Language Generation—0
Data Augmentation in Natural Language Processing: A Novel Text Generation Approach for Long and Short Text Classifiers—0
Finetuning Pretrained Transformers into RNNsCode1
The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures—0
Plug-and-Blend: A Framework for Controllable Story Generation with Blended Control CodesCode1
SparseGAN: Sparse Generative Adversarial Network for Text Generation—0
Non-Autoregressive Translation by Learning Target Categorical CodesCode1
Attribute Alignment: Controlling Text Generation from Pre-trained Language ModelsCode0
Controllable Generation from Pre-trained Language Models via Inverse PromptingCode1
Model Extraction and Adversarial Transferability, Your BERT is Vulnerable!Code1
ENCONTER: Entity Constrained Progressive Sequence Generation via Insertion-based TransformerCode0
Structural Adapters in Pretrained Language Models for AMR-to-text GenerationCode1
Knowledge driven Description Synthesis for Floor Plan Interpretation—0
Get Your Vitamin C! Robust Fact Verification with Contrastive EvidenceCode1
A Study of Automatic Metrics for the Evaluation of Natural Language ExplanationsCode0
Membership Inference Attacks on Machine Learning: A SurveyCode1
Simpson's Bias in NLP Training—0
Improving Diversity of Neural Text Generation via Inverse Probability Weighting—0
Constrained Text Generation with Global Guidance -- Case Study on CommonGen—0
Topical Language Generation using TransformersCode1
ENTRUST: Argument Reframing with Language Models and Entailment—0
Unified Pre-training for Program Understanding and GenerationCode1
Hurdles to Progress in Long-form Question AnsweringCode1
Causal-aware Safe Policy Improvement for Task-oriented dialogueCode1
InFillmore: Frame-Guided Language Generation with Bidirectional Context—0
Empathetic BERT2BERT Conversational Model: Learning Arabic Language Generation with Little DataCode1
Measuring Mathematical Problem Solving With the MATH DatasetCode2
Towards Conversational Humor Analysis and Design—0
Topic Modelling Meets Deep Neural Networks: A Survey—0
Learning Transferable Visual Models From Natural Language SupervisionCode2
Enhanced Modality Transition for Image Captioning—0
Controllable and Diverse Text Generation in E-commerce—0
Exploring Supervised and Unsupervised Rewards in Machine TranslationCode1
Towards Automatic Evaluation of Dialog Systems: A Model-Free Off-Policy Evaluation Approach—0
Progressive Transformer-Based Generation of Radiology ReportsCode1
Towards Faithfulness in Open Domain Table-to-text Generation from an Entity-centric View—0
Searching for Search Errors in Neural Morphological Inflection—0
Non-Autoregressive Text Generation with Pre-trained Language ModelsCode1
Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNetCode0
Generating Diversified Comments via Reader-Aware Topic Modeling and Saliency Detection—0
Show:102550
← PrevPage 70 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified