SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3351–3400 of 5335 papers

TitleStatusHype
Turing: an Accurate and Interpretable Multi-Hypothesis Cross-Domain Natural Language Database Interface—0
Summary Grounded Conversation Generation—0
BERTGEN: Multi-task Generation through BERTCode1
An evaluation of template and ML-based generation of user-readable text from a knowledge graph—0
Neural semi-Markov CRF for Monolingual Word AlignmentCode1
Defending Against Backdoor Attacks in Natural Language GenerationCode1
Few-shot Knowledge Graph-to-Text Generation with Pretrained Language ModelsCode1
SimCLS: A Simple Framework for Contrastive Learning of Abstractive SummarizationCode1
Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate SpeechCode1
ZmBART: An Unsupervised Cross-lingual Transfer Framework for Language GenerationCode1
Detecting Bot-Generated Text by Characterizing Linguistic Accommodation in Human-Bot Interactions—0
How Vision Affects Language: Comparing Masked Self-Attention in Uni-Modal and Multi-Modal Transformer—0
Evaluating and Explaining Natural Language Generation with GenXCode0
On Randomized Classification Layers and Their Implications in Natural Language Generation—0
Task Definition and Integration For Scientific-Document Writing SupportCode0
An Empirical Study of Generating Texts for Search Engine Advertising—0
Coherent and Concise Radiology Report Generation via Context Specific Image Representations and Orthogonal Sentence States—0
HONEST: Measuring Hurtful Sentence Completion in Language ModelsCode1
A Tutorial on Evaluation Metrics used in Natural Language Generation—0
Text Generation from Discourse Representation Structures—0
Deep Learning on Graphs for Natural Language Processing—0
Personalized Response Generation via Generative Split Memory NetworkCode1
Using Integrated Gradients and Constituency Parse Trees to explain Linguistic Acceptability learnt by BERT—0
Implicit Representations of Meaning in Neural Language ModelsCode1
DYPLOC: Dynamic Planning of Content Using Mixed Language Models for Text Generation—0
Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation—0
A Compression-Compilation Framework for On-mobile Real-time BERT Applications—0
Annotation Inconsistency and Entity Bias in MultiWOZ—0
Grammar Accuracy Evaluation (GAE): Quantifiable Quantitative Evaluation of Machine Translation Models—0
SciFive: a text-to-text transformer model for biomedical literatureCode1
OTTers: One-turn Topic Transitions for Open-Domain DialogueCode1
Data Augmentation for Text Generation Without Any Augmented Data—0
Generative Adversarial Imitation Learning for Empathy-based AI—0
Argument Undermining: Counter-Argument Generation by Attacking Weak PremisesCode0
Personalized Transformer for Explainable RecommendationCode1
VANiLLa : Verbalized Answers in Natural Language at Large ScaleCode0
Retrieval Enhanced Model for Commonsense GenerationCode1
Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-TrainingCode1
Controlling Text Edition by Changing Answers of Specific QuestionsCode0
Killing One Bird with Two Stones: Model Extraction and Attribute Inference Attacks against BERT-based APIs—0
Automated Knee X-ray Report Generation—0
Towards a Universal NLG for Dialogue Systems and Simulators with Future Bridging—0
SmartPatch: Improving Handwritten Word Imitation with Patch DiscriminatorsCode1
Pretrained Language Models for Text Generation: A Survey—0
Retrieval-Augmented Transformer-XL for Close-Domain Dialog Generation—0
OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation MetricsCode1
Long Text Generation by Modeling Sentence-Level and Discourse-Level CoherenceCode1
One SPRING to Rule Them Both: Symmetric AMR Semantic Parsing and Generation without a Complex PipelineCode1
CoTexT: Multi-task Learning with Code-Text TransformerCode1
Stylized Story Generation with Style-Guided Planning—0
Show:102550
← PrevPage 68 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified