SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2751–2800 of 5335 papers

TitleStatusHype
Mitigating Toxic Degeneration with Empathetic Data: Exploring the Relationship Between Toxicity and Empathy—0
Classifiers are Better Experts for Controllable Text Generation—0
Near-Negative Distinction: Giving a Second Life to Human Evaluation DatasetsCode0
Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications—0
ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language GenerationCode1
Arithmetic-Based Pretraining -- Improving Numeracy of Pretrained Language ModelsCode0
Exploiting Inductive Bias in Transformers for Unsupervised Disentanglement of Syntax and Semantics with VAEsCode1
Efficient and Training-Free Control of Language Generation—0
AdaVAE: Exploring Adaptive GPT-2s in Variational Auto-Encoders for Language ModelingCode1
Falsesum: Generating Document-level NLI Examples for Recognizing Factual Inconsistency in SummarizationCode0
Symphony Generation with Permutation Invariant Language ModelCode2
Extracting Latent Steering Vectors from Pretrained Language ModelsCode1
UL2: Unifying Language Learning ParadigmsCode1
RoViST:Learning Robust Metrics for Visual StorytellingCode0
Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance LearningCode1
DxFormer: A Decoupled Automatic Diagnostic System Based on Decoder-Encoder Transformer with Dense Symptom RepresentationsCode1
Attract me to Buy: Advertisement Copywriting Generation with Multimodal Multi-structured Information—0
Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attentionCode1
Robust Conversational Agents against Imperceptible Toxicity TriggersCode0
Language Models Can See: Plugging Visual Controls in Text GenerationCode2
Towards Robust and Semantically Organised Latent Representations for Unsupervised Text Style TransferCode0
Provably Confidential Language ModellingCode0
Zero-shot Sonnet Generation with Discourse-level Planning and Aesthetics FeaturesCode0
Adversarial Training for High-Stakes Reliability—0
Learning to Transfer Prompts for Text GenerationCode1
Data-driven emotional body language generation for social roboticsCode0
QiuNiu: A Chinese Lyrics Generation System with Passage-Level Input—0
Rewarding Semantic Similarity under Optimized Alignments for AMR-to-Text Generation—0
Knowledge-Augmented Methods for Natural Language Processing—0
Learning to Rank Visual Stories From Human Ranking DataCode0
Hybrid Semantics for Goal-Directed Natural Language Generation—0
High probability or low information? The probability–quality paradox in language generation—0
GLAT: Glancing at Latent Variables for Parallel Text GenerationCode1
How Do Seq2Seq Models Perform on End-to-End Data-to-Text Generation?Code0
Fine-Grained Controllable Text Generation Using Non-Residual PromptingCode1
On Target Representation in Continuous-output Neural Machine Translation—0
What Makes Good In-Context Examples for GPT-3?—0
uFACT: Unfaithful Alien-Corpora Training for Semantically Consistent Data-to-Text Generation—0
Debiasing Pre-Trained Language Models via Efficient Fine-TuningCode0
Controlled Text Generation Using Dictionary Prior in Variational Autoencoders—0
Hierarchical Recurrent Aggregative Generation for Few-Shot NLG—0
BERT 4EVER@LT-EDI-ACL2022-Detecting signs of Depression from Social Media:Detecting Depression in Social Media using Prompt-Learning and Word-Emotion Cluster—0
On Controlling Fallback Responses for Grounded Dialogue Generation—0
CaM-Gen: Causally Aware Metric-Guided Text Generation—0
Improving Specificity in Review Response Generation with Data-Driven Data FilteringCode0
Learning Reasoning Patterns for Relational Triple Extraction with Mutual Generation of Text and Graph—0
Plug-and-Play Controller for Story Completion: A Pilot Study toward Emotion-aware Story Writing Assistance—0
Can Pretrained Language Models Generate Persuasive, Faithful, and Informative Ad Text for Product Descriptions?—0
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation—0
The Pure Poet: How Good is the Subjective Credibility and Stylistic Quality of Literary Short Texts Written with an Artificial Intelligence Tool as Compared to Texts Written by Human Authors?—0
Show:102550
← PrevPage 56 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified