SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3151–3200 of 5335 papers

TitleStatusHype
Topic Aware Neural Language Model: Domain Adaptation of Unconditional Text Generation Models—0
TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text GenerationCode1
Towards Reinforcement Learning for Pivot-based Neural Machine Translation with Non-autoregressive Transformer—0
Parallel Refinements for Lexically Constrained Text Generation with BARTCode1
Weakly Supervised Contrastive Learning for Chest X-Ray Report GenerationCode1
Towards Brain-to-Text Generation: Neural Decoding with Pre-trained Encoder-Decoder Models—0
Style Control for Schema-Guided Natural Language Generation—0
Dependency Structure for News Document Summarization—0
Enriching and Controlling Global Semantics for Text Summarization—0
Scalable and Efficient MoE Training for Multitask Multilingual Models—0
TrOCR: Transformer-based Optical Character Recognition with Pre-trained ModelsCode1
A Plug-and-Play Method for Controlled Text GenerationCode1
Learning Natural Language Generation from Scratch—0
PluGeN: Multi-Label Conditional Generation From Pre-Trained ModelsCode0
Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction—0
CDM: Combining Extraction and Generation for Definition Modeling—0
BART-light: One Decoder Layer Is Enough—0
AMR-to-text Generation with Graph Structure Reconstruction and Coverage—0
Relating Neural Text Degeneration to Exposure Bias—0
Attention Is Indeed All You Need: Semantically Attention-Guided Decoding for Data-to-Text NLGCode0
Commonsense-Focused Dialogues for Response Generation: An Empirical StudyCode1
The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation—0
A Temporal Variational Model for Story GenerationCode1
Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language GenerationCode1
PETGEN: Personalized Text Generation Attack on Deep Sequence Embedding-based Classification ModelsCode1
Controllable Dialogue Generation with Disentangled Multi-grained Style Specification and Attribute Consistency Reward—0
KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning—0
End-to-end argumentation knowledge graph construction—0
UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation—0
Perturbation CheckLists for Evaluating NLG Evaluation MetricsCode0
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and GenerationCode1
Implicit Premise Generation with Discourse-aware Commonsense Knowledge ModelsCode0
COSMic: A Coherence-Aware Generation Metric for Image DescriptionsCode1
Generating Self-Contained and Summary-Centric Question Answer Pairs via Differentiable Reward Imitation LearningCode0
Controlled Neural Sentence-Level Reframing of News Articles—0
Topic-Aware Contrastive Learning for Abstractive Dialogue SummarizationCode1
CINS: Comprehensive Instruction for Few-shot Learning in Task-oriented Dialog Systems—0
Graphine: A Dataset for Graph-aware Terminology Definition GenerationCode0
Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Models—0
Sequence Level Contrastive Learning for Text SummarizationCode1
Smelting Gold and Silver for Improved Multilingual AMR-to-Text GenerationCode0
IndicBART: A Pre-trained Model for Indic Natural Language GenerationCode1
Naturalness Evaluation of Natural Language Generation in Task-oriented Dialogues using BERT—0
Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings—0
Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive SummarizationCode1
Towards Retrieval-based Conversational RecommendationCode0
Transformer Models for Text Coherence AssessmentCode1
Biomedical Data-to-Text Generation via Fine-Tuning TransformersCode1
Multimodal Conditionality for Natural Language Generation—0
ConQX: Semantic Expansion of Spoken Queries for Intent Detection based on Conditioned Text Generation—0
Show:102550
← PrevPage 64 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified