SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3451–3500 of 5335 papers

TitleStatusHype
SeqPATE: Differentially Private Text Generation via Knowledge Distillation—0
Adversarial Training: A simple and efficient technique to Improving NLP Robustness—0
Evolutionary perspective on model fine-tuning—0
GSD: Generalized Stochastic DecodingCode0
Selective Token Generation for Few-shot Language Modeling—0
A Step-Wise Weighting Approach for Controllable Text Generation—0
On the Latent Holes 🧀 of VAEs for Text Generation—0
Topic Aware Neural Language Model: Domain Adaptation of Unconditional Text Generation Models—0
Text Generation with Efficient (Soft) Q-Learning—0
VUT: Versatile UI Transformer for Multimodal Multi-Task User Interface Modeling—0
Towards Reinforcement Learning for Pivot-based Neural Machine Translation with Non-autoregressive Transformer—0
Style Control for Schema-Guided Natural Language Generation—0
Towards Brain-to-Text Generation: Neural Decoding with Pre-trained Encoder-Decoder Models—0
Dependency Structure for News Document Summarization—0
Scalable and Efficient MoE Training for Multitask Multilingual Models—0
Enriching and Controlling Global Semantics for Text Summarization—0
Learning Natural Language Generation from Scratch—0
PluGeN: Multi-Label Conditional Generation From Pre-Trained ModelsCode0
Relating Neural Text Degeneration to Exposure Bias—0
BART-light: One Decoder Layer Is Enough—0
AMR-to-text Generation with Graph Structure Reconstruction and Coverage—0
Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction—0
CDM: Combining Extraction and Generation for Definition Modeling—0
Attention Is Indeed All You Need: Semantically Attention-Guided Decoding for Data-to-Text NLGCode0
KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning—0
Controllable Dialogue Generation with Disentangled Multi-grained Style Specification and Attribute Consistency Reward—0
The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation—0
End-to-end argumentation knowledge graph construction—0
UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation—0
Perturbation CheckLists for Evaluating NLG Evaluation MetricsCode0
Implicit Premise Generation with Discourse-aware Commonsense Knowledge ModelsCode0
Generating Self-Contained and Summary-Centric Question Answer Pairs via Differentiable Reward Imitation LearningCode0
Controlled Neural Sentence-Level Reframing of News Articles—0
CINS: Comprehensive Instruction for Few-shot Learning in Task-oriented Dialog Systems—0
Graphine: A Dataset for Graph-aware Terminology Definition GenerationCode0
Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Models—0
Smelting Gold and Silver for Improved Multilingual AMR-to-Text GenerationCode0
Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings—0
Naturalness Evaluation of Natural Language Generation in Task-oriented Dialogues using BERT—0
Towards Retrieval-based Conversational RecommendationCode0
Multimodal Conditionality for Natural Language Generation—0
ConQX: Semantic Expansion of Spoken Queries for Intent Detection based on Conditioned Text Generation—0
Models and Tasks for Human-Centered Machine Translation—0
Behavior of Modern Pre-trained Language Models Using the Example of Probing Tasks—0
Humor Generation and Detection in Code-Mixed Hindi-English—0
Improving Abstractive Summarization with Commonsense Knowledge—0
OptAGAN: Entropy-based finetuning on text VAE-GANCode0
On Reducing Repetition in Abstractive Summarization—0
Structured Prediction in NLP -- A survey—0
On the Multilingual Capabilities of Very Large-Scale English Language ModelsCode0
Show:102550
← PrevPage 70 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified