SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3201–3250 of 5335 papers

TitleStatusHype
Efficient Reinforcement Learning for Unsupervised Controlled Text Generation—0
Bridging Cross-Lingual Gaps During Leveraging the Multilingual Sequence-to-Sequence Pretraining for Text Generation and UnderstandingCode0
Text Revision by On-the-Fly Representation OptimizationCode0
On the Role of Pre-trained Language Models in Word Ordering: A Case Study with BARTCode0
Rows from Many Sources: Enriching row completions from Wikidata with a pre-trained Language Model—0
Regularization-based Pruning of Irrelevant Weights in Deep Neural ArchitecturesCode0
Uniform Complexity for Text GenerationCode0
Toward More Effective Human Evaluation for Machine Translation—0
PSP: Pre-trained Soft Prompts for Few-Shot Abstractive Summarization—0
Enhance Incomplete Utterance Restoration by Joint Learning Token Extraction and Text GenerationCode0
Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language GenerationCode0
Entity-Centric Query Refinement—0
On the probability-quality paradox in language generation—0
Reproducibility Issues for BERT-based Evaluation MetricsCode0
On Decoding Strategies for Neural Text Generators—0
Generative Design Ideation: A Natural Language Generation Approach—0
A Roadmap for Big Model—0
Reshaping Robot Trajectories Using Natural Language Commands: A Study of Multi-Modal Data Alignment Using Transformers—0
Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal—0
Linearizing Transformer with Key-Value Memory—0
An Empirical Study on Learning and Improving the Search Objective for Unsupervised Paraphrasing—0
Immersive Text Game and Personality Classification—0
Are You Robert or RoBERTa? Deceiving Online Authorship Attribution Models Using Neural Text Generators—0
GRS: Combining Generation and Revision in Unsupervised Sentence SimplificationCode0
DU-VLG: Unifying Vision-and-Language Generation via Dual Sequence-to-Sequence Pre-training—0
PLANET: Dynamic Content Planning in Autoregressive Transformers for Long-form Text Generation—0
TegTok: Augmenting Text Generation via Task-specific and Open-world KnowledgeCode0
Learning to Infer Belief Embedded Communication—0
Pruned Graph Neural Network for Short Story Ordering—0
Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods—0
IndicNLG Benchmark: Multilingual Datasets for Diverse NLG Tasks in Indic Languages—0
Compilable Neural Code Generation with Compiler Feedback—0
Input-Tuning: Adapting Unfamiliar Inputs to Frozen Pretrained Models—0
Recent Advances in Neural Text Generation: A Task-Agnostic Survey—0
The Proof is in the Pudding: Using Automated Theorem Proving to Generate Cooking RecipesCode0
Deep Latent-Variable Models for Text Generation—0
Controlling the Focus of Pretrained Language Generation ModelsCode0
Attend, Memorize and Generate: Towards Faithful Table-to-Text Generation in Few ShotsCode0
Rethinking and Refining the Distinct MetricCode0
Variational Autoencoder with Disentanglement Priors for Low-Resource Task-Specific Natural Language GenerationCode0
Controllable Natural Language Generation with Contrastive Prefixes—0
Reward Modeling for Mitigating Toxicity in Transformer-based Language Models—0
CLSEG: Contrastive Learning of Story Ending GenerationCode0
XFBoost: Improving Text Generation with Controllable Decoders—0
C IS^2: A Simplified Commonsense Inference Evaluation for Story ProseCode0
Integrating AI Planning with Natural Language Processing: A Combination of Explicit and Tacit Knowledge—0
Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text—0
Including Facial Expressions in Contextual Embeddings for Sign Language Generation—0
Survey of Hallucination in Natural Language Generation—0
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning FrameworkCode0
Show:102550
← PrevPage 65 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified