SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 22012250 of 5335 papers

TitleStatusHype
Back-Translation as Strategy to Tackle the Lack of Corpus in Natural Language Generation from Semantic Representations0
Humor Generation and Detection in Code-Mixed Hindi-English0
Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decoder0
Décodage guidé par un discriminateur avec le Monte Carlo Tree Search pour la génération de texte contrainte (Discriminator-guided decoding with Monte Carlo Tree Search for constrained text generation )0
Backtracking Improves Generation Safety0
HumT DumT: Measuring and controlling human-like language in LLMs0
DECIDER: A Dual-System Rule-Controllable Decoding Framework for Language Generation0
Debias your Large Multi-Modal Model at Test-Time with Non-Contrastive Visual Attribute Steering0
A Natural Language Instructor for pedestrian navigation based in generation by selection0
Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers0
Hybrid Semantics for Goal-Directed Natural Language Generation0
Debiasing Large Vision-Language Models by Ablating Protected Attribute Representations0
Debiasing Guidance for Discrete Diffusion with Sequential Monte Carlo0
De-Biased Court's View Generation with Causality0
Backbone Augmented Training for Adaptations0
A Natural Bias for Language Generation Models0
Advanced RAG Models with Graph Structures: Optimizing Complex Knowledge Reasoning and Text Generation0
De-Anonymizing Text by Fingerprinting Language Generation0
DATScore: Evaluating Translation with Data Augmented Translations0
AXCEL: Automated eXplainable Consistency Evaluation using LLMs0
A working, non-trivial, topically indifferent NLG System for 17 languages0
Anatomy-Guided Radiology Report Generation with Pathology-Aware Regional Prompts0
Human Perception in Natural Language Generation0
Avoiding Overlap in Data Augmentation for AMR-to-Text Generation0
Human-like Natural Language Generation Using Monte Carlo Tree Search0
Human Evaluation of Creative NLG Systems: An Interdisciplinary Survey on Recent Papers0
An Assessment of ChatGPT on Log Data0
Humanizing the Machine: Proxy Attacks to Mislead LLM Detectors0
DataTales: Investigating the use of Large Language Models for Authoring Data-Driven Articles0
AUTOSUMM: Automatic Model Creation for Text Summarization0
Improving Neural Machine Translation with Pre-trained Representation0
Human or Machine: Automating Human Likeliness Evaluation of NLG Texts0
HyPA-RAG: A Hybrid Parameter Adaptive Retrieval-Augmented Generation System for AI Legal and Policy Applications0
IGOT: Information Gain Optimized Tokenizer on Domain Adaptive Pretraining0
Improve Diverse Text Generation by Self Labeling Conditional Variational Auto Encoder0
Including Facial Expressions in Contextual Embeddings for Sign Language Generation0
Data-Driven News Generation for Automated Journalism0
Auto-regressive Text Generation with Pre-Trained Language Models: An Empirical Study on Question-type Short Text Generation0
Data-driven Natural Language Generation: Paving the Road to Success0
An Application of Pseudo-Log-Likelihoods to Natural Language Scoring0
How to Tell a Schneemann from a Milchmann: An Annotation Scheme for Compound-Internal Relations0
Data-Driven Broad-Coverage Grammars for Opinionated Natural Language Generation (ONLG)0
How to Make Neural Natural Language Generation as Reliable as Templates in Task-Oriented Dialogue0
Data-dependent Gaussian Prior Objective for Language Generation0
Data Augmentation Techniques for Machine Translation of Code-Switched Texts: A Comparative Study0
An Annotated Corpus of Film Dialogue for Learning and Characterizing Character Style0
How Useful are Educational Questions Generated by Large Language Models?0
Data Augmentation in Natural Language Processing: A Novel Text Generation Approach for Long and Short Text Classifiers0
Data Augmentation for Visual Question Answering0
Data Augmentation for Text Generation Without Any Augmented Data0
Show:102550
← PrevPage 45 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified