SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 4801–4850 of 5335 papers

TitleStatusHype
Hit the Sweet Spot! Span-Level Ensemble for Large Language Models—0
HOIGPT: Learning Long-Sequence Hand-Object Interaction with Language Models—0
Homeostasis and Sparsity in Transformer—0
Hotel Scribe: Generating High Variation Hotel Descriptions—0
Hot PATE: Private Aggregation of Distributions for Diverse Task—0
How can we adapt generation to the user's cognitive load?—0
How Chaotic Are Recurrent Neural Networks?—0
How Does Beam Search improve Span-Level Confidence Estimation in Generative Sequence Labeling?—0
How Does In-Context Learning Help Prompt Tuning?—0
How do Pre-Trained Models Support Software Engineering? An Empirical Study in Hugging Face—0
How Do Seq2Seq Models Perform on End-to-End Data-to-Text Generation?—0
How Effective are Generative Large Language Models in Performing Requirements Classification?—0
HowkGPT: Investigating the Detection of ChatGPT-generated University Student Homework through Context-Aware Perplexity Analysis—0
How Much Annotation is Needed to Compare Summarization Models?—0
How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN—0
How Privacy-Savvy Are Large Language Models? A Case Study on Compliance and Privacy Technical Review—0
How the Voynich Manuscript was created—0
How to Avoid Sentences Spelling Boring? Towards a Neural Approach to Unsupervised Metaphor Generation—0
How to Choose Pretrained Handwriting Recognition Models for Single Writer Fine-Tuning—0
How to Describe Images in a More Funny Way? Towards a Modular Approach to Cross-Modal Sarcasm Generation—0
How to Make Neural Natural Language Generation as Reliable as Templates in Task-Oriented Dialogue—0
How to Tell a Schneemann from a Milchmann: An Annotation Scheme for Compound-Internal Relations—0
How Useful are Educational Questions Generated by Large Language Models?—0
How Vision Affects Language: Comparing Masked Self-Attention in Uni-Modal and Multi-Modal Transformer—0
How well can machine-generated texts be identified and can language models be trained to avoid identification?—0
How Well Do You Know Your Audience? Toward Socially-aware Question Generation—0
Human Bias in the Face of AI: The Role of Human Judgement in AI Generated Text Evaluation—0
Human Evaluation of Creative NLG Systems: An Interdisciplinary Survey on Recent Papers—0
Humanizing the Machine: Proxy Attacks to Mislead LLM Detectors—0
Human-like Natural Language Generation Using Monte Carlo Tree Search—0
Human or Machine: Automating Human Likeliness Evaluation of NLG Texts—0
Human Perception in Natural Language Generation—0
Humor Generation and Detection in Code-Mixed Hindi-English—0
HumT DumT: Measuring and controlling human-like language in LLMs—0
Hybrid Models for Lexical Acquisition of Correlated Styles—0
Hybrid Semantics for Goal-Directed Natural Language Generation—0
HyPA-RAG: A Hybrid Parameter Adaptive Retrieval-Augmented Generation System for AI Legal and Policy Applications—0
Identification and Disambiguation of Lexical Cues of Rhetorical Relations across Different Text Genres—0
Identifying and Manipulating the Personality Traits of Language Models—0
Identifying Fairness Issues in Automatically Generated Testing Content—0
Identifying Sensible Lexical Relations in Generated Stories—0
Identity-related Speech Suppression in Generative AI Content Moderation—0
IERL: Interpretable Ensemble Representation Learning -- Combining CrowdSourced Knowledge and Distributed Semantic Representations—0
Igea: a Decoder-Only Language Model for Biomedical Text Generation in Italian—0
IGOT: Information Gain Optimized Tokenizer on Domain Adaptive Pretraining—0
IITB System for CoNLL 2013 Shared Task: A Hybrid Approach to Grammatical Error Correction—0
Image2Text2Image: A Novel Framework for Label-Free Evaluation of Image-to-Text Generation with Text-to-Image Diffusion Models—0
Image Based Review Text Generation with Emotional Guidance—0
Image Description using Visual Dependency Representations—0
Image Semantic Relation Generation—0
Show:102550
← PrevPage 97 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4—Unverified
2Beam search + A*esque (beam)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified