SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 4201–4250 of 5335 papers

TitleStatusHype
On Randomized Classification Layers and Their Implications in Natural Language Generation—0
On Reducing Repetition in Abstractive Summarization—0
On Reward Maximization and Distribution Matching for Fine-Tuning Language Models—0
On Stronger Computational Separations Between Multimodal and Unimodal Machine Learning—0
On Target Representation in Continuous-output Neural Machine Translation—0
On the Anatomy of Latent-variable Generative Models for Conditional Text Generation—0
On the application of Large Language Models for language teaching and assessment technology—0
On the Depth between Beam Search and Exhaustive Search for Text Generation—0
On the Effectiveness of Automated Metrics for Text Generation Systems—0
On the Effectiveness of Neural Text Generation based Data Augmentation for Recognition of Morphologically Rich Speech—0
On the Evaluation of Machine-Generated Reports—0
On the Feasibility of Automatically Describing n-dimensional Objects—0
On The Feasibility of Open Domain Referring Expression Generation Using Large Scale Folksonomies—0
On-the-Fly Attention Modulation for Neural Generation—0
On the Latent Holes of VAEs for Text Generation—0
On the Latent Holes 🧀 of VAEs for Text Generation—0
On the Learning of Non-Autoregressive Transformers—0
On the Limits of Language Generation: Trade-Offs Between Hallucination and Mode Collapse—0
On the Multilingual Capabilities of Very Large-Scale English Language Models—0
On the Origin of LLMs: An Evolutionary Tree and Graph for 15,821 Large Language Models—0
On the performativity of SDG classifications in large bibliometric databases—0
On the Power of Decision Trees in Auto-Regressive Language Modeling—0
On the probability-quality paradox in language generation—0
On the Query Complexity of Verifier-Assisted Language Generation—0
On the Relation between Quality-Diversity Evaluation and Distribution-Fitting Goal in Text Generation—0
On the Robustness of Standalone Referring Expression Generation Algorithms Using RDF Data—0
On the Safety of Open-Sourced Large Language Models: Does Alignment Really Prevent Them From Being Misused?—0
On the Sequence Evaluation based on Stochastic Processes—0
On the Unintended Social Bias of Training Language Generation Models with Data from Local Media—0
On the Unintended Social Bias of Training Language Generation Models with News Articles—0
On the verbalization patterns of part-whole relations in isiZulu—0
On the Weaknesses of Reinforcement Learning for Neural Machine Translation—0
Ontologically Faithful Generation of Non-Player Character Dialogues—0
Ontology Authoring Inspired By Dialogue—0
Ontology-Based Retrieval \& Neural Approaches for BioASQ Ideal Answer Generation—0
OntoVerbal: a Generic Tool and Practical Application to SNOMED CT—0
On Training Instance Selection for Few-Shot Neural Text Generation—0
On Uncertainty In Natural Language Processing—0
On Unsupervised Training of Link Grammar Based Language Models—0
OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialogue—0
OPDAI at SemEval-2024 Task 6: Small LLMs can Accelerate Hallucination Detection with Weakly Supervised Data—0
Open-Domain Neural Dialogue Systems—0
Open Domain Question Answering over Virtual Documents: A Unified Approach for Data and Text—0
OpenFact at CheckThat! 2024: Combining Multiple Attack Methods for Effective Adversarial Text Generation—0
OpenKorPOS: Democratizing Korean Tokenization with Voting-Based Open Corpus Annotation—0
OpenKorPOS: Democratizing Korean Tokenization with Voting-Based Open Corpus Annotation—0
OpenLEAF: Open-Domain Interleaved Image-Text Generation and Evaluation—0
Operation-guided Neural Networks for High Fidelity Data-To-Text Generation—0
O Poeta Artificial 2.0: Increasing Meaningfulness in a Poetry Generation Twitter bot—0
Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health—0
Show:102550
← PrevPage 85 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified