SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2001–2050 of 5335 papers

TitleStatusHype
An Extensive Evaluation of Factual Consistency in Large Language Models for Data-to-Text Generation—0
Forcing Generative Models to Degenerate Ones: The Power of Data Poisoning Attacks—0
Forking Paths in Neural Text Generation—0
DiffuSIA: A Spiral Interaction Architecture for Encoder-Decoder Text Diffusion—0
Adversarial Domain Adaptation for Variational Neural Language Generation in Dialogue Systems—0
Form follows Function: Text-to-Text Conditional Graph Generation based on Functional Requirements—0
Fortifying Ethical Boundaries in AI: Advanced Strategies for Enhancing Security in Large Language Models—0
FourierNAT: A Fourier-Mixing-Based Non-Autoregressive Transformer for Parallel Sequence Generation—0
DiffusER: Discrete Diffusion via Edit-based Reconstruction—0
Frame-Based Annotation of Multimodal Corpora: Tracking (A)Synchronies in Meaning Construction—0
An Exploration of Post-Editing Effectiveness in Text Summarization—0
Frames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systems—0
FRE at SocialDisNER: Joint Learning of Language Models for Named Entity Recognition—0
Comparative Analysis of CHATGPT and the evolution of language models—0
Free-text Rationale Generation under Readability Level Control—0
From Extractive to Abstractive Summarization: A Journey—0
From FOAF to English: Linguistic Contribution to Web Semantics—0
From General to Targeted Rewards: Surpassing GPT-4 in Open-Ended Long-Context Generation—0
From Head to Tail: Towards Balanced Representation in Large Vision-Language Models through Adaptive Data Calibration—0
From OpenCCG to AI Planning: Detecting Infeasible Edges in Sentence Generation—0
A Comprehensive Survey of Natural Language Generation Advances from the Perspective of Digital Deception—0
From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing—0
Global Context with Discrete Diffusion in Vector Quantised Modelling for Image Generation—0
From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers—0
From sensors to sense: Integrated heterogeneous ontologies for Natural Language Generation—0
From Show to Tell: A Survey on Deep Learning-based Image Captioning—0
From Solving a Problem Boldly to Cutting the Gordian Knot: Idiomatic Text Generation—0
From Sub-Ability Diagnosis to Human-Aligned Generation: Bridging the Gap for Text Length Control via MARKERGEN—0
From Theories on Styles to their Transfer in Text: Bridging the Gap with a Hierarchical Survey—0
From the Virtual to the RealWorld: Referring to Objects in Real-World Spatial Scenes—0
DiffuDetox: A Mixed Diffusion Model for Text Detoxification—0
BetterV: Controlled Verilog Generation with Discriminative Guidance—0
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation—0
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation—0
Frustratingly Easy Model Ensemble for Abstractive Summarization—0
DiffuCom: A novel diffusion model for comment generation—0
Fully Abstractive Approach to Guided Summarization—0
DiffSampling: Enhancing Diversity and Accuracy in Neural Text Generation—0
Better Distractions: Transformer-based Distractor Generation and Multiple Choice Question Filtering—0
A New Approach for Idiom Identification Using Meanings and the Web—0
Diffusion Glancing Transformer for Parallel Sequence to Sequence Learning—0
Best Student Forcing: A Simple Training Mechanism in Adversarial Language Generation—0
Fusion Models for Improved Visual Captioning—0
Compositional Generalization for Data-to-Text Generation—0
Differential Privacy Mechanisms in Neural Tangent Kernel Regression—0
Fuzzy Sets Across the Natural Language Generation Pipeline—0
Best practices for the human evaluation of automatically generated text—0
An evaluation of template and ML-based generation of user-readable text from a knowledge graph—0
Glauber Generative Model: Discrete Diffusion Models via Binary Classification—0
Grounding in social media: An approach to building a chit-chat dialogue model—0
Show:102550
← PrevPage 41 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4—Unverified
2Beam search + A*esque (beam)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified