SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 26012650 of 5335 papers

TitleStatusHype
Unified Knowledge Prompt Pre-training for Customer Service Dialogues0
StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content EnhancingCode1
On Unsupervised Training of Link Grammar Based Language Models0
Nearest Neighbor Non-autoregressive Text Generation0
Few-Shot Table-to-Text Generation with Prefix-Controlled Generator0
GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformers0
Z-Code++: A Pre-trained Language Model Optimized for Abstractive SummarizationCode4
Diverse Video Captioning by Adaptive Spatio-temporal AttentionCode0
Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries0
MulZDG: Multilingual Code-Switching Framework for Zero-shot Dialogue GenerationCode0
Coherent Visual Storytelling via Parallel Top-Down Visual and Topic Attention0
Performance Optimization for Semantic Communications: An Attention-based Reinforcement Learning Approach0
ProjB: An Improved Bilinear Biased ProjE model for Knowledge Graph Completion0
MENLI: Robust Evaluation Metrics from Natural Language InferenceCode1
Efficient Task-Oriented Dialogue Systems with Response Selection as an Auxiliary TaskCode1
Domain-Specific Text Generation for Machine TranslationCode1
A Comprehensive Survey of Natural Language Generation Advances from the Perspective of Digital Deception0
High Recall Data-to-text Generation with Progressive Edit0
Abstractive Meeting Summarization: A SurveyCode1
DeepGen: Diverse Search Ad Generation and Real-Time Customization0
SMART: Sentences as Basic Units for Text Evaluation0
Neural Knowledge Bank for Pretrained Transformers0
Sequence to sequence pretraining for a less-resourced Slovenian languageCode0
LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text InjectionCode1
Innovations in Neural Data-to-text Generation: A Survey0
Towards a Sentiment-Aware Conversational Agent0
Leveraging Natural Supervision for Language Representation Learning and GenerationCode1
GenText: Unsupervised Artistic Text Generation via Decoupled Font and Texture Manipulation0
Mimetic Models: Ethical Implications of AI that Acts Like You0
Relational Future Captioning Model for Explaining Likely Collisions in Daily TasksCode0
Neural Data-to-Text Generation Based on Small Datasets: Comparing the Added Value of Two Semi-Supervised Learning Approaches on Top of a Large Language Model0
Confident Adaptive Language Modeling0
Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text GenerationCode1
Towards Neural Numeric-To-Text Generation From Temporal Personal Health DataCode0
Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generation0
Multi-Task Retrieval-Augmented Text Generation with Relevance Sampling0
Putting the Con in Context: Identifying Deceptive Actors in the Game of Mafia0
Can Language Models Make Fun? A Case Study in Chinese Comical CrosstalkCode1
Syntax Controlled Knowledge Graph-to-Text Generation with Order and Semantic ConsistencyCode0
Retrieval Based Response Letter Generation For a Customer Care Setting0
CULG: Commercial Universal Language Generation0
Contrastive Data and Learning for Natural Language Processing0
Learning Natural Language Generation with Truncated Reinforcement LearningCode0
Explaining Toxic Text via Knowledge Enhanced Text Generation0
Learning to Selectively Learn for Weakly Supervised Paraphrase Generation with Model-based Reinforcement Learning0
Don’t Take It Literally: An Edit-Invariant Sequence Loss for Text GenerationCode0
Don’t Forget About Pronouns: Removing Gender Bias in Language Models Without Losing Factual Gender Information0
The Case for a Single Model that can Both Generate Continuations and Fill-in-the-Blank0
RoViST: Learning Robust Metrics for Visual StorytellingCode0
Pathway2Text: Dataset and Method for Biomedical Pathway Description GenerationCode0
Show:102550
← PrevPage 53 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4Unverified
2Beam search + A*esque (beam)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified