SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 37513800 of 5335 papers

TitleStatusHype
“This is a Problem, Don’t You Agree?” Framing and Bias in Human Evaluation for Natural Language Generation0
Semantic Triples Verbalization with Generative Pre-Training ModelCode0
A General Benchmarking Framework for Text GenerationCode0
Data Augmentation for Multiclass Utterance Classification -- A Systematic Study0
Neural Micro-Planning for Data to Text Generation Produces more Cohesive Text0
Machine Translation Aided Bilingual Data-to-Text Generation and Semantic Parsing0
Denoising Pre-Training and Data Augmentation Strategies for Enhanced RDF Verbalization with Transformers0
Machine Translation Pre-training for Data-to-Text Generation - A Case Study in Czech0
Learning Semantic Correspondences from Noisy Data-text Pairs by Local-to-Global Alignments0
A proof of concept on triangular test evaluation for Natural Language Generation0
DaMata: A Robot-Journalist Covering the Brazilian Amazon DeforestationCode0
Recipe Instruction Semantics Corpus (RISeC): Resolving Semantic Structure and Zero Anaphora in Recipes0
Controllable Neural Natural Language Generation: comparison of state-of-the-art control strategies0
Zero-Shot Neural Machine Translation: Russian-Hindi @LoResMT 20200
Exploring Looping Effects in RNN-based Architectures0
Unsupervised KB-to-Text Generation with Auxiliary Triple Extraction using Dual Learning0
The 2020 Bilingual, Bi-Directional WebNLG+ Shared Task: Overview and Evaluation Results (WebNLG+ 2020)0
Annotating Errors and Emotions in Human-Chatbot Interactions in Italian0
Learning with Contrastive Examples for Data-to-Text GenerationCode0
Text-to-Text Pre-Training Model with Plan Selection for RDF-to-Text Generation0
Distinctive Slogan Generation with Reconstruction0
MedWriter: Knowledge-Aware Medical Text Generation0
Building Hierarchically Disentangled Language Models for Text Generation with Named Entities0
SimpleNLG-TI: Adapting SimpleNLG to Tibetan0
Dynamic Topic Tracker for KB-to-Text Generation0
A hierarchical approach to vision-based language generation: from simple sentences to complex natural language0
Text Simplification with Reinforcement Learning Using Supervised Rewards on Grammaticality, Meaning Preservation, and Simplicity0
Retrieval-Augmented Controllable Review Generation0
Train Hard, Finetune Easy: Multilingual Denoising for RDF-to-Text Generation0
Label Representations in Modeling Classification as Text Generation0
Controlled Text Generation with Adversarial Learning0
RDFjsRealB: a Symbolic Approach for Generating Text from RDF Triples0
Generalized Shortest-Paths Encoders for AMR-to-Text Generation0
P^2: A Plan-and-Pretrain Approach for Knowledge Graph-to-Text Generation0
The CACAPO Dataset: A Multilingual, Multi-Domain Dataset for Neural Pipeline and End-to-End Data-to-Text Generation0
Utilising Knowledge Graph Embeddings for Data-to-Text Generation0
Automatic coding of students' writing via Contrastive Representation Learning in the Wasserstein space0
Language Generation via Combinatorial Constraint Satisfaction: A Tree Search Enhanced Monte-Carlo ApproachCode0
Generating Intelligible Plumitifs Descriptions: Use Case Application with Ethical Considerations0
Evaluating Semantic Accuracy of Data-to-Text Generation with Natural Language InferenceCode0
Attention Mechanism, Transformers, BERT, and GPT: Tutorial and Survey0
DORB: Dynamically Optimizing Multiple Rewards with Bandits0
Conditioned Natural Language Generation using only Unconditioned Language Model: An Exploration0
Meaningful Answer Generation of E-Commerce Question-Answering0
E-commerce Query-based Generation based on User Review0
From Unsupervised Machine Translation To Adversarial Text Generation0
Multilingual AMR-to-Text Generation0
A Gold Standard Methodology for Evaluating Accuracy in Data-To-Text SystemsCode0
Best Practices for Data-Efficient Modeling in NLG:How to Train Production-Ready Neural Models with Less Data0
Template Controllable keywords-to-text Generation0
Show:102550
← PrevPage 76 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified