SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 36013650 of 5335 papers

TitleStatusHype
Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation0
ImaginE: An Imagination-Based Automatic Evaluation Metric for Natural Language Generation0
Turing: an Accurate and Interpretable Multi-Hypothesis Cross-Domain Natural Language Database Interface0
Summary Grounded Conversation Generation0
An evaluation of template and ML-based generation of user-readable text from a knowledge graph0
Detecting Bot-Generated Text by Characterizing Linguistic Accommodation in Human-Bot Interactions0
Evaluating and Explaining Natural Language Generation with GenXCode0
On Randomized Classification Layers and Their Implications in Natural Language Generation0
How Vision Affects Language: Comparing Masked Self-Attention in Uni-Modal and Multi-Modal Transformer0
Deep Learning on Graphs for Natural Language Processing0
Coherent and Concise Radiology Report Generation via Context Specific Image Representations and Orthogonal Sentence States0
A Tutorial on Evaluation Metrics used in Natural Language Generation0
DYPLOC: Dynamic Planning of Content Using Mixed Language Models for Text Generation0
An Empirical Study of Generating Texts for Search Engine Advertising0
Task Definition and Integration For Scientific-Document Writing SupportCode0
Text Generation from Discourse Representation Structures0
Using Integrated Gradients and Constituency Parse Trees to explain Linguistic Acceptability learnt by BERT0
Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation0
A Compression-Compilation Framework for On-mobile Real-time BERT Applications0
Annotation Inconsistency and Entity Bias in MultiWOZ0
Grammar Accuracy Evaluation (GAE): Quantifiable Quantitative Evaluation of Machine Translation Models0
Data Augmentation for Text Generation Without Any Augmented Data0
Generative Adversarial Imitation Learning for Empathy-based AI0
Argument Undermining: Counter-Argument Generation by Attacking Weak PremisesCode0
VANiLLa : Verbalized Answers in Natural Language at Large ScaleCode0
Killing One Bird with Two Stones: Model Extraction and Attribute Inference Attacks against BERT-based APIs0
Controlling Text Edition by Changing Answers of Specific QuestionsCode0
Automated Knee X-ray Report Generation0
Pretrained Language Models for Text Generation: A Survey0
Towards a Universal NLG for Dialogue Systems and Simulators with Future Bridging0
Retrieval-Augmented Transformer-XL for Close-Domain Dialog Generation0
Stylized Story Generation with Style-Guided Planning0
Doc2Dict: Information Extraction as Text GenerationCode0
A Study on Summarizing and Evaluating Long Documents0
EASE: Extractive-Abstractive Summarization with Explanations0
R2D2: Relational Text Decoding with Transformers0
Knowledge-based Review Generation by Coherence Enhanced Text Planning0
Diversifying Neural Text Generation with Part-of-Speech Guided Softmax and SamplingCode0
Generalising Multilingual Concept-to-Text NLG with Language Agnostic Delexicalisation0
SGG: Learning to Select, Guide, and Generate for Keyphrase GenerationCode0
Translation Quality Assessment: A Brief Survey on Manual and Automatic MethodsCode0
Unsupervised Document Expansion for Information Retrieval with Stochastic Text GenerationCode0
Text-to-Text Multi-view Learning for Passage Re-ranking0
Text Generation with Deep Variational GAN0
What Makes a Message Persuasive? Identifying Adaptations Towards Persuasiveness in Nine Exploratory Case Studies0
On a Utilitarian Approach to Privacy Preserving Text Generation0
Natural Language Generation Using Link Grammar for General Conversational IntelligenceCode0
Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systems0
proScript: Partially Ordered Scripts Generation via Pre-trained Language Models0
ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code GenerationCode0
Show:102550
← PrevPage 73 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified