SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 30013050 of 5335 papers

TitleStatusHype
Design and Development of Spoken Dialogue System in Indic Languages0
Document Level Hierarchical Transformer0
Robustness Analysis of Grover for Machine-Generated News Detection0
Exploration into Translation-Equivariant Image QuantizationCode0
Multi-modal Dependency Tree for Video Captioning0
Improvement in Machine Translation with Generative Adversarial Networks0
ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic ArithmeticCode1
Context Matters in Semantically Controlled Language Generation for Task-oriented Dialogue Systems0
Octree Transformer: Autoregressive 3D Shape Generation on Hierarchically Structured SequencesCode1
Realistic simulation of users for IT systems in cyber ranges0
UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language ModelingCode1
Reinforcement Learning for Few-Shot Text Generation AdaptationCode0
L-Verse: Bidirectional Generation Between Image and TextCode1
Triples-to-Text Generation with Reinforcement Learning Based Graph-augmented Neural Networks0
How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN0
Mix and Match: Learning-free Controllable Text Generationusing Energy Language Models0
What Makes The Story Forward? Inferring Commonsense Explanations as Prompts for Future Event Generation0
Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings0
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation0
Improving Compositional Generalization with Self-Training for Data-to-Text Generation0
REDTABS: A Collection of Report Document Datasets for Long Text and Multi-Table Summarization0
Using Structured Content Plans for Fine-grained Syntactic Control in Pretrained Language Model Generation0
Context-Aware Language Modeling for Goal-Oriented Dialogue Systems0
Modeling Intensification for Signed Language Generation: A Computational Approach0
Rethinking and Refining the Distinct Metric0
Hierarchical Recurrent Aggregative Generation for Few-Shot NLG0
IndicBART: A Pre-trained Model for Indic Natural Language Generation0
Graph Pre-training for AMR Parsing and Generation0
On the Multilingual Capabilities of Very Large-Scale English Language Models0
Generative Pretraining for Paraphrase Evaluation0
Explaining Toxic Text via Knowledge Enhanced Text Generation0
CaM-Gen: Causally-aware Guided Text Generation0
Sentence-Level Discourse Parsing as Text-to-Text Generation0
The Case for a Single Model that can Both Generate Continuations and Fill-in-the-Blank0
FLAP: Table-to-Text Generation with Feature Indication and Numerical Reasoning Pretraining0
OpenKorPOS: Democratizing Korean Tokenization with Voting-Based Open Corpus Annotation0
Boosting coherence of language models0
Open Domain Question Answering over Virtual Documents: A Unified Approach for Data and Text0
How Do Seq2Seq Models Perform on End-to-End Data-to-Text Generation?0
Learning to Rank Visual Stories From Human Ranking Data0
Fine-Grained Controllable Text Generation Using Non-Residual Prompting0
RoMe: A Robust Metric for Evaluating Natural Language Generation0
Improving Controllable Text Generation with Position-Aware Weighted Decoding0
Diversifying Neural Text Generation with Part-of-Speech Guided Softmax and Sampling0
A Generative Language Model for Few-shot Aspect-Based Sentiment Analysis0
Self-conditioning pre-trained language models0
Neural Pipeline for Zero-Shot Data-to-Text Generation0
Controllable Natural Language Generation with Contrastive Prefixes0
MReD: A Meta-Review Dataset for Structure-Controllable Text Generation0
Controlling Pretrained Language Generation Models by Learning to Focus0
Show:102550
← PrevPage 61 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified