SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 33013350 of 5335 papers

TitleStatusHype
Spiral Language Modeling0
AutoGraphex: Zero-shot Biomedical Definition Generation with Automatic Prompting0
ImaginE: An Imagination-Based Automatic Evaluation Metric for Natural Language Generation0
RoViST: Learning Robust Metrics for Visual Storytelling0
Speeding Up Entmax0
DSGPT: Domain-Specific Generative Pre-Training of Transformers for Text Generation in E-commerce Title and Review Summarization0
Dynamic Human Evaluation for Relative Model ComparisonsCode0
Automatic Product Copywriting for E-Commerce0
TopNet: Learning from Neural Topic Model to Generate Long Stories0
GEO-BLEU: Similarity Measure for Geospatial Sequences0
Tackling Query-Focused Summarization as A Knowledge-Intensive Task: A Pilot Study0
Handwritten text generation and strikethrough characters augmentation0
Reinforced Abstractive Summarization with Adaptive Length Controlling0
Controlled Cue Generation for Play Scripts0
Contextualized Scene Imagination for Generative Commonsense ReasoningCode0
Improving Logical-Level Natural Language Generation with Topic-Conditioned Data Augmentation and Logical Form Generation0
Towards More Efficient Insertion Transformer with Fractional Positional EncodingCode0
Show, Write, and Retrieve: Entity-aware Article Generation and RetrievalCode0
Discourse-Aware Soft Prompting for Text Generation0
Sampling from Discrete Energy-Based Models with Quality/Efficiency Trade-offs0
VUT: Versatile UI Transformer for Multi-Modal Multi-Task User Interface Modeling0
Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation0
Self-Supervised Image-to-Text and Text-to-Image SynthesisCode0
Does Structure Matter? Leveraging Data-to-Text Generation for Answering Complex Information NeedsCode0
Natural Answer Generation: From Factoid Answer to Full-length Answer using Grammar Correction0
Search and Learn: Improving Semantic Coverage for Data-to-Text GenerationCode0
Protecting Intellectual Property of Language Generation APIs with Lexical WatermarkCode0
Global Context with Discrete Diffusion in Vector Quantised Modelling for Image Generation0
LOGEN: Few-shot Logical Knowledge-Conditioned Text Generation with Self-training0
Exploration into Translation-Equivariant Image QuantizationCode0
Design and Development of Spoken Dialogue System in Indic Languages0
Document Level Hierarchical Transformer0
Stylistic MR-to-Text Generation Using Pre-trained Language Models0
Multi-modal Dependency Tree for Video Captioning0
Robustness Analysis of Grover for Machine-Generated News Detection0
Cross-lingual Alignment of Knowledge Graph Triples with Sentences0
An Efficient Keyframes Selection Based Framework for Video Captioning0
Improvement in Machine Translation with Generative Adversarial Networks0
Context Matters in Semantically Controlled Language Generation for Task-oriented Dialogue Systems0
Realistic simulation of users for IT systems in cyber ranges0
Reinforcement Learning for Few-Shot Text Generation AdaptationCode0
Triples-to-Text Generation with Reinforcement Learning Based Graph-augmented Neural Networks0
How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN0
MReD: A Meta-Review Dataset for Structure-Controllable Text Generation0
Open Domain Question Answering over Virtual Documents: A Unified Approach for Data and Text0
FLAP: Table-to-Text Generation with Feature Indication and Numerical Reasoning Pretraining0
Improving Compositional Generalization with Self-Training for Data-to-Text Generation0
Modeling Intensification for Signed Language Generation: A Computational Approach0
Improving Controllable Text Generation with Position-Aware Weighted Decoding0
IndicBART: A Pre-trained Model for Indic Natural Language Generation0
Show:102550
← PrevPage 67 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified