SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2951–3000 of 5335 papers

TitleStatusHype
Visual Storytelling with Hierarchical BERT Semantic Guidance—0
Latency Adjustable Transformer Encoder for Language Understanding—0
Imagined versus Remembered Stories: Quantifying Differences in Narrative Flow—0
Automatic Related Work Generation: A Meta Study—0
RabindraNet, Creating Literary Works in the Style of Rabindranath Tagore—0
C2-CRS: Coarse-to-Fine Contrastive Learning for Conversational Recommender SystemCode1
ERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language GenerationCode1
What is Event Knowledge Graph: A Survey—0
Radiology Report Generation with a Learned Knowledge Base and Multi-modal Alignment—0
Measuring Attribution in Natural Language Generation ModelsCode1
A Survey of Natural Language Generation—0
May the Force Be with Your Copy Mechanism: Enhanced Supervised-Copy Method for Natural Language Generation—0
Spiral Language Modeling—0
ImaginE: An Imagination-Based Automatic Evaluation Metric for Natural Language Generation—0
Speeding Up Entmax—0
AutoGraphex: Zero-shot Biomedical Definition Generation with Automatic Prompting—0
RoViST: Learning Robust Metrics for Visual Storytelling—0
NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead HeuristicsCode1
Dynamic Human Evaluation for Relative Model ComparisonsCode0
Automatic Product Copywriting for E-Commerce—0
DSGPT: Domain-Specific Generative Pre-Training of Transformers for Text Generation in E-commerce Title and Review Summarization—0
Handwritten text generation and strikethrough characters augmentation—0
GEO-BLEU: Similarity Measure for Geospatial Sequences—0
TopNet: Learning from Neural Topic Model to Generate Long Stories—0
Reinforced Abstractive Summarization with Adaptive Length Controlling—0
Tackling Query-Focused Summarization as A Knowledge-Intensive Task: A Pilot Study—0
Massive-scale Decoding for Text Generation using LatticesCode1
Step-unrolled Denoising Autoencoders for Text GenerationCode1
Controlled Cue Generation for Play Scripts—0
Contextualized Scene Imagination for Generative Commonsense ReasoningCode0
Towards More Efficient Insertion Transformer with Fractional Positional EncodingCode0
Improving Logical-Level Natural Language Generation with Topic-Conditioned Data Augmentation and Logical Form Generation—0
Show, Write, and Retrieve: Entity-aware Article Generation and RetrievalCode0
VUT: Versatile UI Transformer for Multi-Modal Multi-Task User Interface Modeling—0
Sampling from Discrete Energy-Based Models with Quality/Efficiency Trade-offs—0
Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation—0
Discourse-Aware Soft Prompting for Text Generation—0
Spinning Language Models: Risks of Propaganda-As-A-Service and CountermeasuresCode1
Self-Supervised Image-to-Text and Text-to-Image SynthesisCode0
Does Structure Matter? Leveraging Data-to-Text Generation for Answering Complex Information NeedsCode0
Bidimensional Leaderboards: Generate and Evaluate Language Hand in HandCode1
Natural Answer Generation: From Factoid Answer to Full-length Answer using Grammar Correction—0
Search and Learn: Improving Semantic Coverage for Data-to-Text GenerationCode0
Protecting Intellectual Property of Language Generation APIs with Lexical WatermarkCode0
Global Context with Discrete Diffusion in Vector Quantised Modelling for Image Generation—0
InfoLM: A New Metric to Evaluate Summarization & Data2Text GenerationCode1
LOGEN: Few-shot Logical Knowledge-Conditioned Text Generation with Self-training—0
Stylistic MR-to-Text Generation Using Pre-trained Language Models—0
An Efficient Keyframes Selection Based Framework for Video Captioning—0
Cross-lingual Alignment of Knowledge Graph Triples with Sentences—0
Show:102550
← PrevPage 60 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified