SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3001–3050 of 5335 papers

TitleStatusHype
Synonym Detection Using Syntactic Dependency And Neural Embeddings—0
Calibrating Sequence likelihood Improves Conditional Language Generation—0
DR.BENCH: Diagnostic Reasoning Benchmark for Clinical Natural Language Processing—0
UCEpic: Unifying Aspect Planning and Lexical Constraints for Generating Explanations in RecommendationCode0
FiD-Light: Efficient and Effective Retrieval-Augmented Text Generation—0
Informative Text Generation from Knowledge Triples—0
Knowledge Representation for Conceptual, Motivational, and Affective Processes in Natural Language Communication—0
Word to Sentence Visual Semantic Similarity for Caption Generation: Lessons Learned—0
Controllable Text Generation for Open-Domain Creativity and Fairness—0
XF2T: Cross-lingual Fact-to-Text Generation for Low-Resource Languages—0
Learning to Write with Coherence From Negative Examples—0
Selecting Better Samples from Pre-trained LLMs: A Case Study on Question Generation—0
DFX: A Low-latency Multi-FPGA Appliance for Accelerating Transformer-based Text Generation—0
Assessing ASR Model Quality on Disordered Speech using BERTScore—0
EffEval: A Comprehensive Evaluation of Efficiency for MT Evaluation MetricsCode0
Selective Token Generation for Few-shot Natural Language GenerationCode0
Adaptive Natural Language Generation for Task-oriented Dialogue via Reinforcement LearningCode0
Text and Patterns: For Effective Chain of Thought, It Takes Two to Tango—0
Distribution Aware Metrics for Conditional Natural Language Generation—0
Graph-to-Text Generation with Dynamic Structure Pruning—0
vec2text with Round-Trip Translations—0
Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows—0
Unified Generative & Dense Retrieval for Query Rewriting in Sponsored Search—0
Chain of Explanation: New Prompting Method to Generate Higher Quality Natural Language Explanation for Implicit Hate Speech—0
OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialogue—0
SynSciPass: detecting appropriate uses of scientific text generationCode0
Layer or Representation Space: What makes BERT-based Evaluation Metrics Robust?Code0
Bridging Music and Text with Crowdsourced Music Comments: A Sequence-to-Sequence Framework for Thematic Music Comments Generation—0
Every picture tells a story: Image-grounded controllable stylistic story generation—0
The Effectiveness of Bidirectional Generative Patent Language Models—0
Demonstrating EMMA: Embodied MultiModal Agent for Language-guided Action Execution in 3D Simulated Environments—0
Entity-based De-noising Modeling for Controllable Dialogue Summarization—0
A corpus for Automatic Article Analysis—0
Generating Discourse Connectives with Pre-trained Language Models: Conditioning on Discourse Relations Helps Reconstruct the PDTBCode0
Unified Knowledge Prompt Pre-training for Customer Service Dialogues—0
The Glass Ceiling of Automatic Evaluation in Natural Language Generation—0
On Unsupervised Training of Link Grammar Based Language Models—0
Nearest Neighbor Non-autoregressive Text Generation—0
GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformers—0
Few-Shot Table-to-Text Generation with Prefix-Controlled Generator—0
Diverse Video Captioning by Adaptive Spatio-temporal AttentionCode0
Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries—0
MulZDG: Multilingual Code-Switching Framework for Zero-shot Dialogue GenerationCode0
Coherent Visual Storytelling via Parallel Top-Down Visual and Topic Attention—0
Performance Optimization for Semantic Communications: An Attention-based Reinforcement Learning Approach—0
ProjB: An Improved Bilinear Biased ProjE model for Knowledge Graph Completion—0
A Comprehensive Survey of Natural Language Generation Advances from the Perspective of Digital Deception—0
High Recall Data-to-text Generation with Progressive Edit—0
DeepGen: Diverse Search Ad Generation and Real-Time Customization—0
SMART: Sentences as Basic Units for Text Evaluation—0
Show:102550
← PrevPage 61 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified