SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2401–2450 of 5335 papers

TitleStatusHype
Towards Robust NLG Bias Evaluation with Syntactically-diverse PromptsCode0
CliMedBERT: A Pre-trained Language Model for Climate and Health-related Text—0
What do you MEME? Generating Explanations for Visual Semantic Role Labelling in MemesCode1
Soft Alignment Objectives for Robust Adaptation of Language GenerationCode0
Controlled Language Generation for Language Learning ItemsCode0
DiffusionBERT: Improving Generative Masked Language Models with Diffusion ModelsCode2
Unified Discrete Diffusion for Simultaneous Vision-Language GenerationCode1
Understanding BLOOM: An empirical study on diverse NLP tasks—0
Lexical Complexity Controlled Sentence Generation—0
CodeExp: Explanatory Code Document GenerationCode1
On the Importance of Image Encoding in Automated Chest X-Ray Report GenerationCode1
Look, Read and Ask: Learning to Ask Questions by Reading Text in Images—0
Retrieval-Augmented Multimodal Language Modeling—0
Linear Interpolation In Parameter Space is Good Enough for Fine-Tuned Language Models—0
Best-k Search Algorithm for Neural Text Generation—0
In-sample Curriculum Learning by Sequence Completion for Natural Language GenerationCode0
How to Describe Images in a More Funny Way? Towards a Modular Approach to Cross-Modal Sarcasm Generation—0
Artificial Interrogation for Attributing Language ModelsCode0
An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text GenerationCode1
GENIUS: Sketch-based Language Model Pre-training via Extreme and Selective Masking for Text Generation and AugmentationCode1
Reducing Hallucinations in Neural Machine Translation with Feature Attribution—0
Reward Gaming in Conditional Text Generation—0
An Overview on Controllable Text Generation via Variational Auto-EncodersCode1
kogito: A Commonsense Knowledge Inference ToolkitCode1
AutoTemplate: A Simple Recipe for Lexically Constrained Text GenerationCode0
A Unified Mutual Supervision Framework for Referring Expression Segmentation and Generation—0
Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk DecodingCode1
Evade the Trap of Mediocrity: Promoting Diversity and Novelty in Text Generation via Concentrating AttentionCode0
Learning to Answer Multilingual and Code-Mixed Questions—0
Controllable Citation Sentence Generation with Language ModelsCode0
A Survey of Knowledge Enhanced Pre-trained Language Models—0
CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class Classification—0
Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model ControlCode0
Measuring Reliability of Large Language Models through Semantic ConsistencyCode0
Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers—0
Self-conditioned Embedding Diffusion for Text Generation—0
Retrieval augmentation of large language models for lay language generationCode1
Human-Machine Collaboration Approaches to Build a Dialogue Dataset for Hate Speech CounteringCode1
Generative Transformers for Design Concept Generation—0
LAMASSU: Streaming Language-Agnostic Multilingual Speech Recognition and Translation Using Neural Transducers—0
CLSE: Corpus of Linguistically Significant EntitiesCode0
OSIC: A New One-Stage Image Captioner Coined—0
Time-aware Prompting for Text Generation—0
CodePAD: Sequence-based Code Generation with Pushdown AutomatonCode0
Quantum Natural Language Generation on Near-Term DevicesCode1
Natural Language Deduction with Incomplete InformationCode0
TaTa: A Multilingual Table-to-Text Dataset for African LanguagesCode2
The Effect of Multiple Replies for Natural Language Generation Chatbots—0
SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular ControlCode1
DiffusER: Discrete Diffusion via Edit-based Reconstruction—0
Show:102550
← PrevPage 49 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified