SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 42514300 of 5335 papers

TitleStatusHype
Optimal Control for Transformer Architectures: Enhancing Generalization, Robustness and Efficiency0
Optimal word order for non-causal text generation with Large Language Models: the Spanish case0
Optimising Incremental Dialogue Decisions Using Information Density for Interactive Systems0
Optimising Incremental Generation for Spoken Dialogue Systems: Reducing the Need for Fillers0
Optimizing and Fine-tuning Large Language Model for Urban Renewal0
Optimizing Bilingual Neural Transducer with Synthetic Code-switching Text Generation0
Optimizing Factual Accuracy in Text Generation through Dynamic Knowledge Selection0
Optimizing Humor Generation in Large Language Models: Temperature Configurations and Architectural Trade-offs0
Optimizing Safe and Aligned Language Generation: A Multi-Objective GRPO Approach0
Orthus: Autoregressive Interleaved Image-Text Generation with Modality-Specific Heads0
OSIC: A New One-Stage Image Captioner Coined0
OUMG: Objective and Universal Metric for Text Generation with Guiding Ability0
Outcome-Constrained Large Language Models for Countering Hate Speech0
Out in the Open: Finding and Categorising Errors in the Lexical Simplification Pipeline0
Overcoming Catastrophic Forgetting During Domain Adaptation of Seq2seq Language Generation0
Overview of the First Content Selection Challenge from Open Semantic Web Data0
Overview of the First Shared Task on Clinical Text Generation: RRG24 and "Discharge Me!"0
OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identification0
PackDiT: Joint Human Motion and Text Generation via Mutual Prompting0
PAD: Personalized Alignment of LLMs at Decoding-Time0
PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation0
PairReranker: Pairwise Reranking for Natural Language Generation0
Palette of Language Models: A Solver for Controlled Text Generation0
PALM: Pre-training an Autoencoding\&Autoregressive Language Model for Context-conditioned Generation0
PAPI: Exploiting Dynamic Parallelism in Large Language Model Decoding with a Processing-In-Memory-Enabled Computing System0
PARADIGM: Paraphrase Diagnostics through Grammar Matching0
Paralinguistics-Enhanced Large Language Modeling of Spoken Dialogue0
Parallelizing Autoregressive Generation with Variational State Space Models0
ParallelSpec: Parallel Drafter for Efficient Speculative Decoding0
Paramanu: A Family of Novel Efficient Generative Foundation Language Models for Indian Languages0
Parameter Efficient Audio Captioning With Faithful Guidance Using Audio-text Shared Latent Representation0
Parameter-Efficient Detoxification with Contrastive Decoding0
Parameter Efficient Diverse Paraphrase Generation Using Sequence-Level Knowledge Distillation0
Parameter Efficient Fine Tuning: A Comprehensive Analysis Across Applications0
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies0
Paraphrase and Aggregate with Large Language Models for Minimizing Intent Classification Errors0
Paraphrase Generation: A Survey of the State of the Art0
Paraphrase Generation by Learning How to Edit from Samples0
Paraphrase Identification with Deep Learning: A Review of Datasets and Methods0
Paraphrasing with Large Language Models0
Paraphrastic Variance between European and Brazilian Portuguese0
PASS: A Dutch data-to-text system for soccer, targeted towards specific audiences0
PAST: Phonetic-Acoustic Speech Tokenizer0
Patent Claim Generation by Fine-Tuning OpenAI GPT-20
PatentScore: Multi-dimensional Evaluation of LLM-Generated Patent Claims0
PatentTransformer-2: Controlling Patent Text Generation by Structural Metadata0
PathAlign: A vision-language model for whole slide images in histopathology0
Path Planning for Masked Diffusion Model Sampling0
Pathway2Text: Dataset and Method for Biomedical Pathway Description Generation0
PatientNarr: Towards generating patient-centric summaries of hospital stays0
Show:102550
← PrevPage 86 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified