SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 10511100 of 5335 papers

TitleStatusHype
Diffusion Guided Language ModelingCode1
EditEval: An Instruction-Based Benchmark for Text ImprovementsCode1
Gradient-Based Constrained Sampling from Language ModelsCode1
DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLMCode1
Dependency-based Mixture Language ModelsCode1
Differentiable Tree Operations Promote Compositional GeneralizationCode1
ContraCLM: Contrastive Learning For Causal Language ModelCode1
Elucidating the design space of language models for image generationCode1
Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attentionCode1
Leveraging Large Language Models for Node Generation in Few-Shot Learning on Text-Attributed GraphsCode1
Content-Based Collaborative Generation for Recommender SystemsCode1
Enhancing adversarial robustness in Natural Language Inference using explanationsCode1
A Distributional Approach to Controlled Text GenerationCode1
Erasing Conceptual Knowledge from Language ModelsCode1
Copy Is All You NeedCode1
ERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language GenerationCode1
Differentially Private Fine-tuning of Language ModelsCode1
Domain-Specific Text Generation for Machine TranslationCode1
Factual Serialization Enhancement: A Key Innovation for Chest X-ray Report GenerationCode1
Generative quantum machine learning via denoising diffusion probabilistic modelsCode1
LaDiC: Are Diffusion Models Really Inferior to Autoregressive Counterparts for Image-to-Text Generation?Code1
Opening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generatorsCode1
Control, Generate, Augment: A Scalable Framework for Multi-Attribute Text GenerationCode1
FedEx-LoRA: Exact Aggregation for Federated and Efficient Fine-Tuning of Foundation ModelsCode1
Explaining and Improving Contrastive Decoding by Extrapolating the Probabilities of a Huge and Hypothetical LMCode1
Explaining How Transformers Use Context to Build PredictionsCode1
Explanation as a Watermark: Towards Harmless and Multi-bit Model Ownership Verification via Watermarking Feature AttributionCode1
Explanation Graph Generation via Pre-trained Language Models: An Empirical Study with Contrastive LearningCode1
Exploiting Novel GPT-4 APIsCode1
Compositional Generalization for Data-to-Text Generation0
How Does Knowledge Selection Help Retrieval Augmented Generation?0
Composed Variational Natural Language Generation for Few-shot Intents0
A Systematic Evaluation of Large Language Models for Natural Language Generation Tasks0
Abstract Meaning Representation for Sembanking0
Complete Chess Games Enable LLM Become A Chess Master0
Compilable Neural Code Generation with Compiler Feedback0
Comparing the Template-Based Approach to GF: the case of Afrikaans0
Alex: Bootstrapping a Spoken Dialogue System for a New Domain by Real Users0
Defining and Evaluating Fair Natural Language Generation0
Definite Description Lexical Choice: taking Speaker's Personality into account0
Comparing HMMs and Bayesian Networks for Surface Realisation0
Comparing Grammatical Theories of Code-Mixing0
AsymKV: Enabling 1-Bit Quantization of KV Cache with Layer-Wise Asymmetric Quantization Configurations0
Comparing Computational Architectures for Automated Journalism0
Comparing BERT-based Reward Functions for Deep Reinforcement Learning in Machine Translation0
A Survey on the Applications of Frontier AI, Foundation Models, and Large Language Models to Intelligent Transportation Systems0
Comparing Automatic Evaluation Measures for Image Description0
Comparing Abstractive Summaries Generated by ChatGPT to Real Summaries Through Blinded Reviewers and Text Classification Algorithms0
A survey on text generation using generative adversarial networks0
A Survey on Retrieval-Augmented Text Generation for Large Language Models0
Show:102550
← PrevPage 22 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4Unverified
2Beam search + A*esque (beam)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified