SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 201250 of 5335 papers

TitleStatusHype
What Matters In The Structured Pruning of Generative Language Models?Code2
In-Context Retrieval-Augmented Language ModelsCode2
Grounding Language Models to Images for Multimodal Inputs and OutputsCode2
eVAE: Evolutionary Variational AutoencoderCode2
DiffusionBERT: Improving Generative Masked Language Models with Diffusion ModelsCode2
TaTa: A Multilingual Table-to-Text Dataset for African LanguagesCode2
Contrastive Decoding: Open-ended Text Generation as OptimizationCode2
Contrastive Search Is What You Need For Neural Text GenerationCode2
DiffuSeq: Sequence to Sequence Text Generation with Diffusion ModelsCode2
Towards a Unified Multi-Dimensional Evaluator for Text GenerationCode2
Offline RL for Natural Language Generation with Implicit Language Q LearningCode2
Multimodality for NLP-Centered Applications: Resources, Advances and FrontiersCode2
CoNT: Contrastive Neural Text GenerationCode2
Symphony Generation with Permutation Invariant Language ModelCode2
Language Models Can See: Plugging Visual Controls in Text GenerationCode2
A Contrastive Framework for Neural Text GenerationCode2
Ecco: An Open Source Library for the Explainability of Transformer Language ModelsCode2
Structured Denoising Diffusion Models in Discrete State-SpacesCode2
Measuring Mathematical Problem Solving With the MATH DatasetCode2
Learning Transferable Visual Models From Natural Language SupervisionCode2
TextBox: A Unified, Modularized, and Extensible Framework for Text GenerationCode2
Few-Shot Text Generation with Pattern-Exploiting TrainingCode2
SeqGenSQL -- A Robust Sequence Generation Model for Structured Query LanguageCode2
Deep Learning for Text Style Transfer: A SurveyCode2
Utterance-level Dialogue Understanding: An Empirical StudyCode2
The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP ModelsCode2
Simplifying Paragraph-level Question Generation via Transformer Language ModelsCode2
CLUECorpus2020: A Large-scale Chinese Corpus for Pre-training Language ModelCode2
Plug and Play Language Models: A Simple Approach to Controlled Text GenerationCode2
Unified Vision-Language Pre-Training for Image Captioning and VQACode2
MASS: Masked Sequence to Sequence Pre-training for Language GenerationCode2
Texar: A Modularized, Versatile, and Extensible Toolkit for Text GenerationCode2
Mitigating Object Hallucinations via Sentence-Level Early InterventionCode1
TagRouter: Learning Route to LLMs through Tags for Open-Domain Text Generation TasksCode1
Revisit What You See: Disclose Language Prior in Vision Tokens for Efficient Guided Decoding of LVLMsCode1
Diffuse Everything: Multimodal Diffusion Models on Arbitrary State SpacesCode1
Time to Talk: LLM Agents for Asynchronous Group Communication in Mafia GamesCode1
SuperWriter: Reflection-Driven Long-Form Generation with Large Language ModelsCode1
Neuro2Semantic: A Transfer Learning Framework for Semantic Reconstruction of Continuous Language from Human Intracranial EEGCode1
Rethinking Text-based Protein Understanding: Retrieval or LLM?Code1
Smoothie: Smoothing Diffusion on Token Embeddings for Text GenerationCode1
ThinkRec: Thinking-based recommendation via LLMCode1
U-SAM: An audio language Model for Unified Speech, Audio, and Music UnderstandingCode1
EEG-to-Text Translation: A Model for Deciphering Human Brain ActivityCode1
Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement LearningCode1
A Personalized Conversational Benchmark: Towards Simulating Personalized ConversationsCode1
WriteViT: Handwritten Text Generation with Vision TransformerCode1
FastCar: Cache Attentive Replay for Fast Auto-Regressive Video Generation on the EdgeCode1
MatTools: Benchmarking Large Language Models for Materials Science ToolsCode1
MELLM: Exploring LLM-Powered Micro-Expression Understanding Enhanced by Subtle Motion PerceptionCode1
Show:102550
← PrevPage 5 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified