SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 801–850 of 5335 papers

TitleStatusHype
Mitigating Object Hallucinations via Sentence-Level Early InterventionCode1
Mix and Match: Learning-free Controllable Text Generation using Energy Language ModelsCode1
MMRel: A Relation Understanding Benchmark in the MLLM EraCode1
Mitigating Open-Vocabulary Caption HallucinationsCode1
Model Extraction and Adversarial Transferability, Your BERT is Vulnerable!Code1
Modeling Context in Referring ExpressionsCode1
Modern Methods for Text GenerationCode1
MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal AdapterCode1
Defending Against Backdoor Attacks in Natural Language GenerationCode1
Dependency-based Mixture Language ModelsCode1
AraGPT2: Pre-Trained Transformer for Arabic Language GenerationCode1
Calibrating Large Language Models Using Their Generations OnlyCode1
DeCap: Decoding CLIP Latents for Zero-Shot Captioning via Text-Only TrainingCode1
MTTN: Multi-Pair Text to Text Narratives for Prompt GenerationCode1
Data-to-text Generation with Variational Sequential PlanningCode1
Data-to-Text Generation with Iterative Text EditingCode1
AraT5: Text-to-Text Transformers for Arabic Language GenerationCode1
Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument ExtractionCode1
AR-Diffusion: Auto-Regressive Diffusion Model for Text GenerationCode1
Multimodal Fake News Detection: MFND Dataset and Shallow-Deep Multitask LearningCode1
Data-to-Text Bilingual GenerationCode1
A Frustratingly Simple Decoding Method for Neural Text GenerationCode1
Adapting a Language Model for Controlled Affective Text GenerationCode1
Can Diffusion Model Achieve Better Performance in Text Generation? Bridging the Gap between Training and Inference!Code1
NameGuess: Column Name Expansion for Tabular DataCode1
Data-to-text Generation with Macro PlanningCode1
Neural semi-Markov CRF for Monolingual Word AlignmentCode1
Can Knowledge Graphs Simplify Text?Code1
Deep Graph Convolutional Encoders for Structured Data to Text GenerationCode1
Can Language Models Make Fun? A Case Study in Chinese Comical CrosstalkCode1
Certifiably Robust RAG against Retrieval CorruptionCode1
Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and ReasoningCode1
Neuro2Semantic: A Transfer Learning Framework for Semantic Reconstruction of Continuous Language from Human Intracranial EEGCode1
Octree Transformer: Autoregressive 3D Shape Generation on Hierarchically Structured SequencesCode1
Almost AI, Almost Human: The Challenge of Detecting AI-Polished WritingCode1
Attribute First, then Generate: Locally-attributable Grounded Text GenerationCode1
Data-QuestEval: A Referenceless Metric for Data-to-Text Semantic EvaluationCode1
Diffusion Guided Language ModelingCode1
One SPRING to Rule Them Both: Symmetric AMR Semantic Parsing and Generation without a Complex PipelineCode1
On Faithfulness and Factuality in Abstractive SummarizationCode1
On Long-Tailed Phenomena in Neural Machine TranslationCode1
On Realization of Intelligent Decision-Making in the Real World: A Foundation Decision Model PerspectiveCode1
A Generative Language Model for Few-shot Aspect-Based Sentiment AnalysisCode1
DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-ExpertsCode1
On the Multilingual Ability of Decoder-based Pre-trained Language Models: Finding and Controlling Language-Specific NeuronsCode1
Cascaded Text Generation with Markov TransformersCode1
Cascade Reward Sampling for Efficient Decoding-Time AlignmentCode1
A Generative Model for Joint Natural Language Understanding and GenerationCode1
OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation MetricsCode1
ECG-Byte: A Tokenizer for End-to-End Generative Electrocardiogram Language ModelingCode1
Show:102550
← PrevPage 17 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4—Unverified
2Beam search + A*esque (beam)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified