SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 5335 papers

TitleStatusHype
GEM: Empowering LLM for both Embedding Generation and Language Understanding—0
Backbone Augmented Training for Adaptations—0
Watermarking Degrades Alignment in Language Models: Analysis and MitigationCode0
Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMs—0
HyperSteer: Activation Steering at Scale with HypernetworksCode2
How do Pre-Trained Models Support Software Engineering? An Empirical Study in Hugging Face—0
The Reader is the Metric: How Textual Features and Reader Profiles Explain Conflicting Evaluations of AI Creative WritingCode0
Large Language Models for EEG: A Comprehensive Survey and Taxonomy—0
MoDA: Modulation Adapter for Fine-Grained Visual Grounding in Instructional MLLMs—0
Probing Neural Topology of Large Language ModelsCode0
EEG2TEXT-CN: An Exploratory Study of Open-Vocabulary Chinese Text-EEG Alignment via Large Language Model and Contrastive Learning on ChineseEEG—0
Neuro2Semantic: A Transfer Learning Framework for Semantic Reconstruction of Continuous Language from Human Intracranial EEGCode1
Multilingual Gloss-free Sign Language Translation: Towards Building a Sign Language Foundation ModelCode0
Adaptive LoRA Merge with Parameter Pruning for Low-Resource GenerationCode0
Guiding Generative Storytelling with Knowledge Graphs—0
A Survey of Generative Categories and Techniques in Multimodal Large Language Models—0
Large Language Model Meets Constraint Propagation—0
MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection—0
Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion ModelCode2
How Does Response Length Affect Long-Form FactualityCode0
Document-Level Text Generation with Minimum Bayes Risk Decoding using Optimal TransportCode0
Discriminative Policy Optimization for Token-Level Reward ModelsCode0
Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding—0
Universal Visuo-Tactile Video Understanding for Embodied Interaction—0
Enhancing Paraphrase Type Generation: The Impact of DPO and RLHF Evaluated with Human-Ranked DataCode0
Structured Memory Mechanisms for Stable Context Representation in Large Language Models—0
OmniAD: Detect and Understand Industrial Anomaly via Multimodal Reasoning—0
LLM-Driven E-Commerce Marketing Content Optimization: Balancing Creativity and Conversion—0
MAKIEval: A Multilingual Automatic WiKidata-based Framework for Cultural Awareness Evaluation for LLMsCode0
Rethinking Text-based Protein Understanding: Retrieval or LLM?Code1
Enhancing Visual Reliance in Text Generation: A Bayesian Perspective on Mitigating Hallucination in Large Vision-Language Models—0
Monocle: Hybrid Local-Global In-Context Evaluation for Long-Text Generation with Uncertainty-Based Active Learning—0
Adaptive Classifier-Free Guidance via Dynamic Low-Confidence MaskingCode0
Next Token Prediction Is a Dead End for Creativity—0
PatentScore: Multi-dimensional Evaluation of LLM-Generated Patent Claims—0
Smoothie: Smoothing Diffusion on Token Embeddings for Text GenerationCode1
Writing Like the Best: Exemplar-Based Expository Text GenerationCode0
Syn3DTxt: Embedding 3D Cues for Scene Text GenerationCode0
TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesis—0
U2-BENCH: Benchmarking Large Vision-Language Models on Ultrasound Understanding—0
Towards Practical Defect-Focused Automated Code Review—0
LIFEBench: Evaluating Length Instruction Following in Large Language ModelsCode0
CASTILLO: Characterizing Response Length Distributions of Large Language ModelsCode0
Can AI Read Between The Lines? Benchmarking LLMs On Financial Nuance—0
Exploring the Relationship Between Diversity and Quality in Ad Text Generation—0
Resource for Error Analysis in Text Simplification: New Taxonomy and Test Collection—0
Power-Law Decay Loss for Large Language Model Finetuning: Focusing on Information Sparsity to Enhance Generation QualityCode0
DuFFin: A Dual-Level Fingerprinting Framework for LLMs IP ProtectionCode0
AppealCase: A Dataset and Benchmark for Civil Case Appeal ScenariosCode0
Hallucinate at the Last in Long Response Generation: A Case Study on Long Document Summarization—0
Show:102550
← PrevPage 2 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4—Unverified
2Beam search + A*esque (beam)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified