SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 251300 of 5335 papers

TitleStatusHype
MELLM: Exploring LLM-Powered Micro-Expression Understanding Enhanced by Subtle Motion PerceptionCode1
Adaptive Markup Language Generation for Contextually-Grounded Visual Document UnderstandingCode1
UniBiomed: A Universal Foundation Model for Grounded Biomedical Image InterpretationCode1
Reviving Any-Subset Autoregressive Models with Principled Parallel Sampling and Speculative DecodingCode1
LLMSR@XLLM25: Less is More: Enhancing Structured Multi-Agent Reasoning via Quality-Guided DistillationCode1
AlignRAG: Leveraging Critique Learning for Evidence-Sensitive Retrieval-Augmented ReasoningCode1
Understanding the Repeat Curse in Large Language Models from a Feature PerspectiveCode1
ReasonDrive: Efficient Visual Question Answering for Autonomous Vehicles with Reasoning-Enhanced Small Vision-Language ModelsCode1
Parameterized Synthetic Text Generation with SimpleStoriesCode1
Retrieval Augmented Generation with Collaborative Filtering for Personalized Text GenerationCode1
An Empirical Study of GPT-4o Image Generation CapabilitiesCode1
MSL: Not All Tokens Are What You Need for Tuning LLM as a RecommenderCode1
MEPNet: Medical Entity-balanced Prompting Network for Brain CT Report GenerationCode1
Lost-in-the-Middle in Long-Text Generation: Synthetic Dataset, Evaluation Framework, and MitigationCode1
Unleashing the Potential of Large Language Models for Text-to-Image Generation through Autoregressive Representation AlignmentCode1
Q-Filters: Leveraging QK Geometry for Efficient KV Cache CompressionCode1
Mapping 1,000+ Language Models via the Log-Likelihood VectorCode1
Almost AI, Almost Human: The Challenge of Detecting AI-Polished WritingCode1
Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMsCode1
A Cognitive Writing Perspective for Constrained Long-Form Text GenerationCode1
UniGuardian: A Unified Defense for Detecting Prompt Injection, Backdoor Attacks and Adversarial Attacks in Large Language ModelsCode1
Knowledge Graph-Driven Retrieval-Augmented Generation: Integrating Deepseek-R1 with Weaviate for Advanced Chatbot ApplicationsCode1
ReLearn: Unlearning via Learning for Large Language ModelsCode1
Exposing Numeracy Gaps: A Benchmark to Evaluate Fundamental Numerical Abilities in Large Language ModelsCode1
LANTERN++: Enhancing Relaxed Speculative Decoding with Static Tree Drafting for Visual Auto-regressive ModelsCode1
UniCMs: A Unified Consistency Model For Efficient Multimodal Generation and UnderstandingCode1
Polynomial, trigonometric, and tropical activationsCode1
Joint Localization and Activation Editing for Low-Resource Fine-TuningCode1
How to Select Datapoints for Efficient Human Evaluation of NLG Models?Code1
Pix2Cap-COCO: Advancing Visual Comprehension via Pixel-Level CaptioningCode1
Personalized Graph-Based Retrieval for Large Language ModelsCode1
Mitigating Hallucination for Large Vision Language Model by Inter-Modality Correlation Calibration DecodingCode1
Large Language Models Are Read/Write Policy-Makers for Simultaneous GenerationCode1
Facilitating large language model Russian adaptation with Learned Embedding PropagationCode1
A Survey of RWKVCode1
ECG-Byte: A Tokenizer for End-to-End Generative Electrocardiogram Language ModelingCode1
Typhoon 2: A Family of Open Text and Multimodal Thai Large Language ModelsCode1
AD-LLM: Benchmarking Large Language Models for Anomaly DetectionCode1
Concept Bottleneck Large Language ModelsCode1
Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-OasisCode1
OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text GenerationCode1
CROW: Eliminating Backdoors from Large Language Models via Internal Consistency RegularizationCode1
SAM Decoding: Speculative Decoding via Suffix AutomatonCode1
Bag of Design Choices for Inference of High-Resolution Masked Generative TransformerCode1
Towards Interpreting Language Models: A Case Study in Multi-Hop ReasoningCode1
Regress, Don't Guess -- A Regression-like Loss on Number Tokens for Language ModelsCode1
Explaining and Improving Contrastive Decoding by Extrapolating the Probabilities of a Huge and Hypothetical LMCode1
NeuGPT: Unified multi-modal Neural GPTCode1
Peptide-GPT: Generative Design of Peptides using Generative Pre-trained Transformers and Bio-informatic SupervisionCode1
Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and ReasoningCode1
Show:102550
← PrevPage 6 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4Unverified
2Beam search + A*esque (beam)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified