SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 601–650 of 5335 papers

TitleStatusHype
Does This Summary Answer My Question? Modeling Query-Focused Summary Readers with Rational Speech ActsCode0
In-Context Learning for Preserving Patient Privacy: A Framework for Synthesizing Realistic Patient Portal MessagesCode0
Probabilistic Consensus through Ensemble Validation: A Framework for LLM Reliability—0
Quasi-random Multi-Sample Inference for Large Language Models—0
FactLens: Benchmarking Fine-Grained Fact Verification—0
Cyclic Vision-Language Manipulator: Towards Reliable and Fine-Grained Image Interpretation for Automated Report Generation—0
Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checking—0
Image2Text2Image: A Novel Framework for Label-Free Evaluation of Image-to-Text Generation with Text-to-Image Diffusion Models—0
Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale—0
FMEA Builder: Expert Guided Text Generation for Equipment Maintenance—0
VTechAGP: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Models—0
Interactive Dialogue Agents via Reinforcement Learning on Hindsight Regenerations—0
Towards Interpreting Language Models: A Case Study in Multi-Hop ReasoningCode1
Understanding the Effects of Human-written Paraphrases in LLM-generated Text DetectionCode0
RAGulator: Lightweight Out-of-Context Detectors for Grounded Text Generation—0
Advanced RAG Models with Graph Structures: Optimizing Complex Knowledge Reasoning and Text Generation—0
From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing—0
Graph-DPEP: Decomposed Plug and Ensemble Play for Few-Shot Document Relation Extraction with Graph-of-Thoughts Reasoning—0
A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and TrustworthinessCode3
One VLM to Keep it Learning: Generation and Balancing for Data-free Continual Visual Question Answering—0
Regress, Don't Guess -- A Regression-like Loss on Number Tokens for Language ModelsCode1
Rate, Explain and Cite (REC): Enhanced Explanation and Attribution in Automatic Evaluation by Large Language ModelsCode0
SPES: Spectrogram Perturbation for Explainable Speech-to-Text Generation—0
Explaining and Improving Contrastive Decoding by Extrapolating the Probabilities of a Huge and Hypothetical LMCode1
TypeScore: A Text Fidelity Metric for Text-to-Image Generative Models—0
Magnitude Pruning of Large Pretrained Transformer Models with a Mixture Gaussian Prior—0
E2E-AFG: An End-to-End Model with Adaptive Filtering for Retrieval-Augmented Generation—0
LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI AcceleratorsCode2
P-Masking: Power Law Masking Improves Multi-attribute Controlled Generation—0
Language Models can Self-Lengthen to Generate Long TextsCode2
Mind the Gap: A Generalized Approach for Cross-Modal Embedding Alignment—0
Private Synthetic Text Generation with Diffusion ModelsCode0
Linguistics Theory Meets LLM: Code-Switched Text Generation via Equivalence Constrained Large Language ModelsCode0
Personalization of Large Language Models: A Survey—0
BENCHAGENTS: Automated Benchmark Creation with Agent Interaction—0
CFSafety: Comprehensive Fine-grained Safety Assessment for LLMs—0
Energy-Based Diffusion Language Models for Text Generation—0
Diffusion-nested Auto-Regressive Synthesis of Heterogeneous Tabular Data—0
UFT: Unifying Fine-Tuning of SFT and RLHF/DPO/UNA through a Generalized Implicit Reward Function—0
Graph-based Uncertainty Metrics for Long-form Language Model OutputsCode0
NeuGPT: Unified multi-modal Neural GPTCode1
ADLM -- stega: A Universal Adaptive Token Selection Algorithm for Improving Steganographic Text Quality via Information Entropy—0
Gender Bias in LLM-generated Interview Responses—0
EoRA: Training-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation—0
Maintaining Informative Coherence: Migrating Hallucinations in Large Language Models via Absorbing Markov Chains—0
R^3AG: First Workshop on Refined and Reliable Retrieval Augmented Generation—0
Dynamic layer selection in decoder-only transformersCode0
Peptide-GPT: Generative Design of Peptides using Generative Pre-trained Transformers and Bio-informatic SupervisionCode1
Investigating the Role of Prompting and External Tools in Hallucination Rates of Large Language Models—0
Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and ReasoningCode1
Show:102550
← PrevPage 13 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified