SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 15511600 of 5335 papers

TitleStatusHype
Fine-Tuning LLMs with Noisy Data for Political Argument Generation and Post Guidance0
Dynamic Self-Distillation via Previous Mini-batches for Fine-tuning Small Language Models0
KL-geodesics flow matching with a novel sampling scheme0
Development of Pre-Trained Transformer-based Models for the Nepali Language0
Investigating Factuality in Long-Form Text Generation: The Roles of Self-Known and Self-Unknown0
Improving Factuality of 3D Brain MRI Report Generation with Paired Image-domain Retrieval and Text-domain Augmentation0
Two Heads Are Better Than One: Collaborative LLM Embodied Agents for Human-Robot Interaction0
MolMetaLM: a Physicochemical Knowledge-Guided Molecular Meta Language ModelCode0
Exploring Facets of Language Generation in the Limit0
Benchmarking Multimodal Models for Ukrainian Language Understanding Across Academic and Cultural Domains0
The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims0
GenBFA: An Evolutionary Optimization Approach to Bit-Flip Attacks on LLMs0
Knowledge Graphs, Large Language Models, and Hallucinations: An NLP Perspective0
Restructuring Tractable Probabilistic Circuits0
A Combined Encoder and Transformer Approach for Coherent and High-Quality Text Generation0
Do Captioning Metrics Reflect Music Semantic Alignment?0
FedCoLLM: A Parameter-Efficient Federated Co-tuning Framework for Large and Small Language Models0
Anatomy-Guided Radiology Report Generation with Pathology-Aware Regional Prompts0
Debias your Large Multi-Modal Model at Test-Time with Non-Contrastive Visual Attribute Steering0
LLaMA-Mesh: Unifying 3D Mesh Generation with Language Models0
Towards a Classification of Open-Source ML Models and Datasets for Software Engineering0
DAHL: Domain-specific Automated Hallucination Evaluation of Long-Form Text through a Benchmark Dataset in BiomedicineCode0
On the Limits of Language Generation: Trade-Offs Between Hallucination and Mode Collapse0
Direct Speech-to-Speech Neural Machine Translation: A Survey0
Trustful LLMs: Customizing and Grounding Text Generation with Knowledge Bases and Dual Decoders0
SCAR: Sparse Conditioned Autoencoders for Concept Detection and Steering in LLMsCode0
Benchmarking LLMs' Judgments with No Gold StandardCode0
Probabilistic Consensus through Ensemble Validation: A Framework for LLM Reliability0
Does This Summary Answer My Question? Modeling Query-Focused Summary Readers with Rational Speech ActsCode0
In-Context Learning for Preserving Patient Privacy: A Framework for Synthesizing Realistic Patient Portal MessagesCode0
Prompt-Efficient Fine-Tuning for GPT-like Deep Models to Reduce Hallucination and to Improve Reproducibility in Scientific Text Generation Using Stochastic Optimisation Techniques0
Quasi-random Multi-Sample Inference for Large Language Models0
FactLens: Benchmarking Fine-Grained Fact Verification0
Cyclic Vision-Language Manipulator: Towards Reliable and Fine-Grained Image Interpretation for Automated Report Generation0
Image2Text2Image: A Novel Framework for Label-Free Evaluation of Image-to-Text Generation with Text-to-Image Diffusion Models0
Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checking0
VTechAGP: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Models0
Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale0
Interactive Dialogue Agents via Reinforcement Learning on Hindsight Regenerations0
FMEA Builder: Expert Guided Text Generation for Equipment Maintenance0
Understanding the Effects of Human-written Paraphrases in LLM-generated Text DetectionCode0
Advanced RAG Models with Graph Structures: Optimizing Complex Knowledge Reasoning and Text Generation0
RAGulator: Lightweight Out-of-Context Detectors for Grounded Text Generation0
From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing0
Graph-DPEP: Decomposed Plug and Ensemble Play for Few-Shot Document Relation Extraction with Graph-of-Thoughts Reasoning0
One VLM to Keep it Learning: Generation and Balancing for Data-free Continual Visual Question Answering0
SPES: Spectrogram Perturbation for Explainable Speech-to-Text Generation0
Rate, Explain and Cite (REC): Enhanced Explanation and Attribution in Automatic Evaluation by Large Language ModelsCode0
TypeScore: A Text Fidelity Metric for Text-to-Image Generative Models0
Magnitude Pruning of Large Pretrained Transformer Models with a Mixture Gaussian Prior0
Show:102550
← PrevPage 32 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified