SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1601–1650 of 5335 papers

TitleStatusHype
Magnitude Pruning of Large Pretrained Transformer Models with a Mixture Gaussian Prior—0
P-Masking: Power Law Masking Improves Multi-attribute Controlled Generation—0
Mind the Gap: A Generalized Approach for Cross-Modal Embedding Alignment—0
Private Synthetic Text Generation with Diffusion ModelsCode0
Linguistics Theory Meets LLM: Code-Switched Text Generation via Equivalence Constrained Large Language ModelsCode0
CFSafety: Comprehensive Fine-grained Safety Assessment for LLMs—0
Personalization of Large Language Models: A Survey—0
BENCHAGENTS: Automated Benchmark Creation with Agent Interaction—0
Gender Bias in LLM-generated Interview Responses—0
Diffusion-nested Auto-Regressive Synthesis of Heterogeneous Tabular Data—0
UFT: Unifying Fine-Tuning of SFT and RLHF/DPO/UNA through a Generalized Implicit Reward Function—0
ADLM -- stega: A Universal Adaptive Token Selection Algorithm for Improving Steganographic Text Quality via Information Entropy—0
EoRA: Training-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation—0
Graph-based Uncertainty Metrics for Long-form Language Model OutputsCode0
Energy-Based Diffusion Language Models for Text Generation—0
R^3AG: First Workshop on Refined and Reliable Retrieval Augmented Generation—0
Maintaining Informative Coherence: Migrating Hallucinations in Large Language Models via Absorbing Markov Chains—0
Dynamic layer selection in decoder-only transformersCode0
Humanizing the Machine: Proxy Attacks to Mislead LLM Detectors—0
Investigating the Role of Prompting and External Tools in Hallucination Rates of Large Language Models—0
LLM Tree Search—0
kNN For Whisper And Its Effect On Bias And Speaker Adaptation—0
Towards Better Open-Ended Text Generation: A Multicriteria Evaluation FrameworkCode0
RSA-Control: A Pragmatics-Grounded Lightweight Controllable Text Generation FrameworkCode0
Towards Visual Text Design Transfer Across Languages—0
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies—0
Hierarchical Multimodal LLMs with Semantic Space Alignment for Enhanced Time Series Classification—0
Large Language Models Engineer Too Many Simple Features For Tabular DataCode0
Multilingual Hallucination Gaps in Large Language Models—0
Benchmarking Foundation Models on Exceptional Cases: Dataset Creation and ValidationCode0
LMLPA: Language Model Linguistic Personality Assessment—0
Large Language Models Still Exhibit Bias in Long Text—0
Generation of Indian Sign Language Letters, Numbers, and WordsCode0
PerspectiveNet: Multi-View Perception for Dynamic Scene Understanding—0
Beyond Retrieval: Generating Narratives in Conversational Recommender Systems—0
Enhancing Answer Attribution for Faithful Text Generation with Large Language Models—0
RKadiyala at SemEval-2024 Task 8: Black-Box Word-Level Text Boundary Detection in Partially Machine Generated Texts—0
Large Language Models in Computer Science Education: A Systematic Literature ReviewCode0
Natural Language Processing for Human Resources: A SurveyCode0
Resource-Efficient Medical Report Generation using Large Language Models—0
When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge?—0
ConTReGen: Context-driven Tree-structured Retrieval for Open-domain Long-form Text Generation—0
BrainECHO: Semantic Brain Signal Decoding through Vector-Quantized Spectrogram Reconstruction for Whisper-Enhanced Text Generation—0
Theoretical Aspects of Bias and Diversity in Minimum Bayes Risk DecodingCode0
Improving Vector-Quantized Image Modeling with Latent Consistency-Matching Diffusion—0
MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotations—0
A Lightweight Multi Aspect Controlled Text Generation Solution For Large Language Models—0
How Does Knowledge Selection Help Retrieval Augmented Generation?—0
AsymKV: Enabling 1-Bit Quantization of KV Cache with Layer-Wise Asymmetric Quantization Configurations—0
Meta-DiffuB: A Contextualized Sequence-to-Sequence Text Diffusion Model with Meta-ExplorationCode0
Show:102550
← PrevPage 33 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4—Unverified
2Beam search + A*esque (beam)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified