SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 14511500 of 5335 papers

TitleStatusHype
Integrate the Essence and Eliminate the Dross: Fine-Grained Self-Consistency for Free-Form Language GenerationCode0
Annotating FrameNet via Structure-Conditioned Language GenerationCode0
Is Multilingual BERT Fluent in Language Generation?Code0
Learning to Generate Compositional Color DescriptionsCode0
Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG EvaluationCode0
Defending Against Neural Fake NewsCode0
Improving Variational Autoencoder for Text Modelling with Timestep-Wise RegularisationCode0
Incentivizing Quality Text Generation via Statistical ContractsCode0
BatchGEMBA: Token-Efficient Machine Translation Evaluation with Batched Prompting and Prompt CompressionCode0
Arithmetic-Based Pretraining -- Improving Numeracy of Pretrained Language ModelsCode0
Disentangling Preference Representation and Text Generation for Efficient Individual Preference AlignmentCode0
DisGeM: Distractor Generation for Multiple Choice Questions with Span MaskingCode0
Improving RAG for Personalization with Author Features and Contrastive ExamplesCode0
DeepTextMark: A Deep Learning-Driven Text Watermarking Approach for Identifying Large Language Model Generated TextCode0
Improving Specificity in Review Response Generation with Data-Driven Data FilteringCode0
Improving User Controlled Table-To-Text Generation RobustnessCode0
ReFusion: Improving Natural Language Understanding with Computation-Efficient Retrieval Representation FusionCode0
Deep Residual Output Layers for Neural Language GenerationCode0
Deep Reinforcement Learning: An OverviewCode0
Distributional Discrepancy: A Metric for Unconditional Text GenerationCode0
An Empirical Study of In-context Learning in LLMs for Machine TranslationCode0
Improving Fluency in Narrative Text Generation With Grammatical Transformations and Probabilistic ParsingCode0
Improving Language Generation with Sentence Coherence ObjectiveCode0
In-Context Learning for Preserving Patient Privacy: A Framework for Synthesizing Realistic Patient Portal MessagesCode0
Improved Document Modelling with a Neural Discourse ParserCode0
Improved Variational Autoencoders for Text Modeling using Dilated ConvolutionsCode0
Deep Image-to-Recipe TranslationCode0
Implicit Premise Generation with Discourse-aware Commonsense Knowledge ModelsCode0
IMPersona: Evaluating Individual Level LM ImpersonationCode0
Implicit Deep Latent Variable Models for Text GenerationCode0
Deep Copycat Networks for Text-to-Text GenerationCode0
Image Content Generation with Causal ReasoningCode0
Identifying Informational Sources in News ArticlesCode0
Blacks is to Anger as Whites is to Joy? Understanding Latent Affective Bias in Large Pre-trained Neural Language ModelsCode0
DnDScore: Decontextualization and Decomposition for Factuality Verification in Long-Form Text GenerationCode0
Do Boat and Ocean Suggest Beach? Dialogue Summarization with External KnowledgeCode0
IGD: Token Decisiveness Modeling via Information Gain in LLMs for Personalized RecommendationCode0
AAKT: Enhancing Knowledge Tracing with Alternate Autoregressive ModelingCode0
HypoEval: Hypothesis-Guided Evaluation for Natural Language GenerationCode0
IIT (BHU) Varanasi at MSR-SRST 2018: A Language Model Based Approach for Natural Language GenerationCode0
Human Speech Perception in Noise: Can Large Language Models Paraphrase to Improve It?Code0
DecompEval: Evaluating Generated Texts as Unsupervised Decomposed Question AnsweringCode0
Decoding the End-to-end Writing Trajectory in Scholarly ManuscriptsCode0
Human vs Automatic Metrics: on the Importance of Correlation DesignCode0
HU at SemEval-2024 Task 8A: Can Contrastive Learning Learn Embeddings to Detect Machine-Generated Text?Code0
Humane Speech Synthesis through Zero-Shot Emotion and Disfluency GenerationCode0
How You Prompt Matters! Even Task-Oriented Constraints in Instructions Affect LLM-Generated Text DetectionCode0
BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language GenerationCode0
An Auto-Encoder Matching Model for Learning Utterance-Level Semantic Dependency in Dialogue GenerationCode0
HTSS: A Novel Hybrid Text Summarisation and Simplification ArchitectureCode0
Show:102550
← PrevPage 30 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified