SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 14011450 of 5335 papers

TitleStatusHype
Benchmarking Failures in Tool-Augmented Language ModelsCode0
Kernelized Bayesian Softmax for Text GenerationCode0
In-sample Curriculum Learning by Sequence Completion for Natural Language GenerationCode0
Integrating A.I. in Higher Education: Protocol for a Pilot Study with 'SAMCares: An Adaptive Learning Hub'Code0
InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text GenerationCode0
Differentially Private Knowledge Distillation via Synthetic Text GenerationCode0
Benchmarking and Improving Compositional Generalization of Multi-aspect Controllable Text GenerationCode0
Describing a Knowledge BaseCode0
Inherent Biases in Reference based Evaluation for Grammatical Error Correction and Text SimplificationCode0
Densely Connected Graph Convolutional Networks for Graph-to-Sequence LearningCode0
An Empirical Study of Validating Synthetic Data for Text-Based Person RetrievalCode0
Inherent Biases in Reference-based Evaluation for Grammatical Error CorrectionCode0
Belief-based Generation of Argumentative ClaimsCode0
In-Context Learning for Preserving Patient Privacy: A Framework for Synthesizing Realistic Patient Portal MessagesCode0
Incorporating Joint Embeddings into Goal-Oriented Dialogues with Multi-Task LearningCode0
Improving User Controlled Table-To-Text Generation RobustnessCode0
A Benchmark Corpus for the Detection of Automatically Generated Text in Academic PublicationsCode0
Improving Variational Autoencoder for Text Modelling with Timestep-Wise RegularisationCode0
Improving Specificity in Review Response Generation with Data-Driven Data FilteringCode0
Beautiful Images, Toxic Words: Understanding and Addressing Offensive Text in Generated ImagesCode0
Arithmetic-Based Pretraining -- Improving Numeracy of Pretrained Language ModelsCode0
Incentivizing Quality Text Generation via Statistical ContractsCode0
Incremental Beam Manipulation for Natural Language GenerationCode0
DeltaScore: Fine-Grained Story Evaluation with PerturbationsCode0
DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual EncodersCode0
An Empirical Study of Building a Strong Baseline for Constituency ParsingCode0
Improving Language Generation with Sentence Coherence ObjectiveCode0
ReFusion: Improving Natural Language Understanding with Computation-Efficient Retrieval Representation FusionCode0
Improving RAG for Personalization with Author Features and Contrastive ExamplesCode0
Knowledgeable Storyteller: A Commonsense-Driven Generative Model for Visual StorytellingCode0
Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG EvaluationCode0
Defending Against Neural Fake NewsCode0
BatchGEMBA: Token-Efficient Machine Translation Evaluation with Batched Prompting and Prompt CompressionCode0
Improved Document Modelling with a Neural Discourse ParserCode0
DeepTextMark: A Deep Learning-Driven Text Watermarking Approach for Identifying Large Language Model Generated TextCode0
Improved Variational Autoencoders for Text Modeling using Dilated ConvolutionsCode0
IMPersona: Evaluating Individual Level LM ImpersonationCode0
Beyond Single Concept Vector: Modeling Concept Subspace in LLMs with Gaussian DistributionCode0
Image Content Generation with Causal ReasoningCode0
Deep Residual Output Layers for Neural Language GenerationCode0
Implicit Deep Latent Variable Models for Text GenerationCode0
Large Language Models Engineer Too Many Simple Features For Tabular DataCode0
Deep Reinforcement Learning: An OverviewCode0
An Empirical Study of In-context Learning in LLMs for Machine TranslationCode0
Implicit Premise Generation with Discourse-aware Commonsense Knowledge ModelsCode0
Identifying Informational Sources in News ArticlesCode0
Hyperparameter-Free Approach for Faster Minimum Bayes Risk DecodingCode0
HypoEval: Hypothesis-Guided Evaluation for Natural Language GenerationCode0
Adversarial Mutual Information for Text GenerationCode0
IGD: Token Decisiveness Modeling via Information Gain in LLMs for Personalized RecommendationCode0
Show:102550
← PrevPage 29 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified