SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 24512500 of 5335 papers

TitleStatusHype
RSAdapter: Adapting Multimodal Models for Remote Sensing Visual Question AnsweringCode0
Understanding Retrieval Augmentation for Long-Form Question Answering0
InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text GenerationCode0
Exploring Automatic Evaluation Methods based on a Decoder-based LLM for Text Generation0
Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression0
Large Language Models can Contrastively Refine their Generation for Better Sentence Representation LearningCode0
Automated Evaluation of Personalized Text Generation using Large Language Models0
DiffuCom: A novel diffusion model for comment generation0
DemoSG: Demonstration-enhanced Schema-guided Generation for Low-resource Event Extraction0
One-Shot Sensitivity-Aware Mixed Sparsity Pruning for Large Language ModelsCode0
Efficient Model-Agnostic Multi-Group Equivariant Networks0
The Consensus Game: Language Model Generation via Equilibrium Search0
Dont Add, dont Miss: Effective Content Preserving Generation from Pre-Selected Text SpansCode0
Ziya-Visual: Bilingual Large Vision-Language Model via Multi-Task Instruction Tuning0
Evaluating The Effectiveness of Capsule Neural Network in Toxic Comment Classification using Pre-trained BERT EmbeddingsCode0
EIPE-text: Evaluation-Guided Iterative Plan Extraction for Long-Form Narrative Text Generation0
GraphextQA: A Benchmark for Evaluating Graph-Enhanced Large Language ModelsCode0
OpenLEAF: Open-Domain Interleaved Image-Text Generation and Evaluation0
MatChat: A Large Language Model and Application Service Platform for Materials Science0
The Temporal Structure of Language Processing in the Human Brain Corresponds to The Layered Hierarchy of Deep Language Models0
Guided Attention for Interpretable Motion CaptioningCode0
AutoAD II: The Sequel -- Who, When, and What in Movie Audio Description0
ReZG: Retrieval-Augmented Zero-Shot Counter Narrative Generation for Hate SpeechCode0
Task-Adaptive Tokenization: Enhancing Long-Form Text Generation Efficacy in Mental Health and BeyondCode0
A Bias-Variance-Covariance Decomposition of Kernel Scores for Generative ModelsCode0
Exploring the Maze of Multilingual Modeling0
Factuality Challenges in the Era of Large Language Models0
Do Large Language Models Know about Facts?0
RAC-BERT: Character Radical Enhanced BERT for Ancient ChineseCode0
Video-Teller: Enhancing Cross-Modal Generation with Fusion and Decoupling0
Improving the Reliability of Large Language Models by Leveraging Uncertainty-Aware In-Context Learning0
Learning Personalized Alignment for Evaluating Open-ended Text Generation0
InstructProtein: Aligning Human and Protein Language via Knowledge Instruction0
Expedited Training of Visual Conditioned Language Generation via Redundancy ReductionCode0
Automatic and Human-AI Interactive Text Generation0
Controllable Multi-document Summarization: Coverage & Coherence Intuitive Policy with Large Language Model Based Rewards0
Towards Feasible Counterfactual Explanations: A Taxonomy Guided Template-based NLG MethodCode0
Large Language Models Cannot Self-Correct Reasoning Yet0
Controlling Topic-Focus Articulation in Meaning-to-Text Generation using Graph Neural Networks0
Synthetic Data Generation in Low-Resource Settings via Fine-Tuning of Large Language Models0
Error Norm Truncation: Robust Training in the Presence of Data Noise for Text Generation Models0
A Review of Digital Learning Environments for Teaching Natural Language Processing in K-12 Education0
Enabling Language Models to Implicitly Learn Self-Improvement0
Improving Emotional Expression and Cohesion in Image-Based Playlist Description and Music Topics: A Continuous Parameterization Approach0
GraphText: Graph Reasoning in Text SpaceCode0
On the Safety of Open-Sourced Large Language Models: Does Alignment Really Prevent Them From Being Misused?0
A Comparative Study of Training Objectives for Clarification Facet GenerationCode0
Understanding In-Context Learning from RepetitionsCode0
Learning to Rewrite Prompts for Personalized Text Generation0
Marathi-English Code-mixed Text Generation0
Show:102550
← PrevPage 50 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified