SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 13011350 of 5335 papers

TitleStatusHype
Grammatical vs Spelling Error Correction: An Investigation into the Responsiveness of Transformer-based Language Models using BART and MarianMT0
ToXCL: A Unified Framework for Toxic Speech Detection and ExplanationCode1
Dia-LLaMA: Towards Large Language Model-driven CT Report Generation0
The Frontier of Data Erasure: Machine Unlearning for Large Language Models0
Multi-Review Fusion-in-Context0
Hierarchical Skip Decoding for Efficient Autoregressive Text Generation0
Evidence-Driven Retrieval Augmented Response Generation for Online Misinformation0
Vi-Mistral-X: Building a Vietnamese Language Model with Advanced Continual Pre-training0
Train & Constrain: Phonologically Informed Tongue-Twister Generation from Topics and Paraphrases0
On Prompt Sensitivity of ChatGPT in Affective Computing0
Dynamic Reward Adjustment in Multi-Reward Reinforcement Learning for Counselor Reflection GenerationCode0
Mapping LLM Security Landscapes: A Comprehensive Stakeholder Risk Assessment Proposal0
LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language ModelsCode2
Automated Data Curation for Robust Language Model Fine-Tuning0
A Disease Labeler for Chinese Chest X-Ray Report Generation0
What Are Tools Anyway? A Survey from the Language Model Perspective0
Loops On Retrieval Augmented Generation (LoRAG)0
Zero-Shot Multi-task Hallucination Detection0
Evaluating Named Entity Recognition: A comparative analysis of mono- and multilingual transformer models on a novel Brazilian corporate earnings call transcripts datasetCode0
Embedded Named Entity Recognition using Probing ClassifiersCode0
DEE: Dual-stage Explainable Evaluation Method for Text Generation0
Reinforcement Learning with Token-level Feedback for Controllable Text GenerationCode1
ConvSDG: Session Data Generation for Conversational SearchCode0
Energy-Based Models with Applications to Speech and Language Processing0
Application of GPT Language Models for Innovation in Activities in University Teaching0
Whose Side Are You On? Investigating the Political Stance of Large Language ModelsCode0
DSP: Dynamic Sequence Parallelism for Multi-Dimensional TransformersCode7
DRAGIN: Dynamic Retrieval Augmented Generation based on the Information Needs of Large Language ModelsCode2
ProSwitch: Knowledge-Guided Instruction Tuning to Switch Between Professional and Non-Professional Responses0
Keyformer: KV Cache Reduction through Key Tokens Selection for Efficient Generative InferenceCode2
Detecting Hallucination and Coverage Errors in Retrieval Augmented Generation for Controversial Topics0
Generative Pretrained Structured Transformers: Unsupervised Syntactic Language Models at ScaleCode2
Duwak: Dual Watermarks in Large Language ModelsCode0
Truth-Aware Context Selection: Mitigating Hallucinations of Large Language Models Being Misled by Untruthful ContextsCode1
Harnessing Artificial Intelligence to Combat Online Hate: Exploring the Challenges and Opportunities of Large Language Models in Hate Speech Detection0
Triples-to-isiXhosa (T2X): Addressing the Challenges of Low-Resource Agglutinative Data-to-Text GenerationCode0
SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes0
Complex Reasoning over Logical Queries on Commonsense Knowledge GraphsCode1
Matrix-Transformation Based Low-Rank Adaptation (MTLoRA): A Brain-Inspired Method for Parameter-Efficient Fine-Tuning0
generAItor: Tree-in-the-Loop Text Generation for Language Model Explainability and Adaptation0
Textual Knowledge Matters: Cross-Modality Co-Teaching for Generalized Visual Class DiscoveryCode1
Evolving Knowledge Distillation with Large Language Models and Active Learning0
LSTM-Based Text Generation: A Study on Historical Datasets0
ALaRM: Align Language Models via Hierarchical Rewards ModelingCode1
Calibrating Large Language Models Using Their Generations OnlyCode1
Decoding the AI Pen: Techniques and Challenges in Detecting AI-Generated Text0
Defending Against Unforeseen Failure Modes with Latent Adversarial TrainingCode1
QAQ: Quality Adaptive Quantization for LLM KV CacheCode2
Enhancing Court View Generation with Knowledge Injection and GuidanceCode0
Advancing Chinese biomedical text mining with community challenges0
Show:102550
← PrevPage 27 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified