SOTAVerified

Text-To-Speech Synthesis

Text-To-Speech Synthesis is a machine learning task that involves converting written text into spoken words. The goal is to generate synthetic speech that sounds natural and resembles human speech as closely as possible.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–25 of 332 papers

TitleStatusHype
ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow MatchingCode4
S2ST-Omni: An Efficient and Scalable Multilingual Speech-to-Speech Translation Framework via Seamless Speech-Text Alignment and Streaming Speech Generation—0
A Novel Data Augmentation Approach for Automatic Speaking Assessment on Opinion Expressions—0
CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speech—0
SALF-MOS: Speaker Agnostic Latent Features Downsampled for MOS Prediction—0
Chain-of-Thought Training for Open E2E Spoken Dialogue Systems—0
Zero-Shot Streaming Text to Speech Synthesis with Transducer and Auto-Regressive Modeling—0
Revival with Voice: Multi-modal Controllable Text-to-Speech Synthesis—0
Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language ModelsCode1
FMSD-TTS: Few-shot Multi-Speaker Multi-Dialect Text-to-Speech Synthesis for Ü-Tsang, Amdo and Kham Speech Dataset Generation—0
Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis—0
Lightweight End-to-end Text-to-speech Synthesis for low resource on-device applications—0
A Multi-Agent Framework for Automated Qinqiang Opera Script Generation Using Large Language Models—0
AutoStyle-TTS: Retrieval-Augmented Generation based Automatic Style Matching Text-to-Speech Synthesis—0
Pseudo-Autoregressive Neural Codec Language Models for Efficient Zero-Shot Text-to-Speech Synthesis—0
MoonCast: High-Quality Zero-Shot Podcast GenerationCode3
ASVspoof 5: Design, Collection and Validation of Resources for Spoofing, Deepfake, and Adversarial Attack Detection Using Crowdsourced Speech—0
PROEMO: Prompt-Driven Text-to-Speech Synthesis Based on Emotion and Intensity Control—0
Low-Resource Text-to-Speech Synthesis Using Noise-Augmented Training of ForwardTacotron—0
Probing Speaker-specific Features in Speaker Representations—0
Stable-TTS: Stable Speaker-Adaptive Text-to-Speech Synthesis via Prosody Prompting—0
Incremental Disentanglement for Environment-Aware Zero-Shot Text-to-Speech Synthesis—0
ProsodyFM: Unsupervised Phrasing and Intonation Control for Intelligible Speech Synthesis—0
Efficient Generative Modeling with Residual Vector Quantization-Based Tokens—0
Multimodal Latent Language Modeling with Next-Token DiffusionCode0
Show:102550
← PrevPage 1 of 14Next →
All datasetsLJSpeech20000 utterancesCMUDict 0.7bHUI speech corpusThorsten voice 21.02 neutralTrinity Speech-Gesture Dataset

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1NaturalSpeechAudio Quality MOS4.56—Unverified
2VITSAudio Quality MOS4.43—Unverified
3Grad-TTS + HiFiGAN (1000 steps)Audio Quality MOS4.37—Unverified
4FastSpeech 2 + HiFiGANAudio Quality MOS4.34—Unverified
5Glow-TTS + HiFiGANAudio Quality MOS4.34—Unverified
6FastSpeech 2 + HiFiGANAudio Quality MOS4.32—Unverified
7FastDiff (4 steps)Audio Quality MOS4.28—Unverified
8FastDiff-TTSAudio Quality MOS4.03—Unverified
9Transformer TTS (Mel + WaveGlow)Audio Quality MOS3.88—Unverified
10FastSpeech (Mel + WaveGlow)Audio Quality MOS3.84—Unverified
#ModelMetricClaimedVerifiedStatus
1Mia10-keyword Speech Commands dataset16—Unverified
#ModelMetricClaimedVerifiedStatus
1Token-Level Ensemble DistillationPhoneme Error Rate4.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score3.74—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score3.49—Unverified
#ModelMetricClaimedVerifiedStatus
1Match-TTSGMOS3.7—Unverified