SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 551600 of 1249 papers

TitleStatusHype
Automatic Evaluation of Turn-taking Cues in Conversational Speech Synthesis0
Creating Personalized Synthetic Voices from Post-Glossectomy Speech with Guided Diffusion Models0
Spoken Question Answering and Speech Continuation Using Spectrogram-Powered LLMCode0
ChatGPT-EDSS: Empathetic Dialogue Speech Synthesis Trained from ChatGPT-derived Context Word Embeddings0
CALLS: Japanese Empathetic Dialogue Speech Corpus of Complaint Handling and Attentive Listening in Customer Center0
ZET-Speech: Zero-shot adaptive Emotion-controllable Text-to-Speech Synthesis with Diffusion and Style-based Models0
Text Generation with Speech Synthesis for ASR Data Augmentation0
VAKTA-SETU: A Speech-to-Speech Machine Translation Service in Select Indic Languages0
MParrotTTS: Multilingual Multi-speaker Text to Speech Synthesis in Low Resource Setting0
A unified front-end framework for English text-to-speech synthesis0
Improving Generalization Ability of Countermeasures for New Mismatch Scenario by Combining Multiple Advanced Regularization TermsCode0
Empirical Analysis of Oral and Nasal Vowels of Konkani0
Zero-shot personalized lip-to-speech synthesis with face image based voice control0
Accented Text-to-Speech Synthesis with Limited Data0
M2-CTTS: End-to-End Multi-scale Multi-modal Conversational Text-to-Speech Synthesis0
A Review of Deep Learning Techniques for Speech Processing0
Zero-shot text-to-speech synthesis conditioned using self-supervised speech representation model0
Ensemble prosody prediction for expressive speech synthesis0
Text is All You Need: Personalizing ASR Models using Controllable Speech Synthesis0
Wave-U-Net Discriminator: Fast and Lightweight Discriminator for Generative Adversarial Network-Based Speech Synthesis0
A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AI0
Transformers in Speech Processing: A Survey0
QI-TTS: Questioning Intonation Control for Emotional Speech Synthesis0
Improving Prosody for Cross-Speaker Style Transfer by Semi-Supervised Style Extractor and Hierarchical Modeling in Speech Synthesis0
Controllable Prosody Generation With Partial Inputs0
VANI: Very-lightweight Accent-controllable TTS for Native and Non-native speakers with Identity Preservation0
Do Prosody Transfer Models Transfer Prosody?0
FoundationTTS: Text-to-Speech for ASR Customization with Generative Language Model0
DTW-SiameseNet: Dynamic Time Warped Siamese Network for Mispronunciation Detection and Correction0
ParrotTTS: Text-to-Speech synthesis by exploiting self-supervised representations0
On the Audio-visual Synchronization for Lip-to-Speech Synthesis0
UniFLG: Unified Facial Landmark Generator from Text or Speech0
ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpus0
CrossSpeech: Speaker-independent Acoustic Representation for Cross-lingual Speech Synthesis0
Fast and small footprint Hybrid HMM-HiFiGAN based system for speech synthesis in Indian languages0
Beyond Statistical Similarity: Rethinking Metrics for Deep Generative Models in Engineering Design0
UzbekTagger: The rule-based POS tagger for Uzbek language0
Time out of Mind: Generating Rate of Speech conditioned on emotion and speakerCode0
On granularity of prosodic representations in expressive text-to-speech0
Multilingual Multiaccented Multispeaker TTS with RADTTS0
Regeneration Learning: A Learning Paradigm for Data Generation0
Applying Automated Machine Translation to Educational Video Courses0
ReVISE: Self-Supervised Speech Resynthesis With Visual Input for Universal and Generalized Speech Regeneration0
HMM-based data augmentation for E2E systems for building conversational speech synthesis systems0
ReVISE: Self-Supervised Speech Resynthesis with Visual Input for Universal and Generalized Speech Enhancement0
Investigation of Japanese PnG BERT language model in text-to-speech synthesis for pitch accent language0
Text-to-speech synthesis based on latent variable conversion using diffusion probabilistic model and variational autoencoder0
Style-Label-Free: Cross-Speaker Style Transfer by Quantized VAE and Speaker-wise Normalization in Speech Synthesis0
SNAC: Speaker-normalized affine coupling layer in flow-based architecture for zero-shot multi-speaker text-to-speech0
VideoDubber: Machine Translation with Speech-Aware Length Control for Video Dubbing0
Show:102550
← PrevPage 12 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified