SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 851900 of 1249 papers

TitleStatusHype
Decoupled Pronunciation and Prosody Modeling in Meta-Learning-Based Multilingual Speech Synthesis0
DeepA: A Deep Neural Analyzer For Speech And Singing Vocoding0
Deep Denoising Auto-encoder for Statistical Speech Synthesis0
Deep Encoder-Decoder Models for Unsupervised Learning of Controllable Speech Synthesis0
Deep Feed-forward Sequential Memory Networks for Speech Synthesis0
Toward a Web-based Speech Corpus for Algerian Dialectal Arabic Varieties0
Towards Accurate Lip-to-Speech Synthesis in-the-Wild0
Towards a practical lip-to-speech conversion system using deep neural networks and mobile application frontend0
Towards Expressive Speaking Style Modelling with Hierarchical Context Information for Mandarin Speech Synthesis0
Towards Flow-Matching-based TTS without Classifier-Free Guidance0
Towards Fully Automatic Annotation of Audio Books for TTS0
Towards Improving NAM-to-Speech Synthesis Intelligibility using Self-Supervised Speech Models0
Towards Multilingual Conversations in the Medical Domain: Development of Multilingual Medical Data and A Network-based ASR System0
Towards Multi-Scale Style Control for Expressive Speech Synthesis0
Towards Natural Bilingual and Code-Switched Speech Synthesis Based on Mix of Monolingual Recordings and Cross-Lingual Voice Conversion0
Towards Personalised Synthesised Voices for Individuals with Vocal Disabilities: Voice Banking and Reconstruction0
Towards Robust Neural Vocoding for Speech Generation: A Survey0
Towards Spontaneous Style Modeling with Semi-supervised Pre-training for Conversational Text-to-Speech Synthesis0
Towards Transfer Learning for End-to-End Speech Synthesis from Deep Pre-Trained Language Models0
Towards Universal Speech Discrete Tokens: A Case Study for ASR and TTS0
Towards Zero-Shot Text-To-Speech for Arabic Dialects0
Training Generative Adversarial Network-Based Vocoder with Limited Data Using Augmentation-Conditional Discriminator0
Training Wake Word Detection with Synthesized Speech Data on Confusion Words0
Trans-disciplinary spoken language processing studies for scientific understanding of second language learner's characteristics0
Transferring neural speech waveform synthesizers to musical instrument sounds generation0
Transformer-based Models of Text Normalization for Speech Applications0
Transformer-Based Speech Synthesizer Attribution in an Open Set Scenario0
Transformers in Speech Processing: A Survey0
Transformer VQ-VAE for Unsupervised Unit Discovery and Speech Synthesis: ZeroSpeech 2020 Challenge0
Transplantation of Conversational Speaking Style with Interjections in Sequence-to-Sequence Speech Synthesis0
Triple M: A Practical Text-to-speech Synthesis System With Multi-guidance Attention And Multi-band Multi-time LPCNet0
TTS-by-TTS 2: Data-selective augmentation for neural speech synthesis using ranking support vector machine with variational autoencoder0
TTS-Transducer: End-to-End Speech Synthesis with Neural Transducer0
ULex: new data models and a mobile environment for corpus enrichment.0
Ultra-lightweight Neural Differential DSP Vocoder For High Quality Speech Synthesis0
UmbraTTS: Adapting Text-to-Speech to Environmental Contexts with Flow Matching0
Uncovering Latent Style Factors for Expressive Speech Synthesis0
UniFLG: Unified Facial Landmark Generator from Text or Speech0
UniTTS: Residual Learning of Unified Embedding Space for Speech Style Control0
Universal Neural Vocoding with Parallel WaveNet0
Unsupervised acoustic unit discovery for speech synthesis using discrete latent-variable neural networks0
Unsupervised Multi-scale Expressive Speaking Style Modeling with Hierarchical Context Information for Audiobook Speech Synthesis0
Unsupervised Quantized Prosody Representation for Controllable Speech Synthesis0
Unsupervised Style and Content Separation by Minimizing Mutual Information for Speech Synthesis0
Unsupervised word-level prosody tagging for controllable speech synthesis0
Using a machine learning model to assess the complexity of stress systems0
Using a Pitch-Synchronous Residual Codebook for Hybrid HMM/Frame Selection Speech Synthesis0
Using Audio Books for Training a Text-to-Speech System0
Using GANs to Synthesise Minimum Training Data for Deepfake Generation0
Using multiple reference audios and style embedding constraints for speech synthesis0
Show:102550
← PrevPage 18 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified