SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 801850 of 1249 papers

TitleStatusHype
Towards Natural Bilingual and Code-Switched Speech Synthesis Based on Mix of Monolingual Recordings and Cross-Lingual Voice Conversion0
Towards Personalised Synthesised Voices for Individuals with Vocal Disabilities: Voice Banking and Reconstruction0
Towards Robust Neural Vocoding for Speech Generation: A Survey0
Towards Spontaneous Style Modeling with Semi-supervised Pre-training for Conversational Text-to-Speech Synthesis0
Towards Transfer Learning for End-to-End Speech Synthesis from Deep Pre-Trained Language Models0
Towards Universal Speech Discrete Tokens: A Case Study for ASR and TTS0
Towards Zero-Shot Text-To-Speech for Arabic Dialects0
Training Generative Adversarial Network-Based Vocoder with Limited Data Using Augmentation-Conditional Discriminator0
Training Wake Word Detection with Synthesized Speech Data on Confusion Words0
Trans-disciplinary spoken language processing studies for scientific understanding of second language learner's characteristics0
Transferring neural speech waveform synthesizers to musical instrument sounds generation0
Transformer-based Models of Text Normalization for Speech Applications0
Transformer-Based Speech Synthesizer Attribution in an Open Set Scenario0
Transformers in Speech Processing: A Survey0
Transformer VQ-VAE for Unsupervised Unit Discovery and Speech Synthesis: ZeroSpeech 2020 Challenge0
Transplantation of Conversational Speaking Style with Interjections in Sequence-to-Sequence Speech Synthesis0
Triple M: A Practical Text-to-speech Synthesis System With Multi-guidance Attention And Multi-band Multi-time LPCNet0
TTS-by-TTS 2: Data-selective augmentation for neural speech synthesis using ranking support vector machine with variational autoencoder0
TTS-Transducer: End-to-End Speech Synthesis with Neural Transducer0
ULex: new data models and a mobile environment for corpus enrichment.0
Ultra-lightweight Neural Differential DSP Vocoder For High Quality Speech Synthesis0
UmbraTTS: Adapting Text-to-Speech to Environmental Contexts with Flow Matching0
Uncovering Latent Style Factors for Expressive Speech Synthesis0
UniFLG: Unified Facial Landmark Generator from Text or Speech0
UniTTS: Residual Learning of Unified Embedding Space for Speech Style Control0
Universal Neural Vocoding with Parallel WaveNet0
Unsupervised acoustic unit discovery for speech synthesis using discrete latent-variable neural networks0
Unsupervised Multi-scale Expressive Speaking Style Modeling with Hierarchical Context Information for Audiobook Speech Synthesis0
Unsupervised Quantized Prosody Representation for Controllable Speech Synthesis0
Unsupervised Style and Content Separation by Minimizing Mutual Information for Speech Synthesis0
Unsupervised word-level prosody tagging for controllable speech synthesis0
Using a machine learning model to assess the complexity of stress systems0
Using a Pitch-Synchronous Residual Codebook for Hybrid HMM/Frame Selection Speech Synthesis0
Using Audio Books for Training a Text-to-Speech System0
Using GANs to Synthesise Minimum Training Data for Deepfake Generation0
Using multiple reference audios and style embedding constraints for speech synthesis0
Using NLG for speech synthesis of mathematical sentences0
Using previous acoustic context to improve Text-to-Speech synthesis0
Using VAEs and Normalizing Flows for One-shot Text-To-Speech Synthesis of Expressive Speech0
Utterance-level Sequential Modeling For Deep Gaussian Process Based Speech Synthesis Using Simple Recurrent Unit0
Unsupervised TTS Acoustic Modeling for TTS with Conditional Disentangled Sequential VAE0
UzbekTagger: The rule-based POS tagger for Uzbek language0
VAKTA-SETU: A Speech-to-Speech Machine Translation Service in Select Indic Languages0
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers0
VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment0
VANI: Very-lightweight Accent-controllable TTS for Native and Non-native speakers with Identity Preservation0
VARA-TTS: Non-Autoregressive Text-to-Speech Synthesis based on Very Deep VAE with Residual Attention0
Variations prosodiques en synth\`ese par s\'election d'unit\'es: l'exemple des phrases interrogatives (Prosodic variations in unit-based speech synthesis: the example of interrogative sentences) [in French]0
VCVTS: Multi-speaker Video-to-Speech synthesis via cross-modal knowledge transfer from voice conversion0
vec2wav 2.0: Advancing Voice Conversion via Discrete Token Vocoders0
Show:102550
← PrevPage 17 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified