SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 551600 of 1249 papers

TitleStatusHype
Deep Performer: Score-to-Audio Music Performance Synthesis0
Deep MOS Predictor for Synthetic Speech Using Cluster-Based Modeling0
A Unified Transformer-based Framework for Duplex Text Normalization0
Deep Learning the EEG Manifold for Phonological Categorization from Active Thoughts0
A Unified Speaker Adaptation Method for Speech Synthesis using Transcribed and Untranscribed Speech with Backpropagation0
Analysis of Voice Conversion and Code-Switching Synthesis Using VQ-VAE0
Accented Text-to-Speech Synthesis with Limited Data0
iSTFTNet2: Faster and More Lightweight iSTFT-Based Neural Vocoder Using 1D-2D CNN0
A unified sequence-to-sequence front-end model for Mandarin text-to-speech synthesis0
Analysis of artifacts in EEG signals for building BCIs0
Deep Feed-forward Sequential Memory Networks for Speech Synthesis0
A unified lexical processing framework based on the Margin Infused Relaxed Algorithm. A case study on the Romanian Language0
A Data-Driven Investigation of Noise-Adaptive Utterance Generation with Linguistic Modification0
AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios0
Deep Denoising Auto-encoder for Statistical Speech Synthesis0
DeepA: A Deep Neural Analyzer For Speech And Singing Vocoding0
A unified front-end framework for English text-to-speech synthesis0
Decoupled Pronunciation and Prosody Modeling in Meta-Learning-Based Multilingual Speech Synthesis0
Debatts: Zero-Shot Debating Text-to-Speech Synthesis0
A Unified Framework for Collecting Text-to-Speech Synthesis Datasets for 22 Indian Languages0
Analysis and Synthesis of Hypo and Hyperarticulated Speech0
Investigating gated recurrent neural networks for speech synthesis0
Augmenting Polish Automatic Speech Recognition System With Synthetic Data0
DART: Disentanglement of Accent and Speaker Representation in Multispeaker Text-to-Speech0
Analysing Shortcomings of Statistical Parametric Speech Synthesis0
Ctrl-P: Temporal Control of Prosodic Variation for Speech Synthesis0
Improving Prosody for Cross-Speaker Style Transfer by Semi-Supervised Style Extractor and Hierarchical Modeling in Speech Synthesis0
Cross-Utterance Conditioned VAE for Speech Generation0
Augmenting Images for ASR and TTS through Single-loop and Dual-loop Multimodal Chain Framework0
Accent conversion using discrete units with parallel data synthesized from controllable accented TTS0
Improving LPCNet-based Text-to-Speech with Linear Prediction-structured Mixture Density Network0
Improving homograph disambiguation with supervised machine learning0
CrossSpeech: Speaker-independent Acoustic Representation for Cross-lingual Speech Synthesis0
CrossSpeech++: Cross-lingual Speech Synthesis with Decoupled Language and Speaker Generation0
Improving Prosody for Unseen Texts in Speech Synthesis by Utilizing Linguistic Information and Noisy Data0
Improving Prosody Modelling with Cross-Utterance BERT Embeddings for End-to-end Speech Synthesis0
Improving Robustness of Diffusion-Based Zero-Shot Speech Synthesis via Stable Formant Generation0
Improving Robustness of LLM-based Speech Synthesis by Learning Monotonic Alignment0
DDOS: A MOS Prediction Framework utilizing Domain Adaptive Pre-training and Distribution of Opinion Scores0
Improving speech synthesis quality by reducing pitch peaks in the source recordings0
Improving Trajectory Modelling for DNN-based Speech Synthesis by using Stacked Bottleneck Features and Minimum Generation Error Training0
Incorporating speaker embedding and post-filter network for improving speaker similarity of personalized speech synthesis system0
Incremental Coordination: Attention-Centric Speech Production in a Physically Situated Conversational Agent0
Incremental Disentanglement for Environment-Aware Zero-Shot Text-to-Speech Synthesis0
Incremental FastPitch: Chunk-based High Quality Text to Speech0
Incremental Machine Speech Chain Towards Enabling Listening while Speaking in Real-time0
From Start to Finish: Latency Reduction Strategies for Incremental Speech Synthesis in Simultaneous Speech-to-Speech Translation0
Incremental Text-to-Speech Synthesis with Prefix-to-Prefix Framework0
Deep Encoder-Decoder Models for Unsupervised Learning of Controllable Speech Synthesis0
Improving Cross-lingual Speech Synthesis with Triplet Training Scheme0
Show:102550
← PrevPage 12 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified