SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 801850 of 1249 papers

TitleStatusHype
Simultaneous Translation0
Effective Deep Learning Models for Automatic Diacritization of Arabic TextCode1
Emotion controllable speech synthesis using emotion-unlabeled dataset with the assistance of cross-domain speech emotion recognition0
Multi-stream Attention-based BLSTM with Feature Segmentation for Speech Emotion Recognition0
GraphSpeech: Syntax-Aware Graph Attention Network For Neural Speech Synthesis0
NU-GAN: High resolution neural upsampling with GAN0
An Investigation of the Relation Between Grapheme Embeddings and Pronunciation for Tacotron-based Systems0
Learning Disentangled Phone and Speaker Representations in a Semi-Supervised VQ-VAE ParadigmCode1
End-to-End Text-to-Speech using Latent Duration based on VQ-VAE0
Towards Natural Bilingual and Code-Switched Speech Synthesis Based on Mix of Monolingual Recordings and Cross-Lingual Voice Conversion0
The Zero Resource Speech Challenge 2020: Discovering discrete subword and word units0
HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech SynthesisCode2
Digital Voicing of Silent SpeechCode1
Neural Speech Synthesis for Estonian0
JSSS: free Japanese speech corpus for summarization and simplificationCode0
Automatic Arabic Dialect Identification Systems for Written Texts: A Survey0
Neural Face Models for Example-Based Visual Speech Synthesis0
DiffWave: A Versatile Diffusion Model for Audio SynthesisCode1
Analysis of artifacts in EEG signals for building BCIs0
Hierarchical Multi-Grained Generative Model for Expressive Speech Synthesis0
Conditional Spoken Digit Generation with StyleGAN0
Controllable neural text-to-speech synthesis using intuitive prosodic features0
Visual-speech Synthesis of Exaggerated Corrective Feedback0
What the Future Brings: Investigating the Impact of Lookahead for Incremental Neural TTS0
Silent Speech Interfaces for Speech Restoration: A Review0
Voice Conversion by Cascading Automatic Speech Recognition and Text-to-Speech Synthesis with Prosody Transfer0
WaveGrad: Estimating Gradients for Waveform GenerationCode1
A Preliminary Study on Deep Learning-based Chinese Text to Taiwanese Speech Synthesis System0
Real-Time Single-Speaker Taiwanese-Accented Mandarin Speech Synthesis System0
Dynamical Variational Autoencoders: A Comprehensive ReviewCode1
Efficient neural speech synthesis for low-resource languages through multilingual modeling0
Laughter Synthesis: Combining Seq2seq modeling with Transfer LearningCode1
Enhancing Speech Intelligibility in Text-To-Speech Synthesis using Speaking Style ConversionCode1
Prosody Learning Mechanism for Speech Synthesis System Without Text Length Limit0
Attentron: Few-Shot Text-to-Speech Utilizing Attention-Based Variable-Length EmbeddingCode1
Modeling Prosodic Phrasing with Multi-Task Learning in Tacotron-based TTS0
Improving Opus Low Bit Rate Quality with Neural Speech SynthesisCode2
Speaker Conditional WaveRNN: Towards Universal Neural Vocoder for Unseen Speaker and Recording ConditionsCode1
Deep MOS Predictor for Synthetic Speech Using Cluster-Based Modeling0
LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition0
SpeedySpeech: Efficient Neural Speech SynthesisCode1
Multi-speaker Text-to-speech Synthesis Using Deep Gaussian Processes0
Controllable Neural Prosody Synthesis0
A Machine of Few Words -- Interactive Speaker Recognition with Reinforcement Learning0
Phonological Features for 0-shot Multilingual Speech SynthesisCode1
Learning Boost by Exploiting the Auxiliary Task in Multi-task Domain0
A Spectral Energy Distance for Parallel Speech SynthesisCode1
Audiovisual Speech Synthesis using Tacotron20
One Model, Many Languages: Meta-learning for Multilingual Text-to-SpeechCode1
VocGAN: A High-Fidelity Real-time Vocoder with a Hierarchically-nested Adversarial NetworkCode1
Show:102550
← PrevPage 17 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified