SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 901950 of 1249 papers

TitleStatusHype
Speech Synthesis using EEG0
Fully-hierarchical fine-grained prosody modeling for interpretable speech synthesis0
Improving LPCNet-based Text-to-Speech with Linear Prediction-structured Mixture Density Network0
Eigenresiduals for improved Parametric Speech Synthesis0
Excitation-based Voice Quality Analysis and Modification0
Using a Pitch-Synchronous Residual Codebook for Hybrid HMM/Frame Selection Speech Synthesis0
A Deterministic plus Stochastic Model of the Residual Signal for Improved Parametric Speech Synthesis0
The Deterministic plus Stochastic Model of the Residual Signal and its Applications0
Learning Singing From Speech0
Voice Conversion for Whispered Speech Synthesis0
Towards Robust Neural Vocoding for Speech Generation: A Survey0
A Resource for Computational Experiments on MapudungunCode1
High-quality Speech Synthesis Using Super-resolution Mel-Spectrogram0
WaveFlow: A Compact Flow-based Model for Raw AudioCode1
Dynamic Prosody Generation for Speech Synthesis using Linguistics-Driven Acoustic Embedding Selection0
即時中文語音合成系統 (Real-Time Mandarin Speech Synthesis System)0
Designing the Next Generation of Intelligent Personal Robotic Assistants for the Physically Impaired0
Using VAEs and Normalizing Flows for One-shot Text-To-Speech Synthesis of Expressive Speech0
Jejueo Datasets for Machine Translation and Speech SynthesisCode0
Cross-lingual Multi-speaker Text-to-speech Synthesis for Voice Cloning without Using Parallel Corpus for Unseen Speakers0
Independent and automatic evaluation of acoustic-to-articulatory inversion modelsCode0
A unified sequence-to-sequence front-end model for Mandarin text-to-speech synthesis0
Incremental Text-to-Speech Synthesis with Prefix-to-Prefix Framework0
ASVspoof 2019: A large-scale public database of synthesized, converted and replayed speech0
What does a network layer hear? Analyzing hidden representations of end-to-end ASR through speech synthesisCode0
Replay Spoofing Countermeasure Using Autoencoder and Siamese Network on ASVspoof 2019 Challenge0
Spoofing Speaker Verification Systems with Deep Multi-speaker Text-to-speech SynthesisCode0
Effect of choice of probability distribution, randomness, and search methods for alignment modeling in sequence-to-sequence text-to-speech synthesis using hard alignment0
Transferring neural speech waveform synthesizers to musical instrument sounds generation0
Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramCode2
Location-Relative Attention Mechanisms For Robust Long-Form Speech SynthesisCode0
Using Speech Synthesis to Train End-to-End Spoken Language Understanding ModelsCode2
The Theory behind Controllable Expressive Speech Synthesis: a Cross-disciplinary Approach0
MelGAN: Generative Adversarial Networks for Conditional Waveform SynthesisCode1
Semi-Supervised Generative Modeling for Controllable Speech Synthesis0
即時中文語音合成系統(Real-Time Mandarin Speech Synthesis System)0
應用文脈分析於中英夾雜語音合成系統(Linguistic Analysis for English/Mandarin Speech Synthesis System)0
Using NLG for speech synthesis of mathematical sentences0
Attention Forcing for Sequence-to-sequence Model Training0
High Fidelity Speech Synthesis with Adversarial NetworksCode0
Disentangling Speech and Non-Speech Components for Building Robust Acoustic Models from Found DataCode0
Speech Recognition with Augmented Synthesized Speech0
Modular Meta-Learning with Shrinkage0
Evaluating Long-form Text-to-Speech: Comparing the Ratings of Sentences and Paragraphs0
DurIAN: Duration Informed Attention Network For Multimodal SynthesisCode0
Maximizing Mutual Information for TacotronCode0
Neural Harmonic-plus-Noise Waveform Model with Trainable Maximum Voice Frequency for Text-to-Speech Synthesis0
Unpaired Image-to-Speech Synthesis with Multimodal Information BottleneckCode0
DNN-based Speaker Embedding Using Subjective Inter-speaker Similarity for Multi-speaker Modeling in Speech Synthesis0
Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice CloningCode3
Show:102550
← PrevPage 19 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified