SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 201250 of 1249 papers

TitleStatusHype
DiffWave: A Versatile Diffusion Model for Audio SynthesisCode1
WaveGrad: Estimating Gradients for Waveform GenerationCode1
Dynamical Variational Autoencoders: A Comprehensive ReviewCode1
Laughter Synthesis: Combining Seq2seq modeling with Transfer LearningCode1
Enhancing Speech Intelligibility in Text-To-Speech Synthesis using Speaking Style ConversionCode1
Attentron: Few-Shot Text-to-Speech Utilizing Attention-Based Variable-Length EmbeddingCode1
Speaker Conditional WaveRNN: Towards Universal Neural Vocoder for Unseen Speaker and Recording ConditionsCode1
SpeedySpeech: Efficient Neural Speech SynthesisCode1
Phonological Features for 0-shot Multilingual Speech SynthesisCode1
A Spectral Energy Distance for Parallel Speech SynthesisCode1
One Model, Many Languages: Meta-learning for Multilingual Text-to-SpeechCode1
VocGAN: A High-Fidelity Real-time Vocoder with a Hierarchically-nested Adversarial NetworkCode1
NanoFlow: Scalable Normalizing Flows with Sublinear Parameter ComplexityCode1
WaveNODE: A Continuous Normalizing Flow for Speech SynthesisCode1
FastSpeech 2: Fast and High-Quality End-to-End Text to SpeechCode1
End-to-End Adversarial Text-to-SpeechCode1
PolyDL: Polyhedral Optimizations for Creation of High Performance DL primitivesCode1
Learning Individual Speaking Styles for Accurate Lip to Speech SynthesisCode1
Flowtron: an Autoregressive Flow-based Generative Network for Text-to-Speech SynthesisCode1
TTS-Portuguese Corpus: a corpus for speech synthesis in Brazilian PortugueseCode1
From Speaker Verification to Multispeaker Speech Synthesis, Deep Transfer with Feedback ConstraintCode1
Can Speaker Augmentation Improve Multi-Speaker End-to-End TTS?Code1
Perception of prosodic variation for speech synthesis using an unsupervised discrete representation of F0Code1
A Neuro-AI Interface for Evaluating Generative Adversarial NetworksCode1
A Resource for Computational Experiments on MapudungunCode1
WaveFlow: A Compact Flow-based Model for Raw AudioCode1
MelGAN: Generative Adversarial Networks for Conditional Waveform SynthesisCode1
Effective Use of Variational Embedding Capacity in Expressive End-to-End Speech SynthesisCode1
Synthetic-Neuroscore: Using A Neuro-AI Interface for Evaluating Generative Adversarial NetworksCode1
In Other News: A Bi-style Text-to-speech Model for Synthesizing Newscaster Voice with Limited DataCode1
Visualization and Interpretation of Latent Spaces for Controlling Expressive Speech Synthesis through Audio AnalysisCode1
Exploring Transfer Learning for Low Resource Emotional TTSCode1
Learning pronunciation from a foreign language in speech synthesis networksCode1
ClariNet: Parallel Wave Generation in End-to-End Text-to-SpeechCode1
FonBund: A Library for Combining Cross-lingual Phonological Segment DataCode1
Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with TacotronCode1
Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech SynthesisCode1
Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram PredictionsCode1
Tacotron: Towards End-to-End Speech SynthesisCode1
WaveNet: A Generative Model for Raw AudioCode1
NonverbalTTS: A Public English Corpus of Text-Aligned Nonverbal Vocalizations with Emotion Annotations for Text-to-Speech0
Speech Quality Assessment Model Based on Mixture of Experts: System-Level Performance Enhancement and Utterance-Level Challenge Analysis0
A Hybrid Machine Learning Framework for Optimizing Crop Selection via Agronomic and Economic Forecasting0
DeepGesture: A conversational gesture synthesis system based on emotions and semanticsCode0
OpusLM: A Family of Open Unified Speech Language Models0
An accurate and revised version of optical character recognition-based speech synthesis using LabVIEW0
Pushing the Performance of Synthetic Speech Detection with Kolmogorov-Arnold Networks and Self-Supervised Learning ModelsCode0
From Flat to Feeling: A Feasibility and Impact Study on Dynamic Facial Emotions in AI-Generated Avatars0
S2ST-Omni: An Efficient and Scalable Multilingual Speech-to-Speech Translation Framework via Seamless Speech-Text Alignment and Streaming Speech Generation0
UmbraTTS: Adapting Text-to-Speech to Environmental Contexts with Flow Matching0
Show:102550
← PrevPage 5 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified