SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 901–925 of 1249 papers

TitleStatusHype
Using NLG for speech synthesis of mathematical sentences—0
Using previous acoustic context to improve Text-to-Speech synthesis—0
Using VAEs and Normalizing Flows for One-shot Text-To-Speech Synthesis of Expressive Speech—0
Utterance-level Sequential Modeling For Deep Gaussian Process Based Speech Synthesis Using Simple Recurrent Unit—0
Unsupervised TTS Acoustic Modeling for TTS with Conditional Disentangled Sequential VAE—0
UzbekTagger: The rule-based POS tagger for Uzbek language—0
VAKTA-SETU: A Speech-to-Speech Machine Translation Service in Select Indic Languages—0
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers—0
VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment—0
VANI: Very-lightweight Accent-controllable TTS for Native and Non-native speakers with Identity Preservation—0
VARA-TTS: Non-Autoregressive Text-to-Speech Synthesis based on Very Deep VAE with Residual Attention—0
Variations prosodiques en synth\`ese par s\'election d'unit\'es: l'exemple des phrases interrogatives (Prosodic variations in unit-based speech synthesis: the example of interrogative sentences) [in French]—0
VCVTS: Multi-speaker Video-to-Speech synthesis via cross-modal knowledge transfer from voice conversion—0
vec2wav 2.0: Advancing Voice Conversion via Discrete Token Vocoders—0
Versatile Speech Databases for High Quality Synthesis for Basque—0
Vers une annotation automatique de corpus audio pour la synth\`ese de parole (Towards Fully Automatic Annotation of Audio Books for Text-To-Speech (TTS) Synthesis) [in French]—0
VideoDubber: Machine Translation with Speech-Aware Length Control for Video Dubbing—0
Video-to-Video Translation for Visual Speech Synthesis—0
Virtuoso: Massive Multilingual Speech-Text Joint Semi-Supervised Learning for Text-To-Speech—0
VisageSynTalk: Unseen Speaker Video-to-Speech Synthesis via Speech-Visage Feature Selection—0
Visatronic: A Multimodal Decoder-Only Model for Speech Synthesis—0
Visual-Aware Text-to-Speech—0
VisualTTS: TTS with Accurate Lip-Speech Synchronization for Automatic Voice Over—0
VNet: A GAN-based Multi-Tier Discriminator Network for Speech Synthesis Vocoders—0
Vocoder-Based Speech Synthesis from Silent Videos—0
Show:102550
← PrevPage 37 of 50Next →
All datasetsLibriTTSNorth American EnglishLJSpeechMandarin ChineseBlizzard Challenge 2013

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45—Unverified
2BigVGAN-v2PESQ4.36—Unverified
3EVA-GAN-bigPESQ4.35—Unverified
4PeriodWave + FreeUPESQ4.25—Unverified
5RFWavePESQ4.23—Unverified
6BigVSAN (w/ snakebeta)PESQ4.12—Unverified
7BigVSANPESQ4.12—Unverified
8EVA-GAN-basePESQ4.03—Unverified
9BigVGANPESQ4.03—Unverified
10VocosPESQ3.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53—Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34—Unverified
3WaveNet (L+F)Mean Opinion Score4.21—Unverified
4TacotronMean Opinion Score4—Unverified
5HMM-driven concatenativeMean Opinion Score3.86—Unverified
6LSTM-RNN parametricMean Opinion Score3.67—Unverified
7meansMean Opinion Score0—Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48—Unverified
2DiffWave LARGEMean Opinion Score4.44—Unverified
3Neural HMMMean Opinion Score3.24—Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68—Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08—Unverified
2LSTM-RNN parametricMean Opinion Score3.79—Unverified
3HMM-driven concatenativeMean Opinion Score3.47—Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39—Unverified
2SampleRNN (3-tier)NLL1.39—Unverified