SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 901950 of 1249 papers

TitleStatusHype
Using NLG for speech synthesis of mathematical sentences0
Using previous acoustic context to improve Text-to-Speech synthesis0
Using VAEs and Normalizing Flows for One-shot Text-To-Speech Synthesis of Expressive Speech0
Utterance-level Sequential Modeling For Deep Gaussian Process Based Speech Synthesis Using Simple Recurrent Unit0
Unsupervised TTS Acoustic Modeling for TTS with Conditional Disentangled Sequential VAE0
UzbekTagger: The rule-based POS tagger for Uzbek language0
VAKTA-SETU: A Speech-to-Speech Machine Translation Service in Select Indic Languages0
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers0
VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment0
VANI: Very-lightweight Accent-controllable TTS for Native and Non-native speakers with Identity Preservation0
VARA-TTS: Non-Autoregressive Text-to-Speech Synthesis based on Very Deep VAE with Residual Attention0
Variations prosodiques en synth\`ese par s\'election d'unit\'es: l'exemple des phrases interrogatives (Prosodic variations in unit-based speech synthesis: the example of interrogative sentences) [in French]0
VCVTS: Multi-speaker Video-to-Speech synthesis via cross-modal knowledge transfer from voice conversion0
vec2wav 2.0: Advancing Voice Conversion via Discrete Token Vocoders0
Versatile Speech Databases for High Quality Synthesis for Basque0
Vers une annotation automatique de corpus audio pour la synth\`ese de parole (Towards Fully Automatic Annotation of Audio Books for Text-To-Speech (TTS) Synthesis) [in French]0
VideoDubber: Machine Translation with Speech-Aware Length Control for Video Dubbing0
Video-to-Video Translation for Visual Speech Synthesis0
Virtuoso: Massive Multilingual Speech-Text Joint Semi-Supervised Learning for Text-To-Speech0
VisageSynTalk: Unseen Speaker Video-to-Speech Synthesis via Speech-Visage Feature Selection0
Visatronic: A Multimodal Decoder-Only Model for Speech Synthesis0
Visual-Aware Text-to-Speech0
VisualTTS: TTS with Accurate Lip-Speech Synchronization for Automatic Voice Over0
VNet: A GAN-based Multi-Tier Discriminator Network for Speech Synthesis Vocoders0
Vocoder-Based Speech Synthesis from Silent Videos0
Voice Cloning: a Multi-Speaker Text-to-Speech Synthesis Approach based on Transfer Learning0
Voice Conversion by Cascading Automatic Speech Recognition and Text-to-Speech Synthesis with Prosody Transfer0
Voice Conversion for Whispered Speech Synthesis0
Voice Conversion Using Sequence-to-Sequence Learning of Context Posterior Probabilities0
VoiceCraft-Dub: Automated Video Dubbing with Neural Codec Language Models0
VoiceDiT: Dual-Condition Diffusion Transformer for Environment-Aware Speech Synthesis0
Voice Filter: Few-shot text-to-speech speaker adaptation using voice conversion as a post-processing module0
VoxGenesis: Unsupervised Discovery of Latent Speaker Manifold for Speech Synthesis0
VoxHakka: A Dialectally Diverse Multi-speaker Text-to-Speech System for Taiwanese Hakka0
Voxtlm: unified decoder-only models for consolidating speech recognition/synthesis and speech/text continuation tasks0
VQalAttent: a Transparent Speech Generation Pipeline based on Transformer-learned VQ-VAE Latent Space0
VQTTS: High-Fidelity Text-to-Speech Synthesis with Self-Supervised VQ Acoustic Feature0
Wasserstein GAN and Waveform Loss-based Acoustic Model Training for Multi-speaker Text-to-Speech Synthesis Systems Using a WaveNet Vocoder0
WaveCycleGAN2: Time-domain Neural Post-filter for Speech Waveform Generation0
WaveCycleGAN: Synthetic-to-natural speech waveform conversion using cycle-consistent adversarial networks0
Waveform generation for text-to-speech synthesis using pitch-synchronous multi-scale generative adversarial networks0
Wave-U-Net Discriminator: Fast and Lightweight Discriminator for Generative Adversarial Network-Based Speech Synthesis0
WavThruVec: Latent speech representation as intermediate features for neural speech synthesis0
Weakly-supervised text-to-speech alignment confidence measure0
WebWOZ: A Platform for Designing and Conducting Web-based Wizard of Oz Experiments0
We Need Variations in Speech Generation: Sub-center Modelling for Speaker Embeddings0
What happens to diffusion model likelihood when your model is conditional?0
What the Future Brings: Investigating the Impact of Lookahead for Incremental Neural TTS0
Which Prosodic Features Matter Most for Pragmatics?0
Which Synthetic Voice Should I Choose for an Evocative Task?0
Show:102550
← PrevPage 19 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified