SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 851900 of 1249 papers

TitleStatusHype
Versatile Speech Databases for High Quality Synthesis for Basque0
Vers une annotation automatique de corpus audio pour la synth\`ese de parole (Towards Fully Automatic Annotation of Audio Books for Text-To-Speech (TTS) Synthesis) [in French]0
VideoDubber: Machine Translation with Speech-Aware Length Control for Video Dubbing0
Video-to-Video Translation for Visual Speech Synthesis0
Virtuoso: Massive Multilingual Speech-Text Joint Semi-Supervised Learning for Text-To-Speech0
VisageSynTalk: Unseen Speaker Video-to-Speech Synthesis via Speech-Visage Feature Selection0
Visatronic: A Multimodal Decoder-Only Model for Speech Synthesis0
Visual-Aware Text-to-Speech0
VisualTTS: TTS with Accurate Lip-Speech Synchronization for Automatic Voice Over0
VNet: A GAN-based Multi-Tier Discriminator Network for Speech Synthesis Vocoders0
Vocoder-Based Speech Synthesis from Silent Videos0
Voice Cloning: a Multi-Speaker Text-to-Speech Synthesis Approach based on Transfer Learning0
Voice Conversion by Cascading Automatic Speech Recognition and Text-to-Speech Synthesis with Prosody Transfer0
Voice Conversion for Whispered Speech Synthesis0
Voice Conversion Using Sequence-to-Sequence Learning of Context Posterior Probabilities0
VoiceCraft-Dub: Automated Video Dubbing with Neural Codec Language Models0
VoiceDiT: Dual-Condition Diffusion Transformer for Environment-Aware Speech Synthesis0
Voice Filter: Few-shot text-to-speech speaker adaptation using voice conversion as a post-processing module0
VoxGenesis: Unsupervised Discovery of Latent Speaker Manifold for Speech Synthesis0
VoxHakka: A Dialectally Diverse Multi-speaker Text-to-Speech System for Taiwanese Hakka0
Voxtlm: unified decoder-only models for consolidating speech recognition/synthesis and speech/text continuation tasks0
VQalAttent: a Transparent Speech Generation Pipeline based on Transformer-learned VQ-VAE Latent Space0
VQTTS: High-Fidelity Text-to-Speech Synthesis with Self-Supervised VQ Acoustic Feature0
Wasserstein GAN and Waveform Loss-based Acoustic Model Training for Multi-speaker Text-to-Speech Synthesis Systems Using a WaveNet Vocoder0
WaveCycleGAN2: Time-domain Neural Post-filter for Speech Waveform Generation0
WaveCycleGAN: Synthetic-to-natural speech waveform conversion using cycle-consistent adversarial networks0
Waveform generation for text-to-speech synthesis using pitch-synchronous multi-scale generative adversarial networks0
Wave-U-Net Discriminator: Fast and Lightweight Discriminator for Generative Adversarial Network-Based Speech Synthesis0
WavThruVec: Latent speech representation as intermediate features for neural speech synthesis0
Weakly-supervised text-to-speech alignment confidence measure0
WebWOZ: A Platform for Designing and Conducting Web-based Wizard of Oz Experiments0
We Need Variations in Speech Generation: Sub-center Modelling for Speaker Embeddings0
What happens to diffusion model likelihood when your model is conditional?0
What the Future Brings: Investigating the Impact of Lookahead for Incremental Neural TTS0
Which Prosodic Features Matter Most for Pragmatics?0
Which Synthetic Voice Should I Choose for an Evocative Task?0
Whispered and Lombard Neural Speech Synthesis0
Whither the Priors for (Vocal) Interactivity?0
WinkTalk: a demonstration of a multimodal speech synthesis platform linking facial expressions to expressive synthetic voices0
WOLONet: Wave Outlooker for Efficient and High Fidelity Speech Synthesis0
Word-Level Style Control for Expressive, Non-attentive Speech Synthesis0
應用文脈分析於中英夾雜語音合成系統(Linguistic Analysis for English/Mandarin Speech Synthesis System)0
You Do Not Need More Data: Improving End-To-End Speech Recognition by Text-To-Speech Data Augmentation0
Zero-Shot Long-Form Voice Cloning with Dynamic Convolution Attention0
Zero-Shot Mono-to-Binaural Speech Synthesis0
Zero-shot personalized lip-to-speech synthesis with face image based voice control0
Zero-Shot Streaming Text to Speech Synthesis with Transducer and Auto-Regressive Modeling0
Zero-shot text-to-speech synthesis conditioned using self-supervised speech representation model0
ZET-Speech: Zero-shot adaptive Emotion-controllable Text-to-Speech Synthesis with Diffusion and Style-based Models0
整合語者嵌入向量與後置濾波器於提升個人化合成語音之語者相似度 (Incorporating Speaker Embedding and Post-Filter Network for Improving Speaker Similarity of Personalized Speech Synthesis System)0
Show:102550
← PrevPage 18 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified