SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 451500 of 1249 papers

TitleStatusHype
On granularity of prosodic representations in expressive text-to-speech0
Multilingual Multiaccented Multispeaker TTS with RADTTS0
Regeneration Learning: A Learning Paradigm for Data Generation0
Applying Automated Machine Translation to Educational Video Courses0
Neural Codec Language Models are Zero-Shot Text to Speech SynthesizersCode7
Towards Voice Reconstruction from EEG during Imagined SpeechCode1
ReVISE: Self-Supervised Speech Resynthesis With Visual Input for Universal and Generalized Speech Regeneration0
HMM-based data augmentation for E2E systems for building conversational speech synthesis systems0
ReVISE: Self-Supervised Speech Resynthesis with Visual Input for Universal and Generalized Speech Enhancement0
Investigation of Japanese PnG BERT language model in text-to-speech synthesis for pitch accent language0
Text-to-speech synthesis based on latent variable conversion using diffusion probabilistic model and variational autoencoder0
RWEN-TTS: Relation-aware Word Encoding Network for Natural Text-to-Speech SynthesisCode1
Style-Label-Free: Cross-Speaker Style Transfer by Quantized VAE and Speaker-wise Normalization in Speech Synthesis0
MnTTS2: An Open-Source Multi-Speaker Mongolian Text-to-Speech Synthesis DatasetCode1
VideoDubber: Machine Translation with Speech-Aware Length Control for Video Dubbing0
SNAC: Speaker-normalized affine coupling layer in flow-based architecture for zero-shot multi-speaker text-to-speech0
Controllable speech synthesis by learning discrete phoneme-level prosodic representations0
Contextual Expressive Text-to-Speech0
Efficient Incremental Text-to-Speech on GPUs0
PromptTTS: Controllable Text-to-Speech with Text DescriptionsCode0
Embedding a Differentiable Mel-cepstral Synthesis Filter to a Neural Speech Synthesis SystemCode1
LA-VocE: Low-SNR Audio-visual Speech Enhancement using Neural Vocoders0
Multi-Speaker Expressive Speech Synthesis via Multiple Factors Decoupling0
Audio Anti-spoofing Using a Simple Attention Module and Joint Optimization Based on Additive Angular Margin Loss and Meta-learning0
Towards Building Text-To-Speech Systems for the Next Billion UsersCode2
Grad-StyleSpeech: Any-speaker Adaptive Text-to-Speech Synthesis with Diffusion Models0
The Potential of Neural Speech Synthesis-based Data Augmentation for Personalized Speech Enhancement0
OverFlow: Putting flows on top of neural transducers for better TTSCode1
Semi-supervised learning for continuous emotional intensity controllable speech synthesis with disentangled representations0
PhaseAug: A Differentiable Augmentation for Speech Synthesis to Simulate One-to-Many MappingCode1
ERNIE-SAT: Speech and Text Joint Pretraining for Cross-Lingual Multi-Speaker Text-to-SpeechCode6
Accented Text-to-Speech Synthesis with a Conditional Variational AutoencoderCode1
Deliberation Networks and How to Train Them0
Self-Supervised Learning for Speech Enhancement through SynthesisCode0
SAMO: Speaker Attractor Multi-Center One-Class Learning for Voice Anti-SpoofingCode1
Predicting phoneme-level prosody latents using AR and flow-based Prior Networks for expressive speech synthesis0
Taiwanese-Accented Mandarin and English Multi-Speaker Talking-Face Synthesis System0
A Preliminary Study on Mandarin-Hakka neural machine translation using small-sized data0
Development of Mandarin-English code-switching speech synthesis system0
Technology Pipeline for Large Scale Cross-Lingual Dubbing of Lecture Videos into Multiple Indian Languages0
Learning utterance-level representations through token-level acoustic latents prediction for Expressive Speech Synthesis0
Adapter-Based Extension of Multi-Speaker Text-to-Speech Model for New Speakers0
Towards Developing State-of-the-Art TTS Synthesisers for 13 Indian Languages with Signal Processing aided Alignments0
Period VITS: Variational Inference with Explicit Pitch Modeling for End-to-end Emotional Speech Synthesis0
Evaluating context-invariance in unsupervised speech representationsCode0
FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech SynthesisCode1
Articulation GAN: Unsupervised modeling of articulatory learningCode1
A Fast and Accurate Pitch Estimation Algorithm Based on the Pseudo Wigner-Ville DistributionCode0
Virtuoso: Massive Multilingual Speech-Text Joint Semi-Supervised Learning for Text-To-Speech0
RedPen: Region- and Reason-Annotated Dataset of Unnatural Speech0
Show:102550
← PrevPage 10 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified