SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 601650 of 1249 papers

TitleStatusHype
Applying Syntaxx2013Prosody Mapping Hypothesis and Prosodic Well-Formedness Constraints to Neural Sequence-to-Sequence Speech Synthesis0
Analysis of Voice Conversion and Code-Switching Synthesis Using VQ-VAE0
BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech SynthesisCode2
Towards Expressive Speaking Style Modelling with Hierarchical Context Information for Mandarin Speech Synthesis0
A Text-to-Speech Pipeline, Evaluation Methodology, and Initial Fine-Tuning Results for Child Speech Synthesis0
Modeling speech recognition and synthesis simultaneously: Encoding and decoding lexical and sublexical semantic information into speech with no direct access to speech data0
AutoTTS: End-to-End Text-to-Speech Synthesis through Differentiable Duration Modeling0
ECAPA-TDNN for Multi-speaker Text-to-speech SynthesisCode0
AdaVocoder: Adaptive Vocoder for Custom Voice0
A^3T: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and EditingCode1
Robotic Speech Synthesis: Perspectives on Interactions, Scenarios, and Ethics0
Whither the Priors for (Vocal) Interactivity?0
Text-free non-parallel many-to-many voice conversion using normalising flows0
iSTFTNet: Fast and Lightweight Mel-Spectrogram Vocoder Incorporating Inverse Short-Time Fourier TransformCode2
Generative Modeling for Low Dimensional Speech Attributes with Neural Spline FlowsCode2
Speaker Adaption with Intuitive Prosodic Features for Statistical Parametric Speech Synthesis0
End-to-end LPCNet: A Neural Vocoder With Fully-Differentiable LPC EstimationCode3
Neural Speech Synthesis on a Shoestring: Improving the Efficiency of LPCNetCode3
Improving Cross-lingual Speech Synthesis with Triplet Training Scheme0
VCVTS: Multi-speaker Video-to-Speech synthesis via cross-modal knowledge transfer from voice conversion0
Voice Filter: Few-shot text-to-speech speaker adaptation using voice conversion as a post-processing module0
Unsupervised word-level prosody tagging for controllable speech synthesis0
Partially Fake Audio Detection by Self-attention-based Fake Span Discovery0
Deep Performer: Score-to-Audio Music Performance Synthesis0
Conditional Diffusion Probabilistic Model for Speech EnhancementCode2
Transformer-based Models of Text Normalization for Speech Applications0
DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANs0
Zero-Shot Long-Form Voice Cloning with Dynamic Convolution Attention0
Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot InteractionCode0
Cross-Lingual Text-to-Speech Using Multi-Task Learning and Speaker Classifier Joint Training0
Deep Speech Synthesis from Articulatory Features0
A Practical Guide to Logical Access Voice Presentation Attack Detection0
Quasi-Taylor Samplers for Diffusion Generative Models based on Ideal Derivatives0
Multi-speaker Multi-style Text-to-speech Synthesis With Single-speaker Single-style Training Data Scenarios0
VocBench: A Neural Vocoder Benchmark for Speech SynthesisCode1
YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyoneCode1
整合語者嵌入向量與後置濾波器於提升個人化合成語音之語者相似度 (Incorporating Speaker Embedding and Post-Filter Network for Improving Speaker Similarity of Personalized Speech Synthesis System)0
Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidance0
Word-Level Style Control for Expressive, Non-attentive Speech Synthesis0
Prosodic Clustering for Phoneme-level Prosody Control in End-to-End Speech Synthesis0
High Quality Streaming Speech Synthesis with Low, Sentence-Length-Independent Latency0
Cross-lingual Low Resource Speaker Adaptation Using Phonological Features0
Modeling speech recognition and synthesis simultaneously: Encoding and decoding lexical and sublexical semantic information into speech with no access to speech data0
Speech Synthesis for Low Resource Languages using Transliteration Enabled Transfer Learning0
Improving Prosody for Unseen Texts in Speech Synthesis by Utilizing Linguistic Information and Noisy Data0
Meta-TTS: Meta-Learning for Few-Shot Speaker Adaptive Text-to-SpeechCode1
Synthesizing Speech from Intracranial Depth Electrodes using an Encoder-Decoder FrameworkCode1
Cross-lingual Transfer for Speech Processing using Acoustic Language SimilarityCode0
ITAcotron 2: Transfering English Speech Synthesis Architectures and Speech Features to ItalianCode1
fairseq Sˆ2: A Scalable and Integrable Speech Synthesis Toolkit0
Show:102550
← PrevPage 13 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified