SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 601–650 of 1249 papers

TitleStatusHype
Applying Syntaxx2013Prosody Mapping Hypothesis and Prosodic Well-Formedness Constraints to Neural Sequence-to-Sequence Speech Synthesis—0
Analysis of Voice Conversion and Code-Switching Synthesis Using VQ-VAE—0
BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech SynthesisCode2
Towards Expressive Speaking Style Modelling with Hierarchical Context Information for Mandarin Speech Synthesis—0
A Text-to-Speech Pipeline, Evaluation Methodology, and Initial Fine-Tuning Results for Child Speech Synthesis—0
Modeling speech recognition and synthesis simultaneously: Encoding and decoding lexical and sublexical semantic information into speech with no direct access to speech data—0
AutoTTS: End-to-End Text-to-Speech Synthesis through Differentiable Duration Modeling—0
ECAPA-TDNN for Multi-speaker Text-to-speech SynthesisCode0
AdaVocoder: Adaptive Vocoder for Custom Voice—0
A^3T: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and EditingCode1
Robotic Speech Synthesis: Perspectives on Interactions, Scenarios, and Ethics—0
Whither the Priors for (Vocal) Interactivity?—0
Text-free non-parallel many-to-many voice conversion using normalising flows—0
iSTFTNet: Fast and Lightweight Mel-Spectrogram Vocoder Incorporating Inverse Short-Time Fourier TransformCode2
Generative Modeling for Low Dimensional Speech Attributes with Neural Spline FlowsCode2
Speaker Adaption with Intuitive Prosodic Features for Statistical Parametric Speech Synthesis—0
End-to-end LPCNet: A Neural Vocoder With Fully-Differentiable LPC EstimationCode3
Neural Speech Synthesis on a Shoestring: Improving the Efficiency of LPCNetCode3
Improving Cross-lingual Speech Synthesis with Triplet Training Scheme—0
VCVTS: Multi-speaker Video-to-Speech synthesis via cross-modal knowledge transfer from voice conversion—0
Voice Filter: Few-shot text-to-speech speaker adaptation using voice conversion as a post-processing module—0
Unsupervised word-level prosody tagging for controllable speech synthesis—0
Partially Fake Audio Detection by Self-attention-based Fake Span Discovery—0
Deep Performer: Score-to-Audio Music Performance Synthesis—0
Conditional Diffusion Probabilistic Model for Speech EnhancementCode2
Transformer-based Models of Text Normalization for Speech Applications—0
DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANs—0
Zero-Shot Long-Form Voice Cloning with Dynamic Convolution Attention—0
Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot InteractionCode0
Cross-Lingual Text-to-Speech Using Multi-Task Learning and Speaker Classifier Joint Training—0
Deep Speech Synthesis from Articulatory Features—0
A Practical Guide to Logical Access Voice Presentation Attack Detection—0
Quasi-Taylor Samplers for Diffusion Generative Models based on Ideal Derivatives—0
Multi-speaker Multi-style Text-to-speech Synthesis With Single-speaker Single-style Training Data Scenarios—0
VocBench: A Neural Vocoder Benchmark for Speech SynthesisCode1
YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyoneCode1
整合語者嵌入向量與後置濾波器於提升個人化合成語音之語者相似度 (Incorporating Speaker Embedding and Post-Filter Network for Improving Speaker Similarity of Personalized Speech Synthesis System)—0
Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidance—0
Word-Level Style Control for Expressive, Non-attentive Speech Synthesis—0
Prosodic Clustering for Phoneme-level Prosody Control in End-to-End Speech Synthesis—0
High Quality Streaming Speech Synthesis with Low, Sentence-Length-Independent Latency—0
Cross-lingual Low Resource Speaker Adaptation Using Phonological Features—0
Modeling speech recognition and synthesis simultaneously: Encoding and decoding lexical and sublexical semantic information into speech with no access to speech data—0
Speech Synthesis for Low Resource Languages using Transliteration Enabled Transfer Learning—0
Improving Prosody for Unseen Texts in Speech Synthesis by Utilizing Linguistic Information and Noisy Data—0
Meta-TTS: Meta-Learning for Few-Shot Speaker Adaptive Text-to-SpeechCode1
Synthesizing Speech from Intracranial Depth Electrodes using an Encoder-Decoder FrameworkCode1
Cross-lingual Transfer for Speech Processing using Acoustic Language SimilarityCode0
ITAcotron 2: Transfering English Speech Synthesis Architectures and Speech Features to ItalianCode1
fairseq Sˆ2: A Scalable and Integrable Speech Synthesis Toolkit—0
Show:102550
← PrevPage 13 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45—Unverified
2BigVGAN-v2PESQ4.36—Unverified
3EVA-GAN-bigPESQ4.35—Unverified
4PeriodWave + FreeUPESQ4.25—Unverified
5RFWavePESQ4.23—Unverified
6BigVSAN (w/ snakebeta)PESQ4.12—Unverified
7BigVSANPESQ4.12—Unverified
8EVA-GAN-basePESQ4.03—Unverified
9BigVGANPESQ4.03—Unverified
10VocosPESQ3.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53—Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34—Unverified
3WaveNet (L+F)Mean Opinion Score4.21—Unverified
4TacotronMean Opinion Score4—Unverified
5HMM-driven concatenativeMean Opinion Score3.86—Unverified
6LSTM-RNN parametricMean Opinion Score3.67—Unverified
7meansMean Opinion Score0—Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48—Unverified
2DiffWave LARGEMean Opinion Score4.44—Unverified
3Neural HMMMean Opinion Score3.24—Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68—Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08—Unverified
2LSTM-RNN parametricMean Opinion Score3.79—Unverified
3HMM-driven concatenativeMean Opinion Score3.47—Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39—Unverified
2SampleRNN (3-tier)NLL1.39—Unverified