SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 701750 of 1249 papers

TitleStatusHype
A Text-to-Speech Pipeline, Evaluation Methodology, and Initial Fine-Tuning Results for Child Speech Synthesis0
Modeling speech recognition and synthesis simultaneously: Encoding and decoding lexical and sublexical semantic information into speech with no direct access to speech data0
AutoTTS: End-to-End Text-to-Speech Synthesis through Differentiable Duration Modeling0
ECAPA-TDNN for Multi-speaker Text-to-speech SynthesisCode0
AdaVocoder: Adaptive Vocoder for Custom Voice0
Robotic Speech Synthesis: Perspectives on Interactions, Scenarios, and Ethics0
Whither the Priors for (Vocal) Interactivity?0
Text-free non-parallel many-to-many voice conversion using normalising flows0
Speaker Adaption with Intuitive Prosodic Features for Statistical Parametric Speech Synthesis0
Improving Cross-lingual Speech Synthesis with Triplet Training Scheme0
VCVTS: Multi-speaker Video-to-Speech synthesis via cross-modal knowledge transfer from voice conversion0
Voice Filter: Few-shot text-to-speech speaker adaptation using voice conversion as a post-processing module0
Unsupervised word-level prosody tagging for controllable speech synthesis0
Partially Fake Audio Detection by Self-attention-based Fake Span Discovery0
Deep Performer: Score-to-Audio Music Performance Synthesis0
Transformer-based Models of Text Normalization for Speech Applications0
DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANs0
Zero-Shot Long-Form Voice Cloning with Dynamic Convolution Attention0
Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot InteractionCode0
Cross-Lingual Text-to-Speech Using Multi-Task Learning and Speaker Classifier Joint Training0
Deep Speech Synthesis from Articulatory Features0
A Practical Guide to Logical Access Voice Presentation Attack Detection0
Quasi-Taylor Samplers for Diffusion Generative Models based on Ideal Derivatives0
Multi-speaker Multi-style Text-to-speech Synthesis With Single-speaker Single-style Training Data Scenarios0
整合語者嵌入向量與後置濾波器於提升個人化合成語音之語者相似度 (Incorporating Speaker Embedding and Post-Filter Network for Improving Speaker Similarity of Personalized Speech Synthesis System)0
Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidance0
Word-Level Style Control for Expressive, Non-attentive Speech Synthesis0
Prosodic Clustering for Phoneme-level Prosody Control in End-to-End Speech Synthesis0
High Quality Streaming Speech Synthesis with Low, Sentence-Length-Independent Latency0
Cross-lingual Low Resource Speaker Adaptation Using Phonological Features0
Speech Synthesis for Low Resource Languages using Transliteration Enabled Transfer Learning0
Modeling speech recognition and synthesis simultaneously: Encoding and decoding lexical and sublexical semantic information into speech with no access to speech data0
Improving Prosody for Unseen Texts in Speech Synthesis by Utilizing Linguistic Information and Noisy Data0
Cross-lingual Transfer for Speech Processing using Acoustic Language SimilarityCode0
fairseq Sˆ2: A Scalable and Integrable Speech Synthesis Toolkit0
Assessing Evaluation Metrics for Speech-to-Speech Translation0
DelightfulTTS: The Microsoft Speech Synthesis System for Blizzard Challenge 2021Code0
Synt++: Utilizing Imperfect Synthetic Data to Improve Speech Recognition0
CaloFlow II: Even Faster and Still Accurate Generation of Calorimeter Showers with Normalizing FlowsCode0
From Start to Finish: Latency Reduction Strategies for Incremental Speech Synthesis in Simultaneous Speech-to-Speech Translation0
Direct Simultaneous Speech-to-Speech Translation with Variational Monotonic Multihead Attention0
SingGAN: Generative Adversarial Network For High-Fidelity Singing Voice Generation0
DeepA: A Deep Neural Analyzer For Speech And Singing Vocoding0
Systematic Inequalities in Language Technology Performance across the World's LanguagesCode0
LaughNet: synthesizing laughter utterances from waveform silhouettes and a single laughter example0
Using multiple reference audios and style embedding constraints for speech synthesis0
Towards Lifelong Learning of Multilingual Text-To-Speech SynthesisCode0
Environment Aware Text-to-Speech Synthesis0
VisualTTS: TTS with Accurate Lip-Speech Synchronization for Automatic Voice Over0
Cloning one's voice using very limited data in the wild0
Show:102550
← PrevPage 15 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified