SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 501–550 of 1249 papers

TitleStatusHype
Fully-hierarchical fine-grained prosody modeling for interpretable speech synthesis—0
Fully Unsupervised Training of Few-shot Keyword Spotting—0
Empirical Analysis of Oral and Nasal Vowels of Konkani—0
Emphasized Accent Phrase Prediction from Text for Advertisement Text-To-Speech Synthesis—0
GANSpeech: Adversarial Training for High-Fidelity Multi-Speaker Speech Synthesis—0
GANtron: Emotional Speech Synthesis with Generative Adversarial Networks—0
Building Text-to-Speech Systems for Resource Poor Languages—0
Applying Automated Machine Translation to Educational Video Courses—0
Gender Bias in Instruction-Guided Speech Synthesis Models—0
Generacion de voces artificiales infantiles en castellano con acento costarricense—0
A comparison of recent waveform generation and acoustic modeling methods for neural-network-based speech synthesis—0
EMPHASIS: An Emotional Phoneme-based Acoustic Model for Speech Synthesis System—0
EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model—0
Building Synthetic Voices in the META-NET Framework—0
Emotion controllable speech synthesis using emotion-unlabeled dataset with the assistance of cross-domain speech emotion recognition—0
Building Open-source Speech Technology for Low-resource Minority Languages with SáMi as an Example – Tools, Methods and Experiments—0
A Post Auto-regressive GAN Vocoder Focused on Spectrum Fracture—0
EmoPro: A Prompt Selection Strategy for Emotional Expression in LM-based Speech Synthesis—0
Building Open Javanese and Sundanese Corpora for Multilingual Text-to-Speech—0
Emo-DPO: Controllable Emotional Speech Synthesis through Direct Preference Optimization—0
Building A User-Centric and Content-Driven Socialbot—0
Adversarial Training of Denoising Diffusion Model Using Dual Discriminators for High-Fidelity Multi-Speaker TTS—0
Building a synchronous corpus of acoustic and 3D facial marker data for adaptive audio-visual speech synthesis—0
Eigenresiduals for improved Parametric Speech Synthesis—0
ET-GAN: Cross-Language Emotion Transfer Based on Cycle-Consistent Generative Adversarial Networks—0
Building and using language resources and infrastructure to develop e-learning programs for a minority language—0
基於字元階層之語音合成用文脈訊息擷取 (Character-Level Linguistic Features Extraction for Text-to-Speech System) [In Chinese]—0
Efficient training strategies for natural sounding speech synthesis and speaker adaptation based on FastPitch—0
Efficient neural speech synthesis for low-resource languages through multilingual modeling—0
BUCEADOR, a multi-language search engine for digital libraries—0
Grad-StyleSpeech: Any-speaker Adaptive Text-to-Speech Synthesis with Diffusion Models—0
Adversarial Feature Learning and Unsupervised Clustering based Speech Synthesis for Found Data with Acoustic and Textual Noise—0
A Comparison of Manual and Automatic Voice Repair for Individual with Vocal Disabilities—0
A Bengali HMM Based Speech Synthesis System—0
Voice Cloning for Dysarthric Speech Synthesis: Addressing Data Scarcity in Speech-Language Pathology—0
Efficient Incremental Text-to-Speech on GPUs—0
Efficient Generative Modeling with Residual Vector Quantization-Based Tokens—0
Effect of data reduction on sequence-to-sequence neural TTS—0
BrainTalker: Low-Resource Brain-to-Speech Synthesis with Transfer Learning using Wav2Vec 2.0—0
An Overview of BPPT's Indonesian Language Resources—0
Effect of choice of probability distribution, randomness, and search methods for alignment modeling in sequence-to-sequence text-to-speech synthesis using hard alignment—0
Boosting Large Language Model for Speech Synthesis: An Empirical Study—0
Boosting Fast and High-Quality Speech Synthesis with Linear Diffusion—0
An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Era—0
ED-TTS: Multi-Scale Emotion Modeling using Cross-Domain Emotion Diarization for Emotional Speech Synthesis—0
Bloom Library: Multimodal Datasets in 300+ Languages for a Variety of Downstream Tasks—0
Dynamic Prosody Generation for Speech Synthesis using Linguistics-Driven Acoustic Embedding Selection—0
BinauralFlow: A Causal and Streamable Approach for High-Quality Binaural Speech Synthesis with Flow Matching Models—0
A Novel Data Augmentation Approach for Automatic Speaking Assessment on Opinion Expressions—0
DurIAN-E: Duration Informed Attention Network For Expressive Text-to-Speech Synthesis—0
Show:102550
← PrevPage 11 of 25Next →
All datasetsLibriTTSNorth American EnglishLJSpeechMandarin ChineseBlizzard Challenge 2013

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45—Unverified
2BigVGAN-v2PESQ4.36—Unverified
3EVA-GAN-bigPESQ4.35—Unverified
4PeriodWave + FreeUPESQ4.25—Unverified
5RFWavePESQ4.23—Unverified
6BigVSAN (w/ snakebeta)PESQ4.12—Unverified
7BigVSANPESQ4.12—Unverified
8EVA-GAN-basePESQ4.03—Unverified
9BigVGANPESQ4.03—Unverified
10VocosPESQ3.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53—Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34—Unverified
3WaveNet (L+F)Mean Opinion Score4.21—Unverified
4TacotronMean Opinion Score4—Unverified
5HMM-driven concatenativeMean Opinion Score3.86—Unverified
6LSTM-RNN parametricMean Opinion Score3.67—Unverified
7meansMean Opinion Score0—Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48—Unverified
2DiffWave LARGEMean Opinion Score4.44—Unverified
3Neural HMMMean Opinion Score3.24—Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68—Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08—Unverified
2LSTM-RNN parametricMean Opinion Score3.79—Unverified
3HMM-driven concatenativeMean Opinion Score3.47—Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39—Unverified
2SampleRNN (3-tier)NLL1.39—Unverified