SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 751800 of 1249 papers

TitleStatusHype
Auto Spell Suggestion for High Quality Speech Synthesis in Hindi0
AutoStyle-TTS: Retrieval-Augmented Generation based Automatic Style Matching Text-to-Speech Synthesis0
A Variational EM Method for Pole-Zero Modeling of Speech with Mixed Block Sparse and Gaussian Excitation0
AV-Flow: Transforming Text to Audio-Visual Human-like Interactions0
A Waveform Representation Framework for High-quality Statistical Parametric Speech Synthesis0
BAD: An Assistant tool for making verses in Basque0
Bahasa Harmony: A Comprehensive Dataset for Bahasa Text-to-Speech Synthesis with Discrete Codec Modeling of EnGen-TTS0
Balancing Speech Understanding and Generation Using Continual Pre-training for Codec-based Speech LLM0
Bayesian Subspace HMM for the Zerospeech 2020 Challenge0
BERT, can HE predict contrastive focus? Predicting and controlling prominence in neural TTS using a language model0
Beyond Oversmoothing: Evaluating DDPM and MSE for Scalable Speech Synthesis in ASR0
Beyond Statistical Similarity: Rethinking Metrics for Deep Generative Models in Engineering Design0
BinauralFlow: A Causal and Streamable Approach for High-Quality Binaural Speech Synthesis with Flow Matching Models0
Bloom Library: Multimodal Datasets in 300+ Languages for a Variety of Downstream Tasks0
Boosting Fast and High-Quality Speech Synthesis with Linear Diffusion0
Boosting Large Language Model for Speech Synthesis: An Empirical Study0
BrainTalker: Low-Resource Brain-to-Speech Synthesis with Transfer Learning using Wav2Vec 2.00
BUCEADOR, a multi-language search engine for digital libraries0
Building and using language resources and infrastructure to develop e-learning programs for a minority language0
Building a synchronous corpus of acoustic and 3D facial marker data for adaptive audio-visual speech synthesis0
Building A User-Centric and Content-Driven Socialbot0
Building Open Javanese and Sundanese Corpora for Multilingual Text-to-Speech0
Building Open-source Speech Technology for Low-resource Minority Languages with SáMi as an Example – Tools, Methods and Experiments0
Building Synthetic Voices in the META-NET Framework0
Building Text-to-Speech Systems for Resource Poor Languages0
Building Text-To-Speech Voices in the Cloud0
BU-TTS: An Open-Source, Bilingual Welsh-English, Text-to-Speech Corpus0
Bytes are All You Need: End-to-End Multilingual Speech Recognition and Synthesis with Bytes0
CALLS: Japanese Empathetic Dialogue Speech Corpus of Complaint Handling and Attentive Listening in Customer Center0
Can large-scale vocoded spoofed data improve speech spoofing countermeasure with a self-supervised front end?0
Can We Achieve High-quality Direct Speech-to-Speech Translation without Parallel Speech Data?0
Can we steal your vocal identity from the Internet?: Initial investigation of cloning Obama's voice using GAN, WaveNet and low-quality found data0
CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speech0
Casa de la Lh\'engua: a set of language resources and natural language processing tools for Mirandese0
CASSANDRA: A multipurpose configurable voice-enabled human-computer-interface0
Chain-of-Thought Training for Open E2E Spoken Dialogue Systems0
ChatGPT-EDSS: Empathetic Dialogue Speech Synthesis Trained from ChatGPT-derived Context Word Embeddings0
CHATR the Corpus; a 20-year-old archive of Concatenative Speech Synthesis0
CHiVE: Varying Prosody in Speech Synthesis with a Linguistically Driven Dynamic Hierarchical Conditional Variational Network0
ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpus0
CleanUNet 2: A Hybrid Speech Denoising Model on Waveform and Spectrogram0
Cloning one's voice using very limited data in the wild0
CML-TTS A Multilingual Dataset for Speech Synthesis in Low-Resource Languages0
CoALT: A Software for Comparing Automatic Labelling Tools0
CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systems0
Code-Mixed Text to Speech Synthesis under Low-Resource Constraints0
Collaborative Watermarking for Adversarial Speech Synthesis0
Collective Learning Mechanism based Optimal Transport Generative Adversarial Network for Non-parallel Voice Conversion0
Combining Human Inputters and Language Services to provide Multi-language support system for International Symposiums0
Combining Incremental Language Generation and Incremental Speech Synthesis for Adaptive Information Presentation0
Show:102550
← PrevPage 16 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified