SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 401450 of 1249 papers

TitleStatusHype
ChatGPT-EDSS: Empathetic Dialogue Speech Synthesis Trained from ChatGPT-derived Context Word Embeddings0
CALLS: Japanese Empathetic Dialogue Speech Corpus of Complaint Handling and Attentive Listening in Customer Center0
ZET-Speech: Zero-shot adaptive Emotion-controllable Text-to-Speech Synthesis with Diffusion and Style-based Models0
Text Generation with Speech Synthesis for ASR Data Augmentation0
Scaling Speech Technology to 1,000+ LanguagesCode1
EMNS /Imz/ Corpus: An emotive single-speaker dataset for narrative storytelling in games, television and graphic novelsCode1
VAKTA-SETU: A Speech-to-Speech Machine Translation Service in Select Indic Languages0
MParrotTTS: Multilingual Multi-speaker Text to Speech Synthesis in Low Resource Setting0
Improving Generalization Ability of Countermeasures for New Mismatch Scenario by Combining Multiple Advanced Regularization TermsCode0
Diffusion-Based Mel-Spectrogram Enhancement for Personalized Speech Synthesis with Found DataCode1
A unified front-end framework for English text-to-speech synthesis0
Empirical Analysis of Oral and Nasal Vowels of Konkani0
Better speech synthesis through scalingCode6
CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency ModelCode2
Zero-shot personalized lip-to-speech synthesis with face image based voice control0
Accented Text-to-Speech Synthesis with Limited Data0
Bts-e: Audio deepfake detection using breathing-talking-silence encoderCode1
M2-CTTS: End-to-End Multi-scale Multi-modal Conversational Text-to-Speech Synthesis0
A Review of Deep Learning Techniques for Speech Processing0
Source-Filter-Based Generative Adversarial Neural Vocoder for High Fidelity Speech SynthesisCode2
Zero-shot text-to-speech synthesis conditioned using self-supervised speech representation model0
Enhancing Suno's Bark Text-to-Speech Model: Addressing Limitations Through Meta's Encodec and Pre-Trained HubertCode4
NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing SynthesizersCode2
Ensemble prosody prediction for expressive speech synthesis0
Text is All You Need: Personalizing ASR Models using Controllable Speech Synthesis0
Wave-U-Net Discriminator: Fast and Lightweight Discriminator for Generative Adversarial Network-Based Speech Synthesis0
A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AI0
Transformers in Speech Processing: A Survey0
Controllable Prosody Generation With Partial Inputs0
VANI: Very-lightweight Accent-controllable TTS for Native and Non-native speakers with Identity Preservation0
QI-TTS: Questioning Intonation Control for Emotional Speech Synthesis0
Improving Prosody for Cross-Speaker Style Transfer by Semi-Supervised Style Extractor and Hierarchical Modeling in Speech Synthesis0
Do Prosody Transfer Models Transfer Prosody?0
Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language ModelingCode5
FoundationTTS: Text-to-Speech for ASR Customization with Generative Language Model0
Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech UnderstandingCode1
ParrotTTS: Text-to-Speech synthesis by exploiting self-supervised representations0
On the Audio-visual Synchronization for Lip-to-Speech Synthesis0
DTW-SiameseNet: Dynamic Time Warped Siamese Network for Mispronunciation Detection and Correction0
ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpus0
UniFLG: Unified Facial Landmark Generator from Text or Speech0
CrossSpeech: Speaker-independent Acoustic Representation for Cross-lingual Speech Synthesis0
Imaginary Voice: Face-styled Diffusion Model for Text-to-SpeechCode1
Lip-to-Speech Synthesis in the Wild with Multi-task LearningCode1
Fast and small footprint Hybrid HMM-HiFiGAN based system for speech synthesis in Indian languages0
A Vector Quantized Approach for Text to Speech Synthesis on Real-World Spontaneous SpeechCode2
Beyond Statistical Similarity: Rethinking Metrics for Deep Generative Models in Engineering Design0
Cross-modal information fusion for voice spoofing detectionCode1
UzbekTagger: The rule-based POS tagger for Uzbek language0
Time out of Mind: Generating Rate of Speech conditioned on emotion and speakerCode0
Show:102550
← PrevPage 9 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified