SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 10511100 of 1249 papers

TitleStatusHype
Boosting Large Language Model for Speech Synthesis: An Empirical Study0
BrainTalker: Low-Resource Brain-to-Speech Synthesis with Transfer Learning using Wav2Vec 2.00
BUCEADOR, a multi-language search engine for digital libraries0
Building and using language resources and infrastructure to develop e-learning programs for a minority language0
Building a synchronous corpus of acoustic and 3D facial marker data for adaptive audio-visual speech synthesis0
Building A User-Centric and Content-Driven Socialbot0
Building Open Javanese and Sundanese Corpora for Multilingual Text-to-Speech0
Building Open-source Speech Technology for Low-resource Minority Languages with SáMi as an Example – Tools, Methods and Experiments0
Building Synthetic Voices in the META-NET Framework0
Building Text-to-Speech Systems for Resource Poor Languages0
Building Text-To-Speech Voices in the Cloud0
BU-TTS: An Open-Source, Bilingual Welsh-English, Text-to-Speech Corpus0
Bytes are All You Need: End-to-End Multilingual Speech Recognition and Synthesis with Bytes0
CALLS: Japanese Empathetic Dialogue Speech Corpus of Complaint Handling and Attentive Listening in Customer Center0
Can large-scale vocoded spoofed data improve speech spoofing countermeasure with a self-supervised front end?0
Can We Achieve High-quality Direct Speech-to-Speech Translation without Parallel Speech Data?0
Can we steal your vocal identity from the Internet?: Initial investigation of cloning Obama's voice using GAN, WaveNet and low-quality found data0
CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speech0
Casa de la Lh\'engua: a set of language resources and natural language processing tools for Mirandese0
CASSANDRA: A multipurpose configurable voice-enabled human-computer-interface0
Chain-of-Thought Training for Open E2E Spoken Dialogue Systems0
ChatGPT-EDSS: Empathetic Dialogue Speech Synthesis Trained from ChatGPT-derived Context Word Embeddings0
CHATR the Corpus; a 20-year-old archive of Concatenative Speech Synthesis0
CHiVE: Varying Prosody in Speech Synthesis with a Linguistically Driven Dynamic Hierarchical Conditional Variational Network0
ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpus0
CleanUNet 2: A Hybrid Speech Denoising Model on Waveform and Spectrogram0
Cloning one's voice using very limited data in the wild0
CML-TTS A Multilingual Dataset for Speech Synthesis in Low-Resource Languages0
CoALT: A Software for Comparing Automatic Labelling Tools0
CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systems0
Code-Mixed Text to Speech Synthesis under Low-Resource Constraints0
Collaborative Watermarking for Adversarial Speech Synthesis0
Collective Learning Mechanism based Optimal Transport Generative Adversarial Network for Non-parallel Voice Conversion0
Combining Human Inputters and Language Services to provide Multi-language support system for International Symposiums0
Combining Incremental Language Generation and Incremental Speech Synthesis for Adaptive Information Presentation0
Combining Manual and Automatic Prosodic Annotation for Expressive Speech Synthesis0
Compact Neural TTS Voices for Accessibility0
Comparing normalizing flows and diffusion models for prosody and acoustic modelling in text-to-speech0
Comparing performance of different set-covering strategies for linguistic content optimization in speech corpora0
Complete reconstruction of the tongue contour through acoustic to articulatory inversion using real-time MRI data0
Computer-Aided Quality Assurance of an Icelandic Pronunciation Dictionary0
Computer-assisted Pronunciation Training -- Speech synthesis is almost all you need0
CONCSS: Contrastive-based Context Comprehension for Dialogue-appropriate Prosody in Conversational Speech Synthesis0
Conditional Spoken Digit Generation with StyleGAN0
Conditioning Sequence-to-sequence Networks with Learned Activations0
Construction of English-French Multimodal Affective Conversational Corpus from TV Dramas0
Constructive Interaction for Talking about Interesting Topics0
Contextual Expressive Text-to-Speech0
Continual Speaker Adaptation for Text-to-Speech Synthesis0
Continuous Autoregressive Modeling with Stochastic Monotonic Alignment for Speech Synthesis0
Show:102550
← PrevPage 22 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified