SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 451500 of 1249 papers

TitleStatusHype
Generative Adversarial Network based Voice Conversion: Techniques, Challenges, and Recent Advancements0
Extending Multilingual Speech Synthesis to 100+ Languages without Transcribed Data0
Generative Pre-training for Speech with Flow Matching0
F0 Modeling In Hmm-Based Speech Synthesis System Using Deep Belief Network0
Disentangling Correlated Speaker and Noise for Speech Synthesis via Data Augmentation and Adversarial Factorization0
Face-StyleSpeech: Enhancing Zero-shot Speech Synthesis from Face Images with Improved Face-to-Speech Mapping0
Facial Expression-Enhanced TTS: Combining Face Representation and Emotion Intensity for Adaptive Speech0
FADEL: Uncertainty-aware Fake Audio Detection with Evidential Deep Learning0
FA-GAN: Artifacts-free and Phase-aware High-fidelity GAN-based Vocoder0
Collaborative Watermarking for Adversarial Speech Synthesis0
fairseq Sˆ2: A Scalable and Integrable Speech Synthesis Toolkit0
Fast and Accurate Decision Trees for Natural Language Processing Tasks0
Bahasa Harmony: A Comprehensive Dataset for Bahasa Text-to-Speech Synthesis with Discrete Codec Modeling of EnGen-TTS0
Fast and small footprint Hybrid HMM-HiFiGAN based system for speech synthesis in Indian languages0
Fast Bootstrapping of Grapheme to Phoneme System for Under-resourced Languages - Application to the Iban Language0
Fast, Compact, and High Quality LSTM-RNN Based Statistical Parametric Speech Synthesizers for Mobile Devices0
BAD: An Assistant tool for making verses in Basque0
Direct Simultaneous Speech-to-Speech Translation with Variational Monotonic Multihead Attention0
An In-depth Analysis of the Effect of Text Normalization in Social Media0
Fast Labeling and Transcription with the Speechalyzer Toolkit0
Advances in Speech Vocoding for Text-to-Speech with Continuous Parameters0
Fast Spectrogram Inversion using Multi-head Convolutional Neural Networks0
A Waveform Representation Framework for High-quality Statistical Parametric Speech Synthesis0
AV-Flow: Transforming Text to Audio-Visual Human-like Interactions0
An explainability study of the constant Q cepstral coefficient spoofing countermeasure for automatic speaker verification0
Accurate synthesis of Dysarthric Speech for ASR data augmentation0
Few Shot Adaptive Normalization Driven Multi-Speaker Speech Synthesis0
Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis0
Fine-grained Noise Control for Multispeaker Speech Synthesis0
Diff-TTS: A Denoising Diffusion Model for Text-to-Speech0
Fine-grained Style Modeling, Transfer and Prediction in Text-to-Speech Synthesis via Phone-Level Content-Style Disentanglement0
Fitting New Speakers Based on a Short Untranscribed Sample0
An Expert System for Automatic Reading of A Text Written in Standard Arabic0
Flavored Tacotron: Conditional Learning for Prosodic-linguistic Features0
FleSpeech: Flexibly Controllable Speech Generation with Various Prompts0
An Experimental Study: Assessing the Combined Framework of WavLM and BEST-RQ for Text-to-Speech Synthesis0
DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANs0
FLY-TTS: Fast, Lightweight and High-Quality End-to-End Text-to-Speech Synthesis0
AutoTTS: End-to-End Text-to-Speech Synthesis through Differentiable Duration Modeling0
A Variational EM Method for Pole-Zero Modeling of Speech with Mixed Block Sparse and Gaussian Excitation0
DiffCSS: Diverse and Expressive Conversational Speech Synthesis with Diffusion Models0
Forward Attention in Sequence-to-sequence Acoustic Modelling for Speech Synthesis0
FoundationTTS: Text-to-Speech for ASR Customization with Generative Language Model0
From `Solved Problems' to New Challenges: A Report on LDC Activities0
From Faces to Voices: Learning Hierarchical Representations for High-quality Video-to-Speech0
From Flat to Feeling: A Feasibility and Impact Study on Dynamic Facial Emotions in AI-Generated Avatars0
From Speaker Identification to Affective Analysis: A Multi-Step System for Analyzing Children's Stories0
DiEmo-TTS: Disentangled Emotion Representations via Self-Supervised Distillation for Cross-Speaker Emotion Transfer in Text-to-Speech0
Full Attention Bidirectional Deep Learning Structure for Single Channel Speech Enhancement0
AutoStyle-TTS: Retrieval-Augmented Generation based Automatic Style Matching Text-to-Speech Synthesis0
Show:102550
← PrevPage 10 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified