SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 701–750 of 1249 papers

TitleStatusHype
Speaker Anonymization with Phonetic Intermediate Representations—0
Speaker-independent neural formant synthesis—0
Speaker-independent raw waveform model for glottal excitation—0
Speaker-Independent Speech-Driven Visual Speech Synthesis using Domain-Adapted Acoustic Models—0
Speaker verification-derived loss and data augmentation for DNN-based multispeaker speech synthesis—0
Speaking in Wavelet Domain: A Simple and Efficient Approach to Speed up Speech Diffusion Model—0
Speaking rate attention-based duration prediction for speed control TTS—0
Speaking style adaptation in Text-To-Speech synthesis using Sequence-to-sequence models with attention—0
Speak While You Think: Streaming Speech Synthesis During Text Generation—0
SPEAK WITH YOUR HANDS Using Continuous Hand Gestures to control Articulatory Speech Synthesizer—0
SPEAK YOUR MIND! Towards Imagined Speech Recognition With Hierarchical Deep Learning—0
SpecDiff-GAN: A Spectrally-Shaped Noise Diffusion GAN for Speech and Music Synthesis—0
Spectral Codecs: Improving Non-Autoregressive Speech Synthesis with Spectrogram-Based Audio Codecs—0
Speech: A Challenge to Digital Signal Processing Technology for Human-to-Computer Interaction—0
Speech Bandwidth Expansion Via High Fidelity Generative Adversarial Networks—0
SpeechComposer: Unifying Multiple Speech Tasks with Prompt Composition—0
Speech denoising by parametric resynthesis—0
Speech earthquakes: scaling and universality in human voice—0
Speech inpainting: Context-based speech synthesis guided by video—0
Speech-MLP: a simple MLP architecture for speech processing—0
Speech Quality Assessment Model Based on Mixture of Experts: System-Level Performance Enhancement and Utterance-Level Challenge Analysis—0
Speech Recognition with Augmented Synthesized Speech—0
Speech Rhythm-Based Speaker Embeddings Extraction from Phonemes and Phoneme Duration for Multi-Speaker Speech Synthesis—0
Speech Synthesis along Perceptual Voice Quality Dimensions—0
Speech Synthesis as Augmentation for Low-Resource ASR—0
Speech Synthesis for Low Resource Languages using Transliteration Enabled Transfer Learning—0
Speech Synthesis of Code-Mixed Text—0
Speech Synthesis using EEG—0
Speech Synthesis with Mixed Emotions—0
Speech vocoding for laboratory phonology—0
Speech Synthesis By Unrolling Diffusion Process using Neural Network Layers—0
Spontaneous Style Text-to-Speech Synthesis with Controllable Spontaneous Behaviors Based on Language Models—0
Sprachsynthese -- State-of-the-Art in englischer und deutscher Sprache—0
Stable-TTS: Stable Speaker-Adaptive Text-to-Speech Synthesis via Prosody Prompting—0
Statistical Evaluation of Pronunciation Encoding—0
Statistical Parametric Speech Synthesis Using Bottleneck Representation From Sequence Auto-encoder—0
Strategies in Transfer Learning for Low-Resource Speech Synthesis: Phone Mapping, Features Input, and Source Language Selection—0
StreamVC: Real-Time Low-Latency Voice Conversion—0
StyleFusion TTS: Multimodal Style-control and Enhanced Feature Fusion for Zero-shot Text-to-speech Synthesis—0
Style-Label-Free: Cross-Speaker Style Transfer by Quantized VAE and Speaker-wise Normalization in Speech Synthesis—0
Style Mixture of Experts for Expressive Text-To-Speech Synthesis—0
STYLER: Style Factor Modeling with Rapidity and Robustness via Speech Decomposition for Expressive and Controllable Neural Text to Speech—0
StyleSpeech: Self-supervised Style Enhancing with VQ-VAE-based Pre-training for Expressive Audiobook Speech Synthesis—0
StyleTTS-ZS: Efficient High-Quality Zero-Shot Text-to-Speech Synthesis with Distilled Time-Varying Style Diffusion—0
Style Variation as a Vantage Point for Code-Switching—0
SupertonicTTS: Towards Highly Scalable and Efficient Text-to-Speech System—0
SUT System Description for Anti-Spoofing 2017 Challenge—0
SwissDial: Parallel Multidialectal Corpus of Spoken Swiss German—0
Syllabification by Phone Categorization—0
SynCLR: A Synthesis Framework for Contrastive Learning of out-of-domain Speech Representations—0
Show:102550
← PrevPage 15 of 25Next →
All datasetsLibriTTSNorth American EnglishLJSpeechMandarin ChineseBlizzard Challenge 2013

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45—Unverified
2BigVGAN-v2PESQ4.36—Unverified
3EVA-GAN-bigPESQ4.35—Unverified
4PeriodWave + FreeUPESQ4.25—Unverified
5RFWavePESQ4.23—Unverified
6BigVSAN (w/ snakebeta)PESQ4.12—Unverified
7BigVSANPESQ4.12—Unverified
8EVA-GAN-basePESQ4.03—Unverified
9BigVGANPESQ4.03—Unverified
10VocosPESQ3.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53—Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34—Unverified
3WaveNet (L+F)Mean Opinion Score4.21—Unverified
4TacotronMean Opinion Score4—Unverified
5HMM-driven concatenativeMean Opinion Score3.86—Unverified
6LSTM-RNN parametricMean Opinion Score3.67—Unverified
7meansMean Opinion Score0—Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48—Unverified
2DiffWave LARGEMean Opinion Score4.44—Unverified
3Neural HMMMean Opinion Score3.24—Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68—Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08—Unverified
2LSTM-RNN parametricMean Opinion Score3.79—Unverified
3HMM-driven concatenativeMean Opinion Score3.47—Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39—Unverified
2SampleRNN (3-tier)NLL1.39—Unverified