SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 651700 of 1249 papers

TitleStatusHype
Rhythm-controllable Attention with High Robustness for Long Sentence Speech Synthesis0
R-MelNet: Reduced Mel-Spectral Modeling for Neural TTS0
Robotic Speech Synthesis: Perspectives on Interactions, Scenarios, and Ethics0
RobustL2S: Speaker-Specific Lip-to-Speech Synthesis exploiting Self-Supervised Representations0
Robust Zero-Shot Text-to-Speech Synthesis with Reverse Inference Optimization0
RoVo: Robust Voice Protection Against Unauthorized Speech Synthesis with Embedding-Level Perturbations0
RSS-TOBI - A Prosodically Enhanced Romanian Speech Corpus0
RUSLAN: Russian Spoken Language Corpus for Speech Synthesis0
Russian Stress Prediction using Maximum Entropy Ranking0
S2ST-Omni: An Efficient and Scalable Multilingual Speech-to-Speech Translation Framework via Seamless Speech-Text Alignment and Streaming Speech Generation0
SALF-MOS: Speaker Agnostic Latent Features Downsampled for MOS Prediction0
SALTTS: Leveraging Self-Supervised Speech Representations for improved Text-to-Speech Synthesis0
Sampling-based speech parameter generation using moment-matching networks0
Scaling and bias codes for modeling speaker-adaptive DNN-based speech synthesis systems0
Schrodinger Bridges Beat Diffusion Models on Text-to-Speech Synthesis0
Securing Voice-driven Interfaces against Fake (Cloned) Audio Attacks0
Seeing Voices: Generating A-Roll Video from Audio with Mirage0
SelectTTS: Synthesizing Anyone's Voice via Discrete Unit-Based Frame Selection0
Self-Attention Linguistic-Acoustic Decoder0
Self-supervised Context-aware Style Representation for Expressive Speech Synthesis0
Self-supervised learning for robust voice cloning0
SelfVC: Voice Conversion With Iterative Refinement using Self Transformations0
Semantics and Discourse Processing for Expressive TTS0
SE-MelGAN -- Speaker Agnostic Rapid Speech Enhancement0
Semi-Supervised Generative Modeling for Controllable Speech Synthesis0
Semi-Supervised Learning Based on Reference Model for Low-resource TTS0
Semi-supervised Learning for Multi-speaker Text-to-speech Synthesis Using Discrete Speech Representation0
Semi-Supervised Training for Improving Data Efficiency in End-to-End Speech Synthesis0
Sentiment Analysis for Emotional Speech Synthesis in a News Dialogue System0
Sequence Modeling using Gated Recurrent Neural Networks0
Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis0
Significance of Maximum Spectral Amplitude in Sub-bands for Spectral Envelope Estimation and Its Application to Statistical Parametric Speech Synthesis0
Silent Speech Interfaces for Speech Restoration: A Review0
Simple and Effective Unsupervised Speech Synthesis0
Simple and Effective Unsupervised Speech Translation0
Simultaneous Speech-to-Speech Translation System with Neural Incremental ASR, MT, and TTS0
Simultaneous Translation0
SingGAN: Generative Adversarial Network For High-Fidelity Singing Voice Generation0
Single-stage TTS with Masked Audio Token Modeling and Semantic Knowledge Distillation0
Situated Incremental Natural Language Understanding using a Multimodal, Linguistically-driven Update Model0
SlimSpeech: Lightweight and Efficient Text-to-Speech with Slim Rectified Flow0
SLMGAN: Exploiting Speech Language Model Representations for Unsupervised Zero-Shot Voice Conversion in GANs0
SNAC: Speaker-normalized affine coupling layer in flow-based architecture for zero-shot multi-speaker text-to-speech0
SOLIDO: A Robust Watermarking Method for Speech Synthesis via Low-Rank Adaptation0
SOMOS: The Samsung Open MOS Dataset for the Evaluation of Neural Text-to-Speech Synthesis0
SoundChoice: Grapheme-to-Phoneme Models with Semantic Disambiguation0
MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesis0
Speaker Adaption with Intuitive Prosodic Features for Statistical Parametric Speech Synthesis0
Speaker-adaptive neural vocoders for parametric speech synthesis systems0
Speaker Anonymization Using X-vector and Neural Waveform Models0
Show:102550
← PrevPage 14 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified