SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 9511000 of 1249 papers

TitleStatusHype
Transferring neural speech waveform synthesizers to musical instrument sounds generation0
Location-Relative Attention Mechanisms For Robust Long-Form Speech SynthesisCode0
The Theory behind Controllable Expressive Speech Synthesis: a Cross-disciplinary Approach0
Semi-Supervised Generative Modeling for Controllable Speech Synthesis0
即時中文語音合成系統(Real-Time Mandarin Speech Synthesis System)0
Using NLG for speech synthesis of mathematical sentences0
應用文脈分析於中英夾雜語音合成系統(Linguistic Analysis for English/Mandarin Speech Synthesis System)0
Attention Forcing for Sequence-to-sequence Model Training0
Disentangling Speech and Non-Speech Components for Building Robust Acoustic Models from Found DataCode0
High Fidelity Speech Synthesis with Adversarial NetworksCode0
Speech Recognition with Augmented Synthesized Speech0
Modular Meta-Learning with Shrinkage0
Evaluating Long-form Text-to-Speech: Comparing the Ratings of Sentences and Paragraphs0
DurIAN: Duration Informed Attention Network For Multimodal SynthesisCode0
Maximizing Mutual Information for TacotronCode0
Neural Harmonic-plus-Noise Waveform Model with Trainable Maximum Voice Frequency for Text-to-Speech Synthesis0
Unpaired Image-to-Speech Synthesis with Multimodal Information BottleneckCode0
DNN-based Speaker Embedding Using Subjective Inter-speaker Similarity for Multi-speaker Modeling in Speech Synthesis0
Multi-Speaker End-to-End Speech Synthesis0
\'Evaluation objective de plongements pour la synth\`ese de parole guid\'ee par r\'eseaux de neurones (Objective evaluation of embeddings for speech synthesis guided by neural networks)0
Deep Residual Neural Networks for Audio Spoofing DetectionCode0
RUSLAN: Russian Spoken Language Corpus for Speech Synthesis0
End-to-End Emotional Speech Synthesis Using Style Tokens and Semi-Supervised Training0
A Unified Speaker Adaptation Method for Speech Synthesis using Transcribed and Untranscribed Speech with Backpropagation0
Towards Transfer Learning for End-to-End Speech Synthesis from Deep Pre-Trained Language Models0
Using generative modelling to produce varied intonation for speech synthesisCode0
MelNet: A Generative Model for Audio in the Frequency DomainCode0
Listening while Speaking and Visualizing: Improving ASR through Multimodal Chain0
Neural Models of Text Normalization for Speech Applications0
Permanent Magnetic Articulograph (PMA) vs Electromagnetic Articulograph (EMA) in Articulation-to-Speech Synthesis for Silent Speech Interface0
Neural Text Normalization with Subword Units0
Speaker Anonymization Using X-vector and Neural Waveform Models0
Video-to-Video Translation for Visual Speech Synthesis0
ET-GAN: Cross-Language Emotion Transfer Based on Cycle-Consistent Generative Adversarial Networks0
Effective parameter estimation methods for an ExcitNet model in generative text-to-speech systemsCode0
CHiVE: Varying Prosody in Speech Synthesis with a Linguistically Driven Dynamic Hierarchical Conditional Variational Network0
Speaker-Independent Speech-Driven Visual Speech Synthesis using Domain-Adapted Acoustic Models0
Neural source-filter waveform models for statistical parametric speech synthesis0
Latent Variable Algorithms for Multimodal Learning and Sensor Fusion0
Unsupervised acoustic unit discovery for speech synthesis using discrete latent-variable neural networks0
Spoof detection using time-delay shallow neural network and feature switchingCode0
Direct speech-to-speech translation with a sequence-to-sequence modelCode0
STC Antispoofing Systems for the ASVspoof2019 ChallengeCode0
A high quality and phonetic balanced speech corpus for Vietnamese0
RawNet: Fast End-to-End Neural VocoderCode0
GELP: GAN-Excited Linear Prediction for Speech Synthesis from Mel-spectrogramCode0
Deep Learning the EEG Manifold for Phonological Categorization from Active Thoughts0
SPEAK YOUR MIND! Towards Imagined Speech Recognition With Hierarchical Deep Learning0
WaveCycleGAN2: Time-domain Neural Post-filter for Speech Waveform Generation0
Multi-reference Tacotron by Intercross Training for Style Disentangling,Transfer and Control in Speech Synthesis0
Show:102550
← PrevPage 20 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified