SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 226–250 of 1249 papers

TitleStatusHype
Detection of Prosodic Boundaries in Speech Using Wav2Vec 2.0Code1
ArTST: Arabic Text and Speech TransformerCode1
Deep Learning Based Assessment of Synthetic Speech NaturalnessCode1
Synthesizing Speech from Intracranial Depth Electrodes using an Encoder-Decoder FrameworkCode1
Tacotron: Towards End-to-End Speech SynthesisCode1
Cross-speaker Emotion Transfer Based on Speaker Condition Layer Normalization and Semi-Supervised Training in Text-To-SpeechCode1
Deep Learning Enabled Semantic Communications with Speech Recognition and SynthesisCode1
A Spectral Energy Distance for Parallel Speech SynthesisCode1
Developing multilingual speech synthesis system for Ojibwe, Mi'kmaq, and MaliseetCode1
ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and SpeedCode1
Cross-modal information fusion for voice spoofing detectionCode1
EfficientNet-Absolute Zero for Continuous Speech Keyword SpottingCode1
Unsupervised Text-to-Speech Synthesis by Unsupervised Automatic Speech RecognitionCode1
From Speaker Verification to Multispeaker Speech Synthesis, Deep Transfer with Feedback ConstraintCode1
Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram PredictionsCode1
A Machine of Few Words -- Interactive Speaker Recognition with Reinforcement Learning—0
A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond—0
Constructive Interaction for Talking about Interesting Topics—0
Construction of English-French Multimodal Affective Conversational Corpus from TV Dramas—0
A Survey of Voice Translation Methodologies - Acoustic Dialect Decoder—0
Alternate Endings: Improving Prosody for Incremental Neural TTS with Predicted Future Text Input—0
Accelerating Codec-based Speech Synthesis with Multi-Token Prediction and Speculative Decoding—0
Conditioning Sequence-to-sequence Networks with Learned Activations—0
Contextual Expressive Text-to-Speech—0
Conditional Spoken Digit Generation with StyleGAN—0
Show:102550
← PrevPage 10 of 50Next →
All datasetsLibriTTSNorth American EnglishLJSpeechMandarin ChineseBlizzard Challenge 2013

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45—Unverified
2BigVGAN-v2PESQ4.36—Unverified
3EVA-GAN-bigPESQ4.35—Unverified
4PeriodWave + FreeUPESQ4.25—Unverified
5RFWavePESQ4.23—Unverified
6BigVSAN (w/ snakebeta)PESQ4.12—Unverified
7BigVSANPESQ4.12—Unverified
8EVA-GAN-basePESQ4.03—Unverified
9BigVGANPESQ4.03—Unverified
10VocosPESQ3.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53—Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34—Unverified
3WaveNet (L+F)Mean Opinion Score4.21—Unverified
4TacotronMean Opinion Score4—Unverified
5HMM-driven concatenativeMean Opinion Score3.86—Unverified
6LSTM-RNN parametricMean Opinion Score3.67—Unverified
7meansMean Opinion Score0—Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48—Unverified
2DiffWave LARGEMean Opinion Score4.44—Unverified
3Neural HMMMean Opinion Score3.24—Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68—Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08—Unverified
2LSTM-RNN parametricMean Opinion Score3.79—Unverified
3HMM-driven concatenativeMean Opinion Score3.47—Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39—Unverified
2SampleRNN (3-tier)NLL1.39—Unverified