SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 351–400 of 1249 papers

TitleStatusHype
Audio Codec Augmentation for Robust Collaborative Watermarking of Speech SynthesisCode0
GELP: GAN-Excited Linear Prediction for Speech Synthesis from Mel-spectrogramCode0
High Fidelity Speech Synthesis with Adversarial NetworksCode0
Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic ForgettingCode0
Attentive Multi-Layer Perceptron for Non-autoregressive GenerationCode0
ConvNeXt Based Neural Network for Audio Anti-SpoofingCode0
FastLTS: Non-Autoregressive End-to-End Unconstrained Lip-to-Speech SynthesisCode0
PromptTTS: Controllable Text-to-Speech with Text DescriptionsCode0
fairseq S^2: A Scalable and Integrable Speech Synthesis ToolkitCode0
Adapter-Based Extension of Multi-Speaker Text-to-Speech Model for New SpeakersCode0
Extending Text-to-Speech Synthesis with Articulatory Movement Prediction using Ultrasound Tongue ImagingCode0
fairseq Sˆ2: A Scalable and Integrable Speech Synthesis ToolkitCode0
Evaluating context-invariance in unsupervised speech representationsCode0
Epoch-Synchronous Overlap-Add (ESOLA) for Time- and Pitch-Scale Modification of Speech SignalsCode0
Empirical Study Incorporating Linguistic Knowledge on Filled Pauses for Personalized Spontaneous Speech SynthesisCode0
Exploration strategies for articulatory synthesis of complex syllable onsetsCode0
Humane Speech Synthesis through Zero-Shot Emotion and Disfluency GenerationCode0
Mixed-Precision Training for NLP and Speech Recognition with OpenSeq2SeqCode0
Continuous Speech Synthesis using per-token Latent Diffusion—0
Continuous Expressive Speaking Styles Synthesis based on CVSM and MR-HMM—0
Semi-supervised learning for continuous emotional intensity controllable speech synthesis with disentangled representations—0
Continuous Autoregressive Modeling with Stochastic Monotonic Alignment for Speech Synthesis—0
A Machine of Few Words -- Interactive Speaker Recognition with Reinforcement Learning—0
Continual Speaker Adaptation for Text-to-Speech Synthesis—0
Contextual Expressive Text-to-Speech—0
A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond—0
Constructive Interaction for Talking about Interesting Topics—0
Construction of English-French Multimodal Affective Conversational Corpus from TV Dramas—0
A Survey of Voice Translation Methodologies - Acoustic Dialect Decoder—0
Alternate Endings: Improving Prosody for Incremental Neural TTS with Predicted Future Text Input—0
Conditioning Sequence-to-sequence Networks with Learned Activations—0
Conditional Spoken Digit Generation with StyleGAN—0
A Study of Modeling Rising Intonation in Cantonese Neural Speech Synthesis—0
A Streamwise GAN Vocoder for Wideband Speech Coding at Very Low Bit Rate—0
Aligning phonemes using finte-state methods—0
CONCSS: Contrastive-based Context Comprehension for Dialogue-appropriate Prosody in Conversational Speech Synthesis—0
Computer-assisted Pronunciation Training -- Speech synthesis is almost all you need—0
AS-Speech: Adaptive Style For Speech Synthesis—0
Computer-Aided Quality Assurance of an Icelandic Pronunciation Dictionary—0
Complete reconstruction of the tongue contour through acoustic to articulatory inversion using real-time MRI data—0
Assessing Evaluation Metrics for Speech-to-Speech Translation—0
Aligning Opinions: Cross-Lingual Opinion Mining with Dependencies—0
Acoustic Modeling for End-to-End Empathetic Dialogue Speech Synthesis Using Linguistic and Prosodic Contexts of Dialogue History—0
Accelerating Codec-based Speech Synthesis with Multi-Token Prediction and Speculative Decoding—0
Comparing performance of different set-covering strategies for linguistic content optimization in speech corpora—0
Comparing normalizing flows and diffusion models for prosody and acoustic modelling in text-to-speech—0
Compact Neural TTS Voices for Accessibility—0
ASR-based Features for Emotion Recognition: A Transfer Learning Approach—0
AlignDiT: Multimodal Aligned Diffusion Transformer for Synchronized Speech Generation—0
Combining Manual and Automatic Prosodic Annotation for Expressive Speech Synthesis—0
Show:102550
← PrevPage 8 of 25Next →
All datasetsLibriTTSNorth American EnglishLJSpeechMandarin ChineseBlizzard Challenge 2013

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45—Unverified
2BigVGAN-v2PESQ4.36—Unverified
3EVA-GAN-bigPESQ4.35—Unverified
4PeriodWave + FreeUPESQ4.25—Unverified
5RFWavePESQ4.23—Unverified
6BigVSAN (w/ snakebeta)PESQ4.12—Unverified
7BigVSANPESQ4.12—Unverified
8EVA-GAN-basePESQ4.03—Unverified
9BigVGANPESQ4.03—Unverified
10VocosPESQ3.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53—Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34—Unverified
3WaveNet (L+F)Mean Opinion Score4.21—Unverified
4TacotronMean Opinion Score4—Unverified
5HMM-driven concatenativeMean Opinion Score3.86—Unverified
6LSTM-RNN parametricMean Opinion Score3.67—Unverified
7meansMean Opinion Score0—Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48—Unverified
2DiffWave LARGEMean Opinion Score4.44—Unverified
3Neural HMMMean Opinion Score3.24—Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68—Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08—Unverified
2LSTM-RNN parametricMean Opinion Score3.79—Unverified
3HMM-driven concatenativeMean Opinion Score3.47—Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39—Unverified
2SampleRNN (3-tier)NLL1.39—Unverified