SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 501–550 of 1249 papers

TitleStatusHype
RedPen: Region- and Reason-Annotated Dataset of Unnatural Speech—0
Semi-Supervised Learning Based on Reference Model for Low-resource TTS—0
A Data-Driven Investigation of Noise-Adaptive Utterance Generation with Linguistic Modification—0
Simple and Effective Unsupervised Speech Translation—0
Transformer-Based Speech Synthesizer Attribution in an Open Set Scenario—0
Empirical Study Incorporating Linguistic Knowledge on Filled Pauses for Personalized Spontaneous Speech SynthesisCode0
GAN You Hear Me? Reclaiming Unconditional Speech Synthesis from Diffusion ModelsCode1
An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Era—0
Fully Unsupervised Training of Few-shot Keyword Spotting—0
The Sound of Silence: Efficiency of First Digit Features in Synthetic Audio DetectionCode0
Voice Spoofing Countermeasures: Taxonomy, State-of-the-art, experimental analysis of generalizability, open challenges, and the way forwardCode1
Unsupervised Multi-scale Expressive Speaking Style Modeling with Hierarchical Context Information for Audiobook Speech Synthesis—0
Detection of Prosodic Boundaries in Speech Using Wav2Vec 2.0Code1
ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and SpeedCode1
EPIC TTS Models: Empirical Pruning Investigations Characterizing Text-To-Speech Models—0
MnTTS: An Open-Source Mongolian Text-to-Speech Synthesis Dataset and Accompanied BaselineCode1
Controllable Accented Text-to-Speech Synthesis—0
An Initial study on Birdsong Re-synthesis Using Neural Vocoders—0
AutoLV: Automatic Lecture Video Generator—0
Decoupled Pronunciation and Prosody Modeling in Meta-Learning-Based Multilingual Speech Synthesis—0
ConvNeXt Based Neural Network for Audio Anti-SpoofingCode0
Automated detection of pronunciation errors in non-native English speech employing deep learning—0
Deep Speech Synthesis from Articulatory RepresentationsCode1
Mlphon: A Multifunctional Grapheme-Phoneme Conversion Tool Using Finite State TransducersCode0
Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild—0
Audio Deepfake Attribution: An Initial Dataset and Investigation—0
Visualising Model Training via Vowel Space for Text-To-Speech SystemsCode1
Speech Synthesis with Mixed Emotions—0
A Study of Modeling Rising Intonation in Cantonese Neural Speech Synthesis—0
SoundChoice: Grapheme-to-Phoneme Models with Semantic Disambiguation—0
Transplantation of Conversational Speaking Style with Interjections in Sequence-to-Sequence Speech Synthesis—0
Controllable Data Generation by Deep Learning: A Review—0
ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-SpeechCode3
PoeticTTS -- Controllable Poetry Reading for Literary Studies—0
Speaker Anonymization with Phonetic Intermediate Representations—0
FastLTS: Non-Autoregressive End-to-End Unconstrained Lip-to-Speech SynthesisCode0
End-to-End Binaural Speech Synthesis—0
BERT, can HE predict contrastive focus? Predicting and controlling prominence in neural TTS using a language model—0
Mix and Match: An Empirical Study on Training Corpus Composition for Polyglot Text-To-Speech (TTS)—0
Computer-assisted Pronunciation Training -- Speech synthesis is almost all you need—0
Building African VoicesCode1
TTS-by-TTS 2: Data-selective augmentation for neural speech synthesis using ranking support vector machine with variational autoencoder—0
R-MelNet: Reduced Mel-Spectral Modeling for Neural TTS—0
iEmoTTS: Toward Robust Cross-Speaker Emotion Transfer and Control for Speech Synthesis based on Disentanglement between Prosody and Timbre—0
Expressive, Variable, and Controllable Duration Modelling in TTS—0
Show Me Your Face, And I'll Tell You How You SpeakCode1
Self-supervised Context-aware Style Representation for Expressive Speech Synthesis—0
WOLONet: Wave Outlooker for Efficient and High Fidelity Speech Synthesis—0
Acoustic Modeling for End-to-End Empathetic Dialogue Speech Synthesis Using Linguistic and Prosodic Contexts of Dialogue History—0
Automatic Prosody Annotation with Pre-Trained Text-Speech ModelCode1
Show:102550
← PrevPage 11 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45—Unverified
2BigVGAN-v2PESQ4.36—Unverified
3EVA-GAN-bigPESQ4.35—Unverified
4PeriodWave + FreeUPESQ4.25—Unverified
5RFWavePESQ4.23—Unverified
6BigVSAN (w/ snakebeta)PESQ4.12—Unverified
7BigVSANPESQ4.12—Unverified
8EVA-GAN-basePESQ4.03—Unverified
9BigVGANPESQ4.03—Unverified
10VocosPESQ3.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53—Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34—Unverified
3WaveNet (L+F)Mean Opinion Score4.21—Unverified
4TacotronMean Opinion Score4—Unverified
5HMM-driven concatenativeMean Opinion Score3.86—Unverified
6LSTM-RNN parametricMean Opinion Score3.67—Unverified
7meansMean Opinion Score0—Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48—Unverified
2DiffWave LARGEMean Opinion Score4.44—Unverified
3Neural HMMMean Opinion Score3.24—Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68—Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08—Unverified
2LSTM-RNN parametricMean Opinion Score3.79—Unverified
3HMM-driven concatenativeMean Opinion Score3.47—Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39—Unverified
2SampleRNN (3-tier)NLL1.39—Unverified