SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 501550 of 1249 papers

TitleStatusHype
RedPen: Region- and Reason-Annotated Dataset of Unnatural Speech0
Semi-Supervised Learning Based on Reference Model for Low-resource TTS0
A Data-Driven Investigation of Noise-Adaptive Utterance Generation with Linguistic Modification0
Simple and Effective Unsupervised Speech Translation0
Transformer-Based Speech Synthesizer Attribution in an Open Set Scenario0
Empirical Study Incorporating Linguistic Knowledge on Filled Pauses for Personalized Spontaneous Speech SynthesisCode0
GAN You Hear Me? Reclaiming Unconditional Speech Synthesis from Diffusion ModelsCode1
An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Era0
Fully Unsupervised Training of Few-shot Keyword Spotting0
The Sound of Silence: Efficiency of First Digit Features in Synthetic Audio DetectionCode0
Voice Spoofing Countermeasures: Taxonomy, State-of-the-art, experimental analysis of generalizability, open challenges, and the way forwardCode1
Unsupervised Multi-scale Expressive Speaking Style Modeling with Hierarchical Context Information for Audiobook Speech Synthesis0
Detection of Prosodic Boundaries in Speech Using Wav2Vec 2.0Code1
ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and SpeedCode1
EPIC TTS Models: Empirical Pruning Investigations Characterizing Text-To-Speech Models0
MnTTS: An Open-Source Mongolian Text-to-Speech Synthesis Dataset and Accompanied BaselineCode1
Controllable Accented Text-to-Speech Synthesis0
An Initial study on Birdsong Re-synthesis Using Neural Vocoders0
AutoLV: Automatic Lecture Video Generator0
Decoupled Pronunciation and Prosody Modeling in Meta-Learning-Based Multilingual Speech Synthesis0
ConvNeXt Based Neural Network for Audio Anti-SpoofingCode0
Automated detection of pronunciation errors in non-native English speech employing deep learning0
Deep Speech Synthesis from Articulatory RepresentationsCode1
Mlphon: A Multifunctional Grapheme-Phoneme Conversion Tool Using Finite State TransducersCode0
Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild0
Audio Deepfake Attribution: An Initial Dataset and Investigation0
Visualising Model Training via Vowel Space for Text-To-Speech SystemsCode1
Speech Synthesis with Mixed Emotions0
A Study of Modeling Rising Intonation in Cantonese Neural Speech Synthesis0
SoundChoice: Grapheme-to-Phoneme Models with Semantic Disambiguation0
Transplantation of Conversational Speaking Style with Interjections in Sequence-to-Sequence Speech Synthesis0
Controllable Data Generation by Deep Learning: A Review0
ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-SpeechCode3
PoeticTTS -- Controllable Poetry Reading for Literary Studies0
Speaker Anonymization with Phonetic Intermediate Representations0
FastLTS: Non-Autoregressive End-to-End Unconstrained Lip-to-Speech SynthesisCode0
End-to-End Binaural Speech Synthesis0
BERT, can HE predict contrastive focus? Predicting and controlling prominence in neural TTS using a language model0
Mix and Match: An Empirical Study on Training Corpus Composition for Polyglot Text-To-Speech (TTS)0
Computer-assisted Pronunciation Training -- Speech synthesis is almost all you need0
Building African VoicesCode1
TTS-by-TTS 2: Data-selective augmentation for neural speech synthesis using ranking support vector machine with variational autoencoder0
R-MelNet: Reduced Mel-Spectral Modeling for Neural TTS0
iEmoTTS: Toward Robust Cross-Speaker Emotion Transfer and Control for Speech Synthesis based on Disentanglement between Prosody and Timbre0
Expressive, Variable, and Controllable Duration Modelling in TTS0
Show Me Your Face, And I'll Tell You How You SpeakCode1
Self-supervised Context-aware Style Representation for Expressive Speech Synthesis0
WOLONet: Wave Outlooker for Efficient and High Fidelity Speech Synthesis0
Acoustic Modeling for End-to-End Empathetic Dialogue Speech Synthesis Using Linguistic and Prosodic Contexts of Dialogue History0
Automatic Prosody Annotation with Pre-Trained Text-Speech ModelCode1
Show:102550
← PrevPage 11 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified