SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 201250 of 1249 papers

TitleStatusHype
ITAcotron 2: Transfering English Speech Synthesis Architectures and Speech Features to ItalianCode1
Byakto Speech: Real-time long speech synthesis with convolutional neural network: Transfer learning from English to BanglaCode1
Region-Based Optimization in Continual Learning for Audio Deepfake DetectionCode1
Towards Voice Reconstruction from EEG during Imagined SpeechCode1
KazEmoTTS: A Dataset for Kazakh Emotional Text-to-Speech SynthesisCode1
Detection of Prosodic Boundaries in Speech Using Wav2Vec 2.0Code1
Requirements and Motivations of Low-Resource Speech Synthesis for Language RevitalizationCode1
Learning Arousal-Valence Representation from Categorical Emotion Labels of SpeechCode1
Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language ModelsCode1
Learning Individual Speaking Styles for Accurate Lip to Speech SynthesisCode1
Developing multilingual speech synthesis system for Ojibwe, Mi'kmaq, and MaliseetCode1
Retrieval-Augmented Dialogue Knowledge Aggregation for Expressive Conversational Speech SynthesisCode1
CDPAM: Contrastive learning for perceptual audio similarityCode1
A Resource for Computational Experiments on MapudungunCode1
Deep Speech Synthesis from MRI-Based Articulatory RepresentationsCode1
Deep Speech Synthesis from Articulatory RepresentationsCode1
ADAPTERMIX: Exploring the Efficacy of Mixture of Adapters for Low-Resource TTS AdaptationCode1
Attentron: Few-Shot Text-to-Speech Utilizing Attention-Based Variable-Length EmbeddingCode1
Rasa: Building Expressive Speech Synthesis Systems for Indian Languages in Low-resource SettingsCode1
Articulation GAN: Unsupervised modeling of articulatory learningCode1
MelGAN: Generative Adversarial Networks for Conditional Waveform SynthesisCode1
Voice Spoofing Countermeasures: Taxonomy, State-of-the-art, experimental analysis of generalizability, open challenges, and the way forwardCode1
RF-Next: Efficient Receptive Field Search for Convolutional Neural NetworksCode1
PRESENT: Zero-Shot Text-to-Prosody ControlCode1
Generative Expressive Conversational Speech SynthesisCode1
Cross-speaker Emotion Transfer Based on Speaker Condition Layer Normalization and Semi-Supervised Training in Text-To-SpeechCode1
Deep Learning Based Assessment of Synthetic Speech NaturalnessCode1
UMETTS: A Unified Framework for Emotional Text-to-Speech Synthesis with Multimodal PromptsCode1
Cross-modal information fusion for voice spoofing detectionCode1
MnTTS: An Open-Source Mongolian Text-to-Speech Synthesis Dataset and Accompanied BaselineCode1
ASR data augmentation in low-resource settings using cross-lingual multi-speaker TTS and cross-lingual voice conversionCode1
Imaginary Voice: Face-styled Diffusion Model for Text-to-SpeechCode1
A Spectral Energy Distance for Parallel Speech SynthesisCode1
QS-TTS: Towards Semi-Supervised Text-to-Speech Synthesis via Vector-Quantized Self-Supervised Speech Representation LearningCode1
ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and SpeedCode1
Deep Learning Enabled Semantic Communications with Speech Recognition and SynthesisCode1
Assem-VC: Realistic Voice Conversion by Assembling Modern Speech Synthesis TechniquesCode1
RAD-TTS: Parallel Flow-Based TTS with Robust Alignment Learning and Diverse SynthesisCode1
Show Me Your Face, And I'll Tell You How You SpeakCode1
Synthesizing Speech from Intracranial Depth Electrodes using an Encoder-Decoder FrameworkCode1
Parallel WaveNet: Fast High-Fidelity Speech SynthesisCode0
A Critical Review of Recurrent Neural Networks for Sequence LearningCode0
Partial Rank Similarity Minimization Method for Quality MOS Prediction of Unseen Speech Synthesis Systems in Zero-Shot and Semi-supervised settingCode0
NVC-Net: End-to-End Adversarial Voice ConversionCode0
OmniDRCA: Parallel Speech-Text Foundation Model via Dual-Resolution Speech Representations and Contrastive AlignmentCode0
Neural Voice Cloning with a Few SamplesCode0
One-Class Learning with Adaptive Centroid Shift for Audio Deepfake DetectionCode0
Phrase break prediction with bidirectional encoder representations in Japanese text-to-speech synthesisCode0
Comparison of Speech Representations for Automatic Quality Estimation in Multi-Speaker Text-to-Speech SynthesisCode0
Neural Autoregressive FlowsCode0
Show:102550
← PrevPage 5 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified