SOTAVerified

Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Showing 101150 of 1249 papers

TitleStatusHype
Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context ModelingCode1
What to Remember: Self-Adaptive Continual Learning for Audio Deepfake DetectionCode1
Neural Text to Articulate Talk: Deep Text to Audiovisual Speech Synthesis achieving both Auditory and Photo-realismCode1
Learning Arousal-Valence Representation from Categorical Emotion Labels of SpeechCode1
APNet2: High-quality and High-efficiency Neural Vocoder with Direct Prediction of Amplitude and Phase SpectraCode1
Improved Child Text-to-Speech Synthesis through Fastpitch-based Transfer LearningCode1
ArTST: Arabic Text and Speech TransformerCode1
AutoDiff: combining Auto-encoder and Diffusion model for tabular data synthesizingCode1
Evaluating Speech Synthesis by Training Recognizers on Synthetic SpeechCode1
Towards Joint Modeling of Dialogue Response and Speech Synthesis based on Large Language ModelCode1
QS-TTS: Towards Semi-Supervised Text-to-Speech Synthesis via Vector-Quantized Self-Supervised Speech Representation LearningCode1
DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker EmbeddingCode1
Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech TranslationCode1
DiffProsody: Diffusion-based Latent Prosody Generation for Expressive Speech Synthesis with Prosody Conditional Adversarial TrainingCode1
SC VALL-E: Style-Controllable Zero-Shot Text to Speech SynthesizerCode1
Deep Speech Synthesis from MRI-Based Articulatory RepresentationsCode1
Disentanglement in a GAN for Unconditional Speech SynthesisCode1
EmoSpeech: Guiding FastSpeech2 Towards Emotional Text to SpeechCode1
Intelligible Lip-to-Speech Synthesis with Speech UnitsCode1
ADAPTERMIX: Exploring the Efficacy of Mixture of Adapters for Low-Resource TTS AdaptationCode1
Automatic Tuning of Loss Trade-offs without Hyper-parameter Search in End-to-End Zero-Shot Speech SynthesisCode1
Multilingual Text-to-Speech Synthesis for Turkic Languages Using TransliterationCode1
EMNS /Imz/ Corpus: An emotive single-speaker dataset for narrative storytelling in games, television and graphic novelsCode1
Scaling Speech Technology to 1,000+ LanguagesCode1
Diffusion-Based Mel-Spectrogram Enhancement for Personalized Speech Synthesis with Found DataCode1
Bts-e: Audio deepfake detection using breathing-talking-silence encoderCode1
Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech UnderstandingCode1
Imaginary Voice: Face-styled Diffusion Model for Text-to-SpeechCode1
Lip-to-Speech Synthesis in the Wild with Multi-task LearningCode1
Cross-modal information fusion for voice spoofing detectionCode1
Towards Voice Reconstruction from EEG during Imagined SpeechCode1
RWEN-TTS: Relation-aware Word Encoding Network for Natural Text-to-Speech SynthesisCode1
MnTTS2: An Open-Source Multi-Speaker Mongolian Text-to-Speech Synthesis DatasetCode1
Embedding a Differentiable Mel-cepstral Synthesis Filter to a Neural Speech Synthesis SystemCode1
OverFlow: Putting flows on top of neural transducers for better TTSCode1
PhaseAug: A Differentiable Augmentation for Speech Synthesis to Simulate One-to-Many MappingCode1
Accented Text-to-Speech Synthesis with a Conditional Variational AutoencoderCode1
SAMO: Speaker Attractor Multi-Center One-Class Learning for Voice Anti-SpoofingCode1
Articulation GAN: Unsupervised modeling of articulatory learningCode1
FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech SynthesisCode1
GAN You Hear Me? Reclaiming Unconditional Speech Synthesis from Diffusion ModelsCode1
Voice Spoofing Countermeasures: Taxonomy, State-of-the-art, experimental analysis of generalizability, open challenges, and the way forwardCode1
Detection of Prosodic Boundaries in Speech Using Wav2Vec 2.0Code1
ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and SpeedCode1
MnTTS: An Open-Source Mongolian Text-to-Speech Synthesis Dataset and Accompanied BaselineCode1
Deep Speech Synthesis from Articulatory RepresentationsCode1
Visualising Model Training via Vowel Space for Text-To-Speech SystemsCode1
Building African VoicesCode1
Show Me Your Face, And I'll Tell You How You SpeakCode1
Automatic Prosody Annotation with Pre-Trained Text-Speech ModelCode1
Show:102550
← PrevPage 3 of 25Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PeriodWave-Turbo-LPESQ4.45Unverified
2BigVGAN-v2PESQ4.36Unverified
3EVA-GAN-bigPESQ4.35Unverified
4PeriodWave + FreeUPESQ4.25Unverified
5RFWavePESQ4.23Unverified
6BigVSAN (w/ snakebeta)PESQ4.12Unverified
7BigVSANPESQ4.12Unverified
8EVA-GAN-basePESQ4.03Unverified
9BigVGANPESQ4.03Unverified
10VocosPESQ3.7Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score4.53Unverified
2WaveNet (Linguistic)Mean Opinion Score4.34Unverified
3WaveNet (L+F)Mean Opinion Score4.21Unverified
4TacotronMean Opinion Score4Unverified
5HMM-driven concatenativeMean Opinion Score3.86Unverified
6LSTM-RNN parametricMean Opinion Score3.67Unverified
7meansMean Opinion Score0Unverified
#ModelMetricClaimedVerifiedStatus
1BDDM vocoderMean Opinion Score4.48Unverified
2DiffWave LARGEMean Opinion Score4.44Unverified
3Neural HMMMean Opinion Score3.24Unverified
4Neural HMM Ablation with 1 state per phoneMean Opinion Score2.68Unverified
#ModelMetricClaimedVerifiedStatus
1WaveNet (L+F)Mean Opinion Score4.08Unverified
2LSTM-RNN parametricMean Opinion Score3.79Unverified
3HMM-driven concatenativeMean Opinion Score3.47Unverified
#ModelMetricClaimedVerifiedStatus
1SampleRNN (2-tier)NLL1.39Unverified
2SampleRNN (3-tier)NLL1.39Unverified