SOTAVerified

Text-To-Speech Synthesis

Text-To-Speech Synthesis is a machine learning task that involves converting written text into spoken words. The goal is to generate synthetic speech that sounds natural and resembles human speech as closely as possible.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 332 papers

TitleStatusHype
EmoSphere-TTS: Emotional Style and Intensity Modeling via Spherical Emotion Vector for Controllable Emotional Text-to-SpeechCode2
Meta Learning Text-to-Speech Synthesis in over 7000 LanguagesCode0
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers—0
Autoregressive Diffusion Transformer for Text-to-Speech Synthesis—0
Improving Audio Codec-based Zero-Shot Text-to-Speech Synthesis with Multi-Modal Context and Large Language Model—0
Style Mixture of Experts for Expressive Text-To-Speech Synthesis—0
StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task LearningCode5
Phonetic Enhanced Language Modeling for Text-to-Speech Synthesis—0
Enhancing Zero-shot Text-to-Speech Synthesis with Human Feedback—0
DLPO: Diffusion Model Loss-Guided Reinforcement Learning for Fine-Tuning Text-to-Speech Diffusion Models—0
Evaluating Text-to-Speech Synthesis from a Large Discrete Token-based Speech Language Model—0
UMETTS: A Unified Framework for Emotional Text-to-Speech Synthesis with Multimodal PromptsCode1
RALL-E: Robust Codec Language Modeling with Chain-of-Thought Prompting for Text-to-Speech Synthesis—0
PSCodec: A Series of High-Fidelity Low-bitrate Neural Speech Codecs Leveraging Prompt Encoders—0
KazEmoTTS: A Dataset for Kazakh Emotional Text-to-Speech SynthesisCode1
CM-TTS: Enhancing Real Time Text-to-Speech Synthesis Efficiency through Weighted Samplers and Consistency ModelsCode2
Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic ForgettingCode0
Noise-robust zero-shot text-to-speech synthesis conditioned on self-supervised speech-representation model with adapters—0
Boosting Large Language Model for Speech Synthesis: An Empirical Study—0
Normalization of Lithuanian Text Using Regular Expressions—0
MM-TTS: Multi-modal Prompt based Style Transfer for Expressive Text-to-Speech Synthesis—0
An Experimental Study: Assessing the Combined Framework of WavLM and BEST-RQ for Text-to-Speech Synthesis—0
Schrodinger Bridges Beat Diffusion Models on Text-to-Speech Synthesis—0
Code-Mixed Text to Speech Synthesis under Low-Resource Constraints—0
Learning Arousal-Valence Representation from Categorical Emotion Labels of SpeechCode1
Guided Flows for Generative Modeling and Decision Making—0
Improved Child Text-to-Speech Synthesis through Fastpitch-based Transfer LearningCode1
Generative Pre-training for Speech with Flow Matching—0
Back Transcription as a Method for Evaluating Robustness of Natural Language Understanding Models to Speech Recognition ErrorsCode0
ArTST: Arabic Text and Speech TransformerCode1
Generative Adversarial Training for Text-to-Speech Synthesis Based on Raw Phonetic Input and Explicit Prosody ModellingCode2
Attentive Multi-Layer Perceptron for Non-autoregressive GenerationCode0
Unified speech and gesture synthesis using flow matching—0
LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTCode2
The VoiceMOS Challenge 2023: Zero-shot Subjective Speech Quality Prediction for Multiple Domains—0
DurIAN-E: Duration Informed Attention Network For Expressive Text-to-Speech Synthesis—0
FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech CodecCode2
Matcha-TTS: A fast TTS architecture with conditional flow matchingCode3
The FruitShell French synthesis system at the Blizzard 2023 Challenge—0
QS-TTS: Towards Semi-Supervised Text-to-Speech Synthesis via Vector-Quantized Self-Supervised Speech Representation LearningCode1
Towards Spontaneous Style Modeling with Semi-supervised Pre-training for Conversational Text-to-Speech Synthesis—0
Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech TranslationCode1
SALTTS: Leveraging Self-Supervised Speech Representations for improved Text-to-Speech Synthesis—0
Comparing normalizing flows and diffusion models for prosody and acoustic modelling in text-to-speech—0
SLMGAN: Exploiting Speech Language Model Representations for Unsupervised Zero-Shot Voice Conversion in GANs—0
High-Quality Automatic Voice Over with Accurate Alignment: Supervision through Self-Supervised Discrete Speech Units—0
Voicebox: Text-Guided Multilingual Universal Speech Generation at ScaleCode0
Multilingual Text-to-Speech Synthesis for Turkic Languages Using TransliterationCode1
ZET-Speech: Zero-shot adaptive Emotion-controllable Text-to-Speech Synthesis with Diffusion and Style-based Models—0
VAKTA-SETU: A Speech-to-Speech Machine Translation Service in Select Indic Languages—0
Show:102550
← PrevPage 2 of 7Next →
All datasetsLJSpeech20000 utterancesCMUDict 0.7bHUI speech corpusThorsten voice 21.02 neutralTrinity Speech-Gesture Dataset

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1NaturalSpeechAudio Quality MOS4.56—Unverified
2VITSAudio Quality MOS4.43—Unverified
3Grad-TTS + HiFiGAN (1000 steps)Audio Quality MOS4.37—Unverified
4FastSpeech 2 + HiFiGANAudio Quality MOS4.34—Unverified
5Glow-TTS + HiFiGANAudio Quality MOS4.34—Unverified
6FastSpeech 2 + HiFiGANAudio Quality MOS4.32—Unverified
7FastDiff (4 steps)Audio Quality MOS4.28—Unverified
8FastDiff-TTSAudio Quality MOS4.03—Unverified
9Transformer TTS (Mel + WaveGlow)Audio Quality MOS3.88—Unverified
10FastSpeech (Mel + WaveGlow)Audio Quality MOS3.84—Unverified
#ModelMetricClaimedVerifiedStatus
1Mia10-keyword Speech Commands dataset16—Unverified
#ModelMetricClaimedVerifiedStatus
1Token-Level Ensemble DistillationPhoneme Error Rate4.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score3.74—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score3.49—Unverified
#ModelMetricClaimedVerifiedStatus
1Match-TTSGMOS3.7—Unverified