SOTAVerified

Text-To-Speech Synthesis

Text-To-Speech Synthesis is a machine learning task that involves converting written text into spoken words. The goal is to generate synthetic speech that sounds natural and resembles human speech as closely as possible.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 332 papers

TitleStatusHype
ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow MatchingCode4
S2ST-Omni: An Efficient and Scalable Multilingual Speech-to-Speech Translation Framework via Seamless Speech-Text Alignment and Streaming Speech Generation—0
A Novel Data Augmentation Approach for Automatic Speaking Assessment on Opinion Expressions—0
CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speech—0
SALF-MOS: Speaker Agnostic Latent Features Downsampled for MOS Prediction—0
Chain-of-Thought Training for Open E2E Spoken Dialogue Systems—0
Zero-Shot Streaming Text to Speech Synthesis with Transducer and Auto-Regressive Modeling—0
Revival with Voice: Multi-modal Controllable Text-to-Speech Synthesis—0
Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language ModelsCode1
FMSD-TTS: Few-shot Multi-Speaker Multi-Dialect Text-to-Speech Synthesis for Ü-Tsang, Amdo and Kham Speech Dataset Generation—0
Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis—0
Lightweight End-to-end Text-to-speech Synthesis for low resource on-device applications—0
A Multi-Agent Framework for Automated Qinqiang Opera Script Generation Using Large Language Models—0
AutoStyle-TTS: Retrieval-Augmented Generation based Automatic Style Matching Text-to-Speech Synthesis—0
Pseudo-Autoregressive Neural Codec Language Models for Efficient Zero-Shot Text-to-Speech Synthesis—0
MoonCast: High-Quality Zero-Shot Podcast GenerationCode3
ASVspoof 5: Design, Collection and Validation of Resources for Spoofing, Deepfake, and Adversarial Attack Detection Using Crowdsourced Speech—0
PROEMO: Prompt-Driven Text-to-Speech Synthesis Based on Emotion and Intensity Control—0
Low-Resource Text-to-Speech Synthesis Using Noise-Augmented Training of ForwardTacotron—0
Probing Speaker-specific Features in Speaker Representations—0
Stable-TTS: Stable Speaker-Adaptive Text-to-Speech Synthesis via Prosody Prompting—0
Incremental Disentanglement for Environment-Aware Zero-Shot Text-to-Speech Synthesis—0
ProsodyFM: Unsupervised Phrasing and Intonation Control for Intelligible Speech Synthesis—0
Efficient Generative Modeling with Residual Vector Quantization-Based Tokens—0
Multimodal Latent Language Modeling with Next-Token DiffusionCode0
Debatts: Zero-Shot Debating Text-to-Speech Synthesis—0
Lina-Speech: Gated Linear Attention is a Fast and Parameter-Efficient Learner for text-to-speech synthesisCode2
A Unified Framework for Collecting Text-to-Speech Synthesis Datasets for 22 Indian Languages—0
DurIAN-E 2: Duration Informed Attention Network with Adaptive Variational Autoencoder and Adversarial Learning for Expressive Text-to-Speech Synthesis—0
Efficient training strategies for natural sounding speech synthesis and speaker adaptation based on FastPitch—0
Bahasa Harmony: A Comprehensive Dataset for Bahasa Text-to-Speech Synthesis with Discrete Codec Modeling of EnGen-TTS—0
HALL-E: Hierarchical Neural Codec Language Model for Minute-Long Zero-Shot Text-to-Speech Synthesis—0
Generative Semantic Communication for Text-to-Speech Synthesis—0
Accent conversion using discrete units with parallel data synthesized from controllable accented TTS—0
StyleFusion TTS: Multimodal Style-control and Enhanced Feature Fusion for Zero-shot Text-to-speech Synthesis—0
StyleTTS-ZS: Efficient High-Quality Zero-Shot Text-to-Speech Synthesis with Distilled Time-Varying Style Diffusion—0
Text-To-Speech Synthesis In The Wild—0
Full-text Error Correction for Chinese Speech Recognition with Large Language Model—0
SSR-Speech: Towards Stable, Safe and Robust Zero-shot Text-based Speech Editing and SynthesisCode2
What happens to diffusion model likelihood when your model is conditional?—0
AS-Speech: Adaptive Style For Speech Synthesis—0
Sample-Efficient Diffusion for Text-To-Speech SynthesisCode2
Speech Bandwidth Expansion Via High Fidelity Generative Adversarial Networks—0
Spontaneous Style Text-to-Speech Synthesis with Controllable Spontaneous Behaviors Based on Language Models—0
Autoregressive Speech Synthesis without Vector Quantization—0
Improving Accented Speech Recognition using Data Augmentation based on Unsupervised Text-to-Speech Synthesis—0
Robust Zero-Shot Text-to-Speech Synthesis with Reverse Inference Optimization—0
FLY-TTS: Fast, Lightweight and High-Quality End-to-End Text-to-Speech Synthesis—0
Multi-Scale Accent Modeling and Disentangling for Multi-Speaker Multi-Accent Text-to-Speech Synthesis—0
VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment—0
Show:102550
← PrevPage 1 of 7Next →
All datasetsLJSpeech20000 utterancesCMUDict 0.7bHUI speech corpusThorsten voice 21.02 neutralTrinity Speech-Gesture Dataset

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1NaturalSpeechAudio Quality MOS4.56—Unverified
2VITSAudio Quality MOS4.43—Unverified
3Grad-TTS + HiFiGAN (1000 steps)Audio Quality MOS4.37—Unverified
4FastSpeech 2 + HiFiGANAudio Quality MOS4.34—Unverified
5Glow-TTS + HiFiGANAudio Quality MOS4.34—Unverified
6FastSpeech 2 + HiFiGANAudio Quality MOS4.32—Unverified
7FastDiff (4 steps)Audio Quality MOS4.28—Unverified
8FastDiff-TTSAudio Quality MOS4.03—Unverified
9Transformer TTS (Mel + WaveGlow)Audio Quality MOS3.88—Unverified
10FastSpeech (Mel + WaveGlow)Audio Quality MOS3.84—Unverified
#ModelMetricClaimedVerifiedStatus
1Mia10-keyword Speech Commands dataset16—Unverified
#ModelMetricClaimedVerifiedStatus
1Token-Level Ensemble DistillationPhoneme Error Rate4.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score3.74—Unverified
#ModelMetricClaimedVerifiedStatus
1Tacotron 2Mean Opinion Score3.49—Unverified
#ModelMetricClaimedVerifiedStatus
1Match-TTSGMOS3.7—Unverified