Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1001–1025 of 1249 papers

Title	Date	Tasks	Status	Hype
ExcitNet vocoder: A neural excitation model for parametric speech synthesis systems	Nov 9, 2018	Speech Synthesis	—Unverified	0
Speaker-adaptive neural vocoders for parametric speech synthesis systems	Nov 8, 2018	Speech Synthesistext-to-speech	—Unverified	0
Robust and fine-grained prosody control of end-to-end speech synthesis	Nov 6, 2018	Expressive Speech SynthesisSpeech Synthesis	CodeCode Available	0
Investigating context features hidden in End-to-End TTS	Nov 4, 2018	Feature EngineeringSpeech Synthesis	—Unverified	0
WaveGlow: A Flow-based Generative Network for Speech Synthesis	Oct 31, 2018	Audio SynthesisGPU	CodeCode Available	0
End-to-End Feedback Loss in Speech Chain Framework via Straight-Through Estimator	Oct 31, 2018	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	—Unverified	0
Disentangling Correlated Speaker and Noise for Speech Synthesis via Data Augmentation and Adversarial Factorization	Oct 30, 2018	Data AugmentationDisentanglement	—Unverified	0
How to make someone speak a language that they don't know.	Oct 30, 2018	DecoderSpeech Synthesis	—Unverified	0
Waveform generation for text-to-speech synthesis using pitch-synchronous multi-scale generative adversarial networks	Oct 30, 2018	Image GenerationSpeech Synthesis	—Unverified	0
Speaking style adaptation in Text-To-Speech synthesis using Sequence-to-sequence models with attention	Oct 29, 2018	Speech Synthesistext-to-speech	—Unverified	0
Investigation of enhanced Tacotron text-to-speech synthesis systems with self-attention for pitch accent language	Oct 29, 2018	Speech Synthesistext-to-speech	CodeCode Available	0
Neural source-filter-based waveform model for statistical parametric speech synthesis	Oct 29, 2018	Speech Synthesistext-to-speech	—Unverified	0
LPCNet: Improving Neural Speech Synthesis Through Linear Prediction	Oct 28, 2018	PredictionSpeech Synthesis	CodeCode Available	2
Learning pronunciation from a foreign language in speech synthesis networks	Oct 22, 2018	Speech Synthesis	CodeCode Available	0
Hierarchical Generative Modeling for Controllable Speech Synthesis	Oct 16, 2018	AttributeSpeech Synthesis	CodeCode Available	0
A Challenge Set and Methods for Noun-Verb Ambiguity	Oct 1, 2018	Speech Synthesistext-to-speech	—Unverified	0
WaveCycleGAN: Synthetic-to-natural speech waveform conversion using cycle-consistent adversarial networks	Sep 25, 2018	Speech SynthesisVoice Conversion	—Unverified	0
Hindi-English Code-Switching Speech Corpus	Sep 24, 2018	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	—Unverified	0
Neural Speech Synthesis with Transformer Network	Sep 19, 2018	DecoderMachine Translation	CodeCode Available	2
Self-Attention Linguistic-Acoustic Decoder	Aug 31, 2018	CPUDecoder	—Unverified	0
Semi-Supervised Training for Improving Data Efficiency in End-to-End Speech Synthesis	Aug 30, 2018	DecoderSpeech Synthesis	—Unverified	0
Fast Spectrogram Inversion using Multi-head Convolutional Neural Networks	Aug 20, 2018	speech-recognitionSpeech Recognition	—Unverified	0
Multimodal speech synthesis architecture for unsupervised speaker adaptation	Aug 20, 2018	Speech Synthesis	—Unverified	0
Predicting Expressive Speaking Style From Text In End-To-End Speech Synthesis	Aug 4, 2018	Speech Synthesistext-to-speech	—Unverified	0
Investigating accuracy of pitch-accent annotations in neural network-based speech synthesis and denoising effects	Aug 2, 2018	DenoisingSpeech Synthesis	—Unverified	0

Show:10 25 50

← PrevPage 41 of 50Next →

All datasets LibriTTS North American English LJSpeech Mandarin Chinese Blizzard Challenge 2013

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	PeriodWave-Turbo-L	PESQ	4.45	—	Unverified
2	BigVGAN-v2	PESQ	4.36	—	Unverified
3	EVA-GAN-big	PESQ	4.35	—	Unverified
4	PeriodWave + FreeU	PESQ	4.25	—	Unverified
5	RFWave	PESQ	4.23	—	Unverified
6	BigVSAN (w/ snakebeta)	PESQ	4.12	—	Unverified
7	BigVSAN	PESQ	4.12	—	Unverified
8	EVA-GAN-base	PESQ	4.03	—	Unverified
9	BigVGAN	PESQ	4.03	—	Unverified
10	Vocos	PESQ	3.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Tacotron 2	Mean Opinion Score	4.53	—	Unverified
2	WaveNet (Linguistic)	Mean Opinion Score	4.34	—	Unverified
3	WaveNet (L+F)	Mean Opinion Score	4.21	—	Unverified
4	Tacotron	Mean Opinion Score	4	—	Unverified
5	HMM-driven concatenative	Mean Opinion Score	3.86	—	Unverified
6	LSTM-RNN parametric	Mean Opinion Score	3.67	—	Unverified
7	means	Mean Opinion Score	0	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BDDM vocoder	Mean Opinion Score	4.48	—	Unverified
2	DiffWave LARGE	Mean Opinion Score	4.44	—	Unverified
3	Neural HMM	Mean Opinion Score	3.24	—	Unverified
4	Neural HMM Ablation with 1 state per phone	Mean Opinion Score	2.68	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WaveNet (L+F)	Mean Opinion Score	4.08	—	Unverified
2	LSTM-RNN parametric	Mean Opinion Score	3.79	—	Unverified
3	HMM-driven concatenative	Mean Opinion Score	3.47	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SampleRNN (2-tier)	NLL	1.39	—	Unverified
2	SampleRNN (3-tier)	NLL	1.39	—	Unverified