Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1026–1050 of 1249 papers

Title	Date	Tasks	Status	Hype
Indigenous language technologies in Canada: Assessment, challenges, and successes	Aug 1, 2018	Machine TranslationOptical Character Recognition	—Unverified	0
Wasserstein GAN and Waveform Loss-based Acoustic Model Training for Multi-speaker Text-to-Speech Synthesis Systems Using a WaveNet Vocoder	Jul 31, 2018	Generative Adversarial NetworkSpeech Synthesis	—Unverified	0
Scaling and bias codes for modeling speaker-adaptive DNN-based speech synthesis systems	Jul 31, 2018	Speech Synthesis	—Unverified	0
Deep Encoder-Decoder Models for Unsupervised Learning of Controllable Speech Synthesis	Jul 30, 2018	Acoustic ModellingDecoder	—Unverified	0
Analysing Shortcomings of Statistical Parametric Speech Synthesis	Jul 28, 2018	Speech Synthesis	—Unverified	0
ClariNet: Parallel Wave Generation in End-to-End Text-to-Speech	Jul 19, 2018	Speech Synthesistext-to-speech	CodeCode Available	1
Forward Attention in Sequence-to-sequence Acoustic Modelling for Speech Synthesis	Jul 18, 2018	Acoustic ModellingDecoder	—Unverified	0
Syllabification by Phone Categorization	Jul 15, 2018	Retrievalspeech-recognition	—Unverified	0
An Analysis of the Effect of Emotional Speech Synthesis on Non-Task-Oriented Dialogue System	Jul 1, 2018	Dialogue ManagementEmotional Speech Synthesis	—Unverified	0
EMPHASIS: An Emotional Phoneme-based Acoustic Model for Speech Synthesis System	Jun 26, 2018	Emotional Speech SynthesisParameter Prediction	—Unverified	0
The Emotional Voices Database: Towards Controlling the Emotion Dimension in Voice Generation Systems	Jun 25, 2018	Speech Emotion RecognitionSpeech Synthesis	CodeCode Available	0
Multi-task WaveNet: A Multi-task Generative Model for Statistical Parametric Speech Synthesis without Fundamental Frequency Conditions	Jun 22, 2018	Multi-Task LearningPrediction	—Unverified	0
A Variational Prosody Model for the decomposition and synthesis of speech prosody	Jun 22, 2018	Speech Synthesis	CodeCode Available	0
Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis	Jun 12, 2018	Speaker VerificationSpeech Synthesis	CodeCode Available	0
Mixed-Precision Training for NLP and Speech Recognition with OpenSeq2Seq	May 25, 2018	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	CodeCode Available	0
ASR-based Features for Emotion Recognition: A Transfer Learning Approach	May 23, 2018	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	—Unverified	0
A Regression Model of Recurrent Deep Neural Networks for Noise Robust Estimation of the Fundamental Frequency Contour of Speech	May 8, 2018	Language IdentificationSpeech Synthesis	—Unverified	0
Construction of English-French Multimodal Affective Conversational Corpus from TV Dramas	May 1, 2018	Emotion RecognitionSpeech Recognition	—Unverified	0
From `Solved Problems' to New Challenges: A Report on LDC Activities	May 1, 2018	Dialogue ManagementLanguage Identification	—Unverified	0
Design and Development of Speech Corpora for Air Traffic Control Training	May 1, 2018	Automatic Speech Recognition (ASR)Speech Recognition	—Unverified	0
FonBund: A Library for Combining Cross-lingual Phonological Segment Data	May 1, 2018	Language ModelingLanguage Modelling	CodeCode Available	1
SynPaFlex-Corpus: An Expressive French Audiobooks Corpus dedicated to expressive speech synthesis.	May 1, 2018	Expressive Speech SynthesisSpeech Synthesis	—Unverified	0
Literality and cognitive effort: Japanese and Spanish	May 1, 2018	Speech Synthesis	—Unverified	0
Improving homograph disambiguation with supervised machine learning	May 1, 2018	BIG-bench Machine LearningSpeech Synthesis	—Unverified	0
CPJD Corpus: Crowdsourced Parallel Speech Corpus of Japanese Dialects	May 1, 2018	Machine TranslationSpeech Recognition	—Unverified	0

Show:10 25 50

← PrevPage 42 of 50Next →

All datasets LibriTTS North American English LJSpeech Mandarin Chinese Blizzard Challenge 2013

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	PeriodWave-Turbo-L	PESQ	4.45	—	Unverified
2	BigVGAN-v2	PESQ	4.36	—	Unverified
3	EVA-GAN-big	PESQ	4.35	—	Unverified
4	PeriodWave + FreeU	PESQ	4.25	—	Unverified
5	RFWave	PESQ	4.23	—	Unverified
6	BigVSAN (w/ snakebeta)	PESQ	4.12	—	Unverified
7	BigVSAN	PESQ	4.12	—	Unverified
8	EVA-GAN-base	PESQ	4.03	—	Unverified
9	BigVGAN	PESQ	4.03	—	Unverified
10	Vocos	PESQ	3.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Tacotron 2	Mean Opinion Score	4.53	—	Unverified
2	WaveNet (Linguistic)	Mean Opinion Score	4.34	—	Unverified
3	WaveNet (L+F)	Mean Opinion Score	4.21	—	Unverified
4	Tacotron	Mean Opinion Score	4	—	Unverified
5	HMM-driven concatenative	Mean Opinion Score	3.86	—	Unverified
6	LSTM-RNN parametric	Mean Opinion Score	3.67	—	Unverified
7	means	Mean Opinion Score	0	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BDDM vocoder	Mean Opinion Score	4.48	—	Unverified
2	DiffWave LARGE	Mean Opinion Score	4.44	—	Unverified
3	Neural HMM	Mean Opinion Score	3.24	—	Unverified
4	Neural HMM Ablation with 1 state per phone	Mean Opinion Score	2.68	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WaveNet (L+F)	Mean Opinion Score	4.08	—	Unverified
2	LSTM-RNN parametric	Mean Opinion Score	3.79	—	Unverified
3	HMM-driven concatenative	Mean Opinion Score	3.47	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SampleRNN (2-tier)	NLL	1.39	—	Unverified
2	SampleRNN (3-tier)	NLL	1.39	—	Unverified