Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 876–900 of 1249 papers

Title	Date	Tasks	Status	Hype
TTS-Portuguese Corpus: a corpus for speech synthesis in Brazilian Portuguese	May 11, 2020	DenoisingSpeech Synthesis	CodeCode Available	1
From Speaker Verification to Multispeaker Speech Synthesis, Deep Transfer with Feedback Constraint	May 10, 2020	Speaker VerificationSpeech Synthesis	CodeCode Available	1
Building A User-Centric and Content-Driven Socialbot	May 6, 2020	ArticlesManagement	—Unverified	0
Can Speaker Augmentation Improve Multi-Speaker End-to-End TTS?	May 4, 2020	Speech Synthesis	CodeCode Available	1
Development and Evaluation of Speech Synthesis Corpora for Latvian	May 1, 2020	speech-recognitionSpeech Recognition	—Unverified	0
Open-source Multi-speaker Speech Corpora for Building Gujarati, Kannada, Malayalam, Marathi, Tamil and Telugu Speech Synthesis Systems	May 1, 2020	Speech Synthesistext-to-speech	—Unverified	0
DNN-based Speech Synthesis Using Abundant Tags of Spontaneous Speech Corpus	May 1, 2020	Speech Synthesis	—Unverified	0
Augmented Prompt Selection for Evaluation of Spontaneous Speech Synthesis	May 1, 2020	Speech Synthesis	—Unverified	0
Corpus Generation for Voice Command in Smart Home and the Effect of Speech Synthesis on End-to-End SLU	May 1, 2020	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	—Unverified	0
Manual Speech Synthesis Data Acquisition - From Script Design to Recording Speech	May 1, 2020	Speech Synthesis	—Unverified	0
Neural Text-to-Speech Synthesis for an Under-Resourced Language in a Diglossic Environment: the Case of Gascon Occitan	May 1, 2020	Speech Synthesistext-to-speech	—Unverified	0
Style Variation as a Vantage Point for Code-Switching	May 1, 2020	Language ModelingLanguage Modelling	—Unverified	0
Adversarial Feature Learning and Unsupervised Clustering based Speech Synthesis for Found Data with Acoustic and Textual Noise	Apr 28, 2020	ClusteringData Augmentation	—Unverified	0
Utterance-level Sequential Modeling For Deep Gaussian Process Based Speech Synthesis Using Simple Recurrent Unit	Apr 22, 2020	Speech Synthesis	—Unverified	0
An explainability study of the constant Q cepstral coefficient spoofing countermeasure for automatic speaker verification	Apr 19, 2020	Speaker VerificationSpeech Synthesis	—Unverified	0
Advancing Speech Synthesis using EEG	Apr 9, 2020	EEGElectroencephalogram (EEG)	—Unverified	0
Vocoder-Based Speech Synthesis from Silent Videos	Apr 6, 2020	Multi-Task LearningSpeech Synthesis	—Unverified	0
Language Technology Programme for Icelandic 2019-2023	Mar 20, 2020	Machine Translationspeech-recognition	CodeCode Available	0
Perception of prosodic variation for speech synthesis using an unsupervised discrete representation of F0	Mar 14, 2020	ClusteringRepresentation Learning	CodeCode Available	1
Unsupervised Style and Content Separation by Minimizing Mutual Information for Speech Synthesis	Mar 9, 2020	DecoderSpeech Synthesis	—Unverified	0
A Neuro-AI Interface for Evaluating Generative Adversarial Networks	Mar 5, 2020	Speech Synthesis	CodeCode Available	1
GraphTTS: graph-to-sequence modelling in neural text-to-speech	Mar 4, 2020	Graph EmbeddingGraph-to-Sequence	—Unverified	0
Generating EEG features from Acoustic features	Feb 29, 2020	EEGElectroencephalogram (EEG)	—Unverified	0
Comparison of Speech Representations for Automatic Quality Estimation in Multi-Speaker Text-to-Speech Synthesis	Feb 28, 2020	Speech Synthesistext-to-speech	CodeCode Available	0
Controllable Sequence-To-Sequence Neural TTS with LPCNET Backend for Real-time Speech Synthesis on CPU	Feb 25, 2020	CPUProsody Prediction	—Unverified	0

Show:10 25 50

← PrevPage 36 of 50Next →

All datasets LibriTTS North American English LJSpeech Mandarin Chinese Blizzard Challenge 2013

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	PeriodWave-Turbo-L	PESQ	4.45	—	Unverified
2	BigVGAN-v2	PESQ	4.36	—	Unverified
3	EVA-GAN-big	PESQ	4.35	—	Unverified
4	PeriodWave + FreeU	PESQ	4.25	—	Unverified
5	RFWave	PESQ	4.23	—	Unverified
6	BigVSAN (w/ snakebeta)	PESQ	4.12	—	Unverified
7	BigVSAN	PESQ	4.12	—	Unverified
8	EVA-GAN-base	PESQ	4.03	—	Unverified
9	BigVGAN	PESQ	4.03	—	Unverified
10	Vocos	PESQ	3.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Tacotron 2	Mean Opinion Score	4.53	—	Unverified
2	WaveNet (Linguistic)	Mean Opinion Score	4.34	—	Unverified
3	WaveNet (L+F)	Mean Opinion Score	4.21	—	Unverified
4	Tacotron	Mean Opinion Score	4	—	Unverified
5	HMM-driven concatenative	Mean Opinion Score	3.86	—	Unverified
6	LSTM-RNN parametric	Mean Opinion Score	3.67	—	Unverified
7	means	Mean Opinion Score	0	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BDDM vocoder	Mean Opinion Score	4.48	—	Unverified
2	DiffWave LARGE	Mean Opinion Score	4.44	—	Unverified
3	Neural HMM	Mean Opinion Score	3.24	—	Unverified
4	Neural HMM Ablation with 1 state per phone	Mean Opinion Score	2.68	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WaveNet (L+F)	Mean Opinion Score	4.08	—	Unverified
2	LSTM-RNN parametric	Mean Opinion Score	3.79	—	Unverified
3	HMM-driven concatenative	Mean Opinion Score	3.47	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SampleRNN (2-tier)	NLL	1.39	—	Unverified
2	SampleRNN (3-tier)	NLL	1.39	—	Unverified