Speech Synthesis

Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.

Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.

( Image credit: WaveNet: A generative model for raw audio )

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 201–225 of 1249 papers

Title	Date	Tasks	Status	Hype
DiffWave: A Versatile Diffusion Model for Audio Synthesis	Sep 21, 2020	Audio SynthesisDiversity	CodeCode Available	1
WaveGrad: Estimating Gradients for Waveform Generation	Sep 2, 2020	Speech SynthesisText-To-Speech Synthesis	CodeCode Available	1
Dynamical Variational Autoencoders: A Comprehensive Review	Aug 28, 2020	3D Human DynamicsResynthesis	CodeCode Available	1
Laughter Synthesis: Combining Seq2seq modeling with Transfer Learning	Aug 20, 2020	Expressive Speech SynthesisSpeech Synthesis	CodeCode Available	1
Enhancing Speech Intelligibility in Text-To-Speech Synthesis using Speaking Style Conversion	Aug 13, 2020	Speech Synthesistext-to-speech	CodeCode Available	1
Attentron: Few-Shot Text-to-Speech Utilizing Attention-Based Variable-Length Embedding	Aug 12, 2020	Speech Synthesistext-to-speech	CodeCode Available	1
Speaker Conditional WaveRNN: Towards Universal Neural Vocoder for Unseen Speaker and Recording Conditions	Aug 9, 2020	Speech Synthesistext-to-speech	CodeCode Available	1
SpeedySpeech: Efficient Neural Speech Synthesis	Aug 9, 2020	Audio SynthesisCPU	CodeCode Available	1
Phonological Features for 0-shot Multilingual Speech Synthesis	Aug 6, 2020	Speech Synthesistext-to-speech	CodeCode Available	1
A Spectral Energy Distance for Parallel Speech Synthesis	Aug 3, 2020	scoring ruleSpeech Synthesis	CodeCode Available	1
One Model, Many Languages: Meta-learning for Multilingual Text-to-Speech	Aug 3, 2020	Meta-LearningSpeech Synthesis	CodeCode Available	1
VocGAN: A High-Fidelity Real-time Vocoder with a Hierarchically-nested Adversarial Network	Jul 30, 2020	CPUGPU	CodeCode Available	1
NanoFlow: Scalable Normalizing Flows with Sublinear Parameter Complexity	Jun 11, 2020	Density EstimationNormalising Flows	CodeCode Available	1
WaveNODE: A Continuous Normalizing Flow for Speech Synthesis	Jun 8, 2020	Speech Synthesis	CodeCode Available	1
FastSpeech 2: Fast and High-Quality End-to-End Text to Speech	Jun 8, 2020	Knowledge DistillationSpeech Synthesis	CodeCode Available	1
End-to-End Adversarial Text-to-Speech	Jun 5, 2020	Adversarial TextDynamic Time Warping	CodeCode Available	1
PolyDL: Polyhedral Optimizations for Creation of High Performance DL primitives	Jun 2, 2020	speech-recognitionSpeech Recognition	CodeCode Available	1
Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis	May 17, 2020	Lip ReadingLip to Speech Synthesis	CodeCode Available	1
Flowtron: an Autoregressive Flow-based Generative Network for Text-to-Speech Synthesis	May 12, 2020	Speech SynthesisStyle Transfer	CodeCode Available	1
TTS-Portuguese Corpus: a corpus for speech synthesis in Brazilian Portuguese	May 11, 2020	DenoisingSpeech Synthesis	CodeCode Available	1
From Speaker Verification to Multispeaker Speech Synthesis, Deep Transfer with Feedback Constraint	May 10, 2020	Speaker VerificationSpeech Synthesis	CodeCode Available	1
Can Speaker Augmentation Improve Multi-Speaker End-to-End TTS?	May 4, 2020	Speech Synthesis	CodeCode Available	1
Perception of prosodic variation for speech synthesis using an unsupervised discrete representation of F0	Mar 14, 2020	ClusteringRepresentation Learning	CodeCode Available	1
A Neuro-AI Interface for Evaluating Generative Adversarial Networks	Mar 5, 2020	Speech Synthesis	CodeCode Available	1
A Resource for Computational Experiments on Mapudungun	Dec 4, 2019	Machine Translationspeech-recognition	CodeCode Available	1

Show:10 25 50

← PrevPage 9 of 50Next →

All datasets LibriTTS North American English LJSpeech Mandarin Chinese Blizzard Challenge 2013

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	PeriodWave-Turbo-L	PESQ	4.45	—	Unverified
2	BigVGAN-v2	PESQ	4.36	—	Unverified
3	EVA-GAN-big	PESQ	4.35	—	Unverified
4	PeriodWave + FreeU	PESQ	4.25	—	Unverified
5	RFWave	PESQ	4.23	—	Unverified
6	BigVSAN (w/ snakebeta)	PESQ	4.12	—	Unverified
7	BigVSAN	PESQ	4.12	—	Unverified
8	EVA-GAN-base	PESQ	4.03	—	Unverified
9	BigVGAN	PESQ	4.03	—	Unverified
10	Vocos	PESQ	3.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Tacotron 2	Mean Opinion Score	4.53	—	Unverified
2	WaveNet (Linguistic)	Mean Opinion Score	4.34	—	Unverified
3	WaveNet (L+F)	Mean Opinion Score	4.21	—	Unverified
4	Tacotron	Mean Opinion Score	4	—	Unverified
5	HMM-driven concatenative	Mean Opinion Score	3.86	—	Unverified
6	LSTM-RNN parametric	Mean Opinion Score	3.67	—	Unverified
7	means	Mean Opinion Score	0	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BDDM vocoder	Mean Opinion Score	4.48	—	Unverified
2	DiffWave LARGE	Mean Opinion Score	4.44	—	Unverified
3	Neural HMM	Mean Opinion Score	3.24	—	Unverified
4	Neural HMM Ablation with 1 state per phone	Mean Opinion Score	2.68	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	WaveNet (L+F)	Mean Opinion Score	4.08	—	Unverified
2	LSTM-RNN parametric	Mean Opinion Score	3.79	—	Unverified
3	HMM-driven concatenative	Mean Opinion Score	3.47	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SampleRNN (2-tier)	NLL	1.39	—	Unverified
2	SampleRNN (3-tier)	NLL	1.39	—	Unverified