Speaker-Specific Lip to Speech Synthesis

How accurately can we infer an individual’s speech style and content from his/her lip movements? [1]

In this task, the model is trained on a specific speaker, or a very limited set of speakers.

[1] Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis, CVPR 2020.

Papers

Showing 1–4 of 4 papers

Title	Date	Tasks	Status	Hype
Densely Connected Convolutional Networks	Aug 25, 2016	Breast Tumour ClassificationClassification	CodeCode Available	1
Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis	May 17, 2020	Lip ReadingLip to Speech Synthesis	CodeCode Available	1
RobustL2S: Speaker-Specific Lip-to-Speech Synthesis exploiting Self-Supervised Representations	Jul 3, 2023	Lip to Speech SynthesisSpeaker-Specific Lip to Speech Synthesis	—Unverified	0
Speech Reconstruction with Reminiscent Sound via Visual Voice Memory	Nov 17, 2021	Speaker-Specific Lip to Speech Synthesis	CodeCode Available	0

Show:10 25 50

No leaderboard results yet.