Speaker-Specific Lip to Speech Synthesis

How accurately can we infer an individual’s speech style and content from his/her lip movements? [1]

In this task, the model is trained on a specific speaker, or a very limited set of speakers.

[1] Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis, CVPR 2020.