Lip to Speech Synthesis

Given a silent video of a speaker, generate the corresponding speech that matches the lip movements.

Papers

Showing 11–13 of 13 papers

Title	Date	Tasks	Status
On the Audio-visual Synchronization for Lip-to-Speech Synthesis	Mar 1, 2023	Audio-Visual SynchronizationLip to Speech Synthesis	—Unverified
RobustL2S: Speaker-Specific Lip-to-Speech Synthesis exploiting Self-Supervised Representations	Jul 3, 2023	Lip to Speech SynthesisSpeaker-Specific Lip to Speech Synthesis	—Unverified
FastLTS: Non-Autoregressive End-to-End Unconstrained Lip-to-Speech Synthesis	Jul 8, 2022	Lip to Speech SynthesisSpeech Synthesis	CodeCode Available

Show:10 25 50

← PrevPage 2 of 2Next →

#	Model	Metric	Claimed	Verified	Status
1	Lip2Wav	ESTOI	0.34	—	Unverified