thaimtl/Silent-Voice: Real-time silent speech translation and voice cloning
Silent Voice is an open-source real-time communication system built at Cal Hacks 13.0 that restores a natural voice to people who have lost their voice box due to laryngectomy. The system combines live lip reading, facial expression analysis, facial muscle EMG signals, and AI language processing to instantly translate silent mouthing into synthesized speech in the user's own voice during phone calls. Open article →