Microsoft patents real-time AI lip and audio editing

Microsoft has filed a patent for an artificial intelligence system designed to alter live video and audio feeds in real time, replacing speakers' words and editing their mouths to match. The proposed technology could be used for real-time language translation, removing filler words or speech impediments, and filtering out colloquial terms or phrases deemed inappropriate by viewers. While potential applications include personalized viewing preferences, the patent acknowledges the risk of misuse and mentions that original feeds could be stored for ground truth. Open article →