Microsoft files patent for real-time AI that rewrites livestream speech and syncs lips
Microsoft has filed a patent, uncovered by Patentlyze, describing an AI system that can listen to a livestream's audio, swap out words based on a viewer's profile data like age or language, and adjust lip movements to hide the edit. The filing also outlines a separate translation feature that dubs livestreams with matching lip sync while preserving the original recording as a reference.