AI pipeline turns iPhone video into Unreal City Sample virtual production

www-users.york.ac.uk12 min read

The author argues that traditional virtual production studios are no longer necessary for high-end video compositing, demonstrating a pipeline that replaces physical green screens and lighting rigs with AI-powered camera tracking, matting, and relighting. Using ordinary mobile phone video combined with automated tools and a 3D scene renderer like Unreal Engine, creators can shoot in any environment and have AI harmonize the actors' lighting and shadows to match the virtual world. Open article →

More on this topic