365体育官方网站

Latest in Gaming

Image credit: Unreal Engine

Facial mocap comes to Unreal Engine via new iPhone app

You don’t need a mocap suit or soundstage to get these effects.
Ann Smajstrla
July 9, 2020
283 Shares
Share
Tweet
Share

Sponsored Links

A demonstration of how Live Link Face records a person's facial movements.
Unreal Engine

365体育官方网站A new iOS app for Unreal Engine uses your iPhone to capture your facial expressions and animate an onscreen character in real time. Live Link Face is designed to work in both professional game production settings, like a soundstage with actors in full mocap suits, and amaetur ones, such as a single artist at a desk, according to a from Unreal Engine developer Epic Games. The app is available now from .

The app uses Apple’s augmented reality platform, ARKit, and the iPhone’s front-facing TrueDepth camera (introduced on the iPhone X in 2017) to capture facial features and transmit the data to Unreal Engine. The app also captures head and neck movement.

365体育官方网站To support collaborative work, Live Link Face uses multicast networking to synchronize with multiple devices at once. Developers promise “robust timecode support and precise frame accuracy” to further support multi-device synchronization. The “tentacle sync” feature allows the app to connect with a master clock on stage.

365体育官方网站The post doesn’t mention whether an Android equivalent app is in the works. This could be because it would be near-impossible to ensure this mocap app would work with the dozens of different front camera setups found in the many Android phones available. Developing it for the iPhone means Epic could target the TrueDepth camera and not have to worry about variations on it.

Unreal Engine is one of the most widely-used production tools for games and other media, included in titles as big as Fortnite and The Mandalorian. Epic plans to continue making Unreal widely available, saying, “continued democratization of real-time tools for virtual production is one of the primary goals of Unreal Engine development.” 

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
283 Shares
Share
Tweet
Share

Popular on Engadget

Engadget's 2020 Back-to-School Guide

Engadget's 2020 Back-to-School Guide

View
Our readers get real about their issues with the AirPods Pro

Our readers get real about their issues with the AirPods Pro

View
20GB of Intel internal documents were leaked online

20GB of Intel internal documents were leaked online

View
Trump executive order seeks to ban TikTok, WeChat 'transactions' in 45 days

Trump executive order seeks to ban TikTok, WeChat 'transactions' in 45 days

View
Disney has no idea what it's doing with 'Mulan'

Disney has no idea what it's doing with 'Mulan'

View

From around the web

Facial mocap comes to Unreal Engine via new iPhone app | Engadget Facial mocap comes to Unreal Engine via new iPhone app | Engadget Facial mocap comes to Unreal Engine via new iPhone app | Engadget Facial mocap comes to Unreal Engine via new iPhone app | Engadget Facial mocap comes to Unreal Engine via new iPhone app | Engadget Facial mocap comes to Unreal Engine via new iPhone app | Engadget Facial mocap comes to Unreal Engine via new iPhone app | Engadget