Researchers have developed a generative neural network to make fake videos of talking heads. It’s getting a lot harder to tell the difference between real and deep fakes.
We present a novel approach that enables photo-realistic re-animation of portrait videos using only an input video. In contrast to existing approaches that are restricted to manipulations of facial expressions only, we are the first to transfer the full 3D head position, head rotation, face expression, eye gaze, and eye blinking from a source actor to a portrait video of a target actor.