We have seen face swap technology come a long way over the past couple of years. Just in the past couple of years, we’ve seen Marvel use de-aging technology in Ant-Man and the Wasp, as well as that same tech in The Irishman. The technology has become better and will continue to do so. Proof of that comes in from a recent report from Disney studios.
Researchers from Disney Research Studios have proved a new Deepfake technology that has the potential to make it more widely utilized in the Movie and TV industry. Disney displayed a video presentation and paper at a recent computer graphics conference, showing off what they claim is the first photo-realistic Deepfake that can render results at megapixel resolution.
In a new paper being presented at the 2020 Eurographics Symposium on Rendering titled High-Resolution Neural Face Swapping for Visual Effects, “researchers from ETH Zurich and Disney Research Studios detail some new discoveries and procedures to automated face-swaps that produce megapixel results with enough quality and resolution to be used for actual film production.”
Check out the video below that shows you what they’re talking about. It’s pretty unbelievable to see, and it shows how far the tech has come, and where it is headed.
What is Face Swap or Deepfake and how it works :
Deep fake is a type of artificial intelligence used to create convincing images, audio, and video hoaxes. The term, which describes both the technology and the resulting bogus content, is a portmanteau of deep learning and fake.
To create the deepfakes, makers start with a recording of a person showing some fancied behavior, like talking. Next, they perform face alignment by detecting facial landmarks, or certain shapes that match to given facial features—the same underlying principle that facial identification software platforms use.
Then, “transform and normalize” the image to the resolution and feed the image into their decoder program, which swaps the input face with a target face.
The capability to change out the appearance of one face for another could be endlessly useful for large media companies. Usually, it takes extensive and labor-intensive visual effects (VFX) techniques to make an actor appear younger or to use footage of a late actor in a film that hasn’t yet wrapped filming. Consider Paul Walker in Fast And Furious 7, or the forthcoming movie starring the long-dead James Dean.