Concerns about deepfakes are nothing new, but the technology has advanced far faster than many anticipated and has given rise to a medium that’s terrifying in its potential, says Jarrod Overson, Principal Technical Evangelist, F5 Networks.
Though watching Jim Carrey’s face on Allison Brie’s body is, admittedly, delightful, the implications for forgery are sobering. Consider, for instance, the recent deep fake using Vladimir Putin’s face over MIT Technology Review’s editor-in-chief Gideon Lichfield’s body. Though it’s clear that Putin himself isn’t being interviewed, it isn’t a bad effort. It also doesn’t take a big imaginative leap to envision how the technology can be further enhanced and used with nefarious intent.
In the meantime, here are five useful tips to separate digital sophistry from the real thing:
1. Be aware of differences in quality and resolution between the facial components and the rest of the video. Sources are often higher quality than destination videos, leading to strangely high-definition faces on top of lower-definition bodies and backgrounds. This is especially apparent in the Steve Buscemi/Jennifer Lawrence demo that went viral. Note the fuzziness of the Golden Globe Awards background compared to Steve Buscemi’s eerily vivid face.
2. Look out for any points where a person’s face is obscured or at a sharp angle. This often results in blurrier artifacts or inconsistent motion, which is indicative of a deepfake. A great example of this is the Jim Carrey deepfake of Jack Nicholson in The Shining. Inconsistent motion is especially visible while delivering the famous, “Here’s Johnny!” line.
3. Note any inconsistencies in the scale of faces compared to the rest of their body. Deepfakes with multiple camera angles may scale or morph the face differently to achieve believability in each scene. This will result in faces of different scales across the whole video. Check out a gloriously weird Sylvester Stallone Terminator 2 deepfake for a good demonstration of the scaling problem.
4. Keep an eye on inconsistent facial border features. Facial components on the border (chin, eyebrows, cheekbones, facial hair, freckles/birthmarks) may alternate between the original and the replacement. Any inconsistency there is indicative of a deepfake. For example, take a look at this deepfake of Bill Hader and Tom Cruise. It’s very well-done, but the deepfake is given away by inconsistent cheekbones and jawline.
5. Watch out for uneven skin tones/”shimmering”. Matching the skin tone and facial movement, especially at the border, is difficult and gives away deepfakes quickly. The recent Jim Carrey/Alison Brie demo showcases the problems with skin shimmering.
Even if these techniques don’t last, they are helpful examples you can use to train your suspicion meter early. Deepfakes will certainly progress in quality, and their proliferation is guaranteed, so it’s up to you to develop an investigative mindset. Blindly trusting media is negligence.
Start practicing your sharp eyes now so they can be better prepared for the deepfake future that’s just around the corner, and better distinguish fact from fiction.
