'Deepfake face swap' app ZAO is making people afraid of the future

The 'deepfake-style face swap app' ZAO has climbed to the top of Android and iPhone download charts in recent weeks. As its popularity grew, so have privacy concerns on Chinese social media, and now, beyond.

Here's how it works:

The sudden wide adoption of ZAO is an “intriguing development in a country where mass surveillance and facial recognition technology are prevalent,” writes Jake Newby at radiichina.com.

“Some social media platforms, including WeChat, have now started blocking ZAO videos,” Newby writes in an update to his story on Monday. “WeChat has done this before with popular rival short video apps.”

The app — developed by Momo, the same company behind popular Chinese dating app Tantan — became an overnight sensation after it began circulating on Friday evening. Hashtags related to the app quickly became some of the hottest on microblogging site Weibo, while the app rocketed up the iOS download charts. Chinese social media feeds quickly became filled with ZAO-produced videos from friends and contacts for many users.

The premise of the app is pretty simple: take a selfie and put yourself into your favorite movie or soap opera (chosen from a pre-selected list of clips). Cue users giving themselves starring roles in Leonardo DiCaprio’s filmography or uninvited guest appearances on Game of Thrones.

Yet the initial buzz around the app quickly gave way to headlines about privacy concerns as reporters from several major tech publications in China actually bothered to read the 6,000 character user agreement required to download ZAO. One clause in particular is causing consternation as it appears to give the app’s developers the global rights to use any imagery created on the app for free. Once a user has opted in, there doesn’t seem to be the right to revoke the agreement.

This story went viral pretty quickly, and ZAO “responded to the above complaints” by amending the user agreement, writes Newby in another update to the Radii piece:

The new agreement states that content generated on the app will now no longer be used for other purposes without the user’s prior consent. It also says that if a user deletes content on ZAO, this will be wiped from ZAO’s databases too, and injects a clause stating that users bear responsibility for having the authorization to use portraits in the app (thereby making the user culpable if someone’s photo is used without their permission).

[via techmeme.com]