Facebook machine learning aims to modify faces, hands and outfits

The latest research out of Facebook sets machine learning models to tasks that, to us, seem rather ordinary but for a computer are still monstrously difficult.

These projects aim to anonymize faces, improvise hand movements and perhaps hardest of all give credible fashion advice.

Deepfakes use a carefully cultivated understanding of the faces features and landmarks to map one persons expressions and movements onto a completely different face. The Facebook team used the same features and landmarks, but instead uses them to tweak the face just enough that its no longer recognizable to facial recognition engines.

This could allow someone who, for whatever reason, wants to appear on video but not be recognized publicly to do so without something as clunky as a mask or completely fabricated face.

Instead, theyd look a bit like themselves, but with slightly wider-set eyes, a thinner mouth, higher forehead and so on.

The system they created appears to work well, but would of course require some optimization before it can be deployed as a product. But one can imagine how useful such a thing might be, either for those at risk of retribution from political oppressors or more garden variety privacy preferences.

Its a little funny to think about, but really theres not a lot of data on how exactly people move their hands when they talk. Its always nice to detect faces in a photo faster or more accurately, or infer location from the objects in a room, but clearly there are many more obscure or surprising aspects of digital life that could be improved with a little visual intelligence.

Original article
Author: Devin Coldewey

TechCrunch is a leading technology media property, dedicated to obsessively profiling startups, reviewing new Internet products, and breaking tech news.

Devin Coldewey has recently written 9 articles on similar topics including :
  1. "Facebook has challenged the FTCs antitrust case against it using a standard playbook that questions the agencys arguably expansive approach to defining monopolies". (March 10, 2021)
  2. "Facebook first showed off its 3D photos back in 2018, and shared the technical details behind it a month later. But unless you had one of a handful of phones with dual cameras back then (when they weren't so common), you couldn't make your own". (February 28, 2020)
  3. "Facebooks battle against misinformation will never be over at this rate, but that doesnt mean the company has given up". (November 19, 2020)
  4. "Facebooks AI tools are the only thing standing between its users and the growing onslaught of hate and misinformation the platform is experiencing". (May 12, 2020)
  5. "Facebook will soon add labels to news outlets owned or otherwise controlled by a government, marking that information as, if not necessarily false or unreliable, at least worth considering the origin of. Those so labeled will also be banned from buying ads starting this summer". (June 4, 2020)
  6. "If AI-powered robots are ever going to help us out around the house, they're going to need a lot of experience navigating human environments". (June 14, 2019)
  7. "If you've ever seen a lamp or chair that you liked and wished you could just take a picture and find it online, well, GrokStyle let you do that — and now the company has been snatched up by Facebook to augment its own growing computer vision department". (February 9, 2019)
  8. "Facebook's WhatsApp is in the midst of a lawsuit against Israeli mobile surveillance outfit NSO Group. But before complaining about the company's methods, Facebook seems to have wanted to use them for its own purposes, according to testimony from NSO founder Shalev Hulio". (April 4, 2020)
  9. "An independent investigator has issued a preliminary report on its work determining the existence and/or extent of bias against conservatives on Facebook". (August 28, 2019)
Posted on  , ,