Facebook and Instagram going down reveals hidden message behind your pictures

Artificial intelligence is used to guess who and what is in images

Andrew Griffin
Wednesday 03 July 2019 20:34 BST
Comments
Facebook down: Site and app stops showing photos as users also report issues with Whatsapp

Your support helps us to tell the story

From reproductive rights to climate change to Big Tech, The Independent is on the ground when the story is developing. Whether it's investigating the financials of Elon Musk's pro-Trump PAC or producing our latest documentary, 'The A Word', which shines a light on the American women fighting for reproductive rights, we know how important it is to parse out the facts from the messaging.

At such a critical moment in US history, we need reporters on the ground. Your donation allows us to keep sending journalists to speak to both sides of the story.

The Independent is trusted by Americans across the entire political spectrum. And unlike many other quality news outlets, we choose not to lock Americans out of our reporting and analysis with paywalls. We believe quality journalism should be available to everyone, paid for by those who can afford it.

Your support makes all the difference.

An outage at Facebook and Instagram has inadvertently revealed the usually hidden messages attached to the photos posted by users.

The global problems – which started simultaneously across Facebook products and WhatsApp – left parts of the sites working but others completely broken.

But the issues appeared to have had a particularly pronounced affect on photos. On WhatsApp, pictures could not be sent, while on Instagram and Facebook, images were not loading, leaving the boxes where they would normally appear empty.

However, those same boxes are filled with the usually hidden text, revealing what Facebook does with the images uploaded to the site and to Instagram.

The pictures include a message reading "image may contain". It then goes on to list the things that Facebook's artificial intelligence systems have spotted inside the images, and even occasionally attempts to guess who is in them.

They can be seen on Mark Zuckerberg's own profile, for instance – which mostly loads as normal, but contains a series of errors in the "Photos" section, at the bottom right of this image:

They can be seen on your own profile by simply heading to it in your browser, where the images should show the same. Sometimes, Facebook and Instagram pages will suffer more severe faults and simply refuse to load, though they may reappear when the page is refreshed.

The descriptions are often much more detailed than those shown on Mark Zuckerberg's profile. They appear to be able to identify what a person might be doing in a picture, such as dancing or walking, whether a pet or certain object included in the image and information about they were taken, such as at a wedding, outdoors, or at night.

Facebook's attempts to guess what is in pictures serve a range of purposes.

Importantly, the tools are used to add accessibility to the site. If people are unable to see the photographs, then they can instead use technology to read what the images contain.

Such notes, which are known as alt-text, can be vital to people who are blind or partially sighted. Traditionally, that alt-text is added manually by the person who shares an image – sites such as Twitter give people a feed to describe the thing they are uploading – but the rise of artificial intelligence has offered a way to allow computers to do the work.

But those automated descriptions are also a reminder of the sophisticated processing technologies that are available to platforms like Instagram and Facebook. By using facial recognition technology to try and guess who appears in photographs, social media sites could be able to build a graph of who a certain person is associating with – and then use that to decide what to show them, or potentially for advertising.

Facial recognition technology is banned on social media sites in Europe, because of privacy concerns about how it can be used, meaning that not everyone will be able to see the messages about who Facebook has guessed is in a certain photograph.

The same error was showing on Instagram as well as Facebook. That could be an indication that the same underlying technology is being used across both sites, which might explain why both of the sites went down at the same time.

Join our commenting forum

Join thought-provoking conversations, follow other Independent readers and see their replies

Comments

Thank you for registering

Please refresh the page or navigate to another page on the site to be automatically logged inPlease refresh your browser to be logged in