The future of data storage isn't on the cloud – it's on the 'edge'
Eventually the cloud won’t be able to cope with the billions of devices seeking data storage, and more localised 'edge' tech will be adopted
Your support helps us to tell the story
From reproductive rights to climate change to Big Tech, The Independent is on the ground when the story is developing. Whether it's investigating the financials of Elon Musk's pro-Trump PAC or producing our latest documentary, 'The A Word', which shines a light on the American women fighting for reproductive rights, we know how important it is to parse out the facts from the messaging.
At such a critical moment in US history, we need reporters on the ground. Your donation allows us to keep sending journalists to speak to both sides of the story.
The Independent is trusted by Americans across the entire political spectrum. And unlike many other quality news outlets, we choose not to lock Americans out of our reporting and analysis with paywalls. We believe quality journalism should be available to everyone, paid for by those who can afford it.
Your support makes all the difference.Time travel to the UK in 2025: Harry is a teenager with a smartphone and Pauline is a senior citizen with Alzheimer’s who relies on smart glasses for independent living. Harry is frustrated his favourite online game is slow, and Pauline is anxious because her healthcare app is unresponsive.
Forbes predicts that by 2025 more than 80 billion devices, from wearables and smartphones, to factory and smart-city sensors, will be connected to the internet. Something like 180 trillion gigabytes of data will be generated that year.
Currently almost all data we generate is sent to and processed in distant clouds. The cloud is a facility that provides virtually unlimited computer power and storage space over the internet. This mechanism is already becoming impractical, but by the time billions more devices are connected, delays due to congested networks will be significant. Harry and Pauline’s frustrations will be the norm as apps communicate with distant clouds over a busy internet, becoming slower and less responsive.
Disruptive technology
After all, seconds matter. Harry will have a poor gaming experience if there is a 50 millisecond delay on his smartphone. Even a 10 millisecond lag between the movement of Pauline’s head and the appearance of processed information on the smart glasses will cause motion sickness.
To imagine another futuristic scenario, a delay of one-tenth of a second could prove disastrous for an autonomous car driving at 70 miles per hour. It is not inconceivable, therefore, that limitations in cloud provisions could lead to life-or-death scenarios. For cloud users to operate in real time, experiencing delays of no more than one millisecond – assuming networks worldwide can transmit data at the speed of light – data will need to be processed less than 93 miles from the user.
Edge computing is a disruptive new technology, still in its infancy, which offers a solution. Delays will be reduced by processing data geographically closer to the devices where it is needed, that is, at the edge of the network, instead of in a distant cloud. For example, smartphone data could be processed on a home router, and navigation guidance information on smart glasses could be obtained from a mobile base station instead of the cloud.
Will this really happen?
The value of edge computing is to make applications highly responsive by minimising delays. This compelling proposition has attracted significant investment from major companies, including Cisco, Dell and Arm, all of whom have a major global footprint. The market is headed towards embracing the edge, and researchers across universities are closely examining and developing this technology.
Cost-effective application will require the edge to do a lot of data pre-processing before it is sent to the cloud. Proof of concept from pilot projects demonstrates that a variety of applications benefit from using the edge, including online games, health care apps, military applications and autonomous cars.
A number of alliances, such as the OpenEdge and OpenFog consortia, are developing standards for using the edge. Even major cloud providers, including Amazon and Microsoft Azure, have developed software systems for the technology. The market is estimated to be valued between $6bn-$10bn (£4.6bn-£7.7bn) over the next five years.
Will the cloud become obsolete?
Cloud data centres are facilities with processing and storage capabilities across the globe. They are one of the central planks of modern economies. They are critical infrastructure – but once processing is done at the edge, the central role of the cloud will change.
The massive storage and scalable resources available in the cloud will obviously not be accessible at the edge, with its limited computing and storage capabilities. But the edge will become central for real-time processing. The edge will not exist without the cloud, but the cloud will become a slightly more passive technology. Resources required for processing and/or storage will be decentralised along the cloud/edge continuum.
Safety
Jason Bourne always managed to outsmart his assailants by blending in with a large rioting crowd or a busy marketplace. Thousands of cloud data breaches affecting billions of people were reported in 2017. A home router is a needle in a haystack of devices at the edge – which, even if compromised, would not give access to billions of users’ data. So that alone is a huge plus, as mass breaches can be avoided.
Processing a user’s data on home router servers without leaving a data footprint outside the home network is more secure than leaving data on the cloud. More public edge devices, such as internet gateways or mobile base stations, will have the data footprint of many users. So the systems required to fully protect the edge are still a major investigative focus.
Questions remain to be answered as we make the change, but the inevitable conclusion is clear: the edge will change not only the cloud but the lives of those like Harry and Pauline who depend on it every day.
Blesson Varghese is a lecturer at the School of Electronics, Electrical Engineering and Computer Science at Queen's University Belfast. This article first appeared on The Conversation (theconversation.com)
Join our commenting forum
Join thought-provoking conversations, follow other Independent readers and see their replies
Comments