Digital Edition

SYS-CON.TV
Challenges with Big Data for the IoT | @ThingsExpo #BigData #IoT #IIoT #M2M
The design and implementation of smarter infrastructure

The biggest challenge to IOT is thus big data that requires an infrastructure that is capable of processing billions or more data points each second.

If you thought e-commerce revolutionized the retail industry over the past two decades, something much bigger is coming over the next ten years and that is the Internet of Things (IoT). By deploying sensors and network connectivity to everyday physical objects like cars, refrigerators, television and buildings, it is possible to remotely connect, manage and engage with these entities in ways that are not possible today.

Proponents of IoT describe a future where your car could interact with your air conditioner at home so that your house could be appropriately cooled by the time you reach home, or such devices could be automatically turned off each time you leave the house. While such examples are not far from truth, the true test for IoT shall come from policy makers.

The prospects for IoT in administration is so good that in countries like India and the UK, IoT is a matter of state policy today. However, it here that IoT is likely to meet its largest set of detractors. This is because IoT in state administration comes with huge stakes. Take the example of smart traffic management where Internet-enabled devices can monitor traffic movements across the city and can smartly administer lanes to ease congestion. Insufficient infrastructure or a badly executed IoT system could crumble under heavy load and could paralyze traffic movements across the city during peak times.

The biggest challenge to IoT is Big Data. The Internet of Things in administration could require an infrastructure that is capable of processing billions or more data points each second. Essentially, when IoT becomes main stream, we will be dealing with information that is much bigger than what the Big Data tools of today process on average. For mission-critical services like traffic management, this necessitates sophisticated data infrastructure that can handle the humongous volume of data thrown in by these large scale IoT systems.

Some experts argue that IoT and Big Data are essentially two sides of the same coin - like Big Data, the solution to a successful IoT implementation lies in storing, processing and extracting value from the data received. Protocols like Mosquitto and platforms like Hadoop and Hive do a good job in queuing and storing data while custom analytics tools will help process and derive meaningful information from this data. In both cases, however, the underlying infrastructure can make or break the system. A recent study published by CA Technologies found that among enterprise Big Data players, nearly 32% believe that their existing infrastructure is a major obstacle and not adequate to implement Big Data projects. It is not surprising then that close to half of the respondents believed their organizations needed major investments in infrastructure to implement their projects.

According to technology writer Arthur Cole, the solution to the infrastructural challenges facing IoT and the associated big data is not bigger infrastructure. Rather, it is in the design and implementation of smarter infrastructure that can process data in transit as well as optimize resources through prescriptive platform analytics and active copy analytics. Such an infrastructure could use machine learning algorithms to dynamically allocate the resources required to back up job processes, monitor services and produce output for the user.

This argument makes sense since focusing merely on larger infrastructure could create a bull-whip effect that could lead to exponential rise in infrastructural investment that could make IoT unviable. By focusing on smarter infrastructure that can possibly make use of current investments to process much larger volumes of data, we could be looking at larger adoption that could in effect lead to quicker mainstreaming of IoT. And that's a good thing for everyone in the ecosystem.

About Harry Trott
Harry Trott is an IT consultant from Perth, WA. He is currently working on a long term project in Bangalore, India. Harry has over 7 years of work experience on cloud and networking based projects. He is also working on a SaaS based startup which is currently in stealth mode.



ADS BY GOOGLE
Subscribe to the World's Most Powerful Newsletters

ADS BY GOOGLE

Modern software design has fundamentally changed how we manage applications, causing many to turn to...
In this presentation, you will learn first hand what works and what doesn't while architecting and d...
In an era of historic innovation fueled by unprecedented access to data and technology, the low cost...
In his session at 20th Cloud Expo, Mike Johnston, an infrastructure engineer at Supergiant.io, discu...
Everyone wants the rainbow - reduced IT costs, scalability, continuity, flexibility, manageability, ...
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing w...
Founded in 2000, Chetu Inc. is a global provider of customized software development solutions and IT...
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held Novemb...
Most DevOps journeys involve several phases of maturity. Research shows that the inflection point wh...
SYS-CON Events announced today that DatacenterDynamics has been named “Media Sponsor” of SYS-CON's 1...
CloudEXPO New York 2018, colocated with DXWorldEXPO New York 2018 will be held November 11-13, 2018,...
Dynatrace is an application performance management software company with products for the informatio...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, ...
@DevOpsSummit at Cloud Expo, taking place November 12-13 in New York City, NY, is co-located with 22...
Today, we have more data to manage than ever. We also have better algorithms that help us access our...
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: D...
A valuable conference experience generates new contacts, sales leads, potential strategic partners a...
DXWorldEXPO LLC announced today that ICOHOLDER named "Media Sponsor" of Miami Blockchain Event by Fi...
SYS-CON Events announced today that IoT Global Network has been named “Media Sponsor” of SYS-CON's @...
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news an...