Skip to main content

IOT Data Analytics

By Ragavendran S

Internet of Things (IoT) brings in a whole new world of possibilities with data from Smart Devices, Application Logs and anything connected to provide a means for analyzing data at the most granular lever, detect patterns, predict outcomes, build systems that are automated, self-learning, self-managed, intelligent and derive deep and valuable insights that make the world Smart and efficient. IOT Data Analytics deals with collection, organization, analysis of a vast collection of time variant data and derive insights through AI techniques and make the world a better place. At Coforge, we specialize in Streaming Data processing and analysis, Statistical analysis Deep data mining using Machine learning, Deep Learning and Cognitive AI techniques to deliver industry leading solutions and services for IOT Data Analytics.

Internet of Things (IoT) broadly refers to a collection of inter-connected devices that are enabled with Sensors to capture a pre-defined set of variables in their eco system, continuously over time and share that data across their network.

A common example, most popular in current times is the smart watch that can detect heart rate, pulse rate and other parameters of the person wearing this on a continuous every second basis and helps in tracking the vital health parameters during exercise, sleep and regular daily activities. Likewise, there are 100s of types of sensors for tracking various parameters, in industries, mines, commercial establishments, vehicles, flights, ships, transportation systems, medical equipment, Utility systems for Electricity/ Gas /Water distribution, sports equipment, weather monitoring systems, wind turbines, smart cities, smart homes and every possible area where a smart device can be embedded.

IoT Data Analytics deals with collection, processing, enriching, analyzing and deriving meaningful and valuable business insights from the data by through specialized technology, tools and methods. This paper covers various considerations for technology and implementation of IoT Data Analytics.

Industry Trends and Evolution of IoT Data Analytics

The number of IoT devices in use worldwide is forecasted to almost triple from 8.4 Billion devices in 2020 to 25.4 Billion devices in 2030 (Source: statista.com). IoT Analytics market has been valued at USD 17.14 Billion in 2020 and expected to grow to USD 81.67 Billion at a CAGR of 29.8% through 2021-2026 (source: mordorintelligence.com). IoT devices are widely in use across all industries and across large variety of use cases for tracking and monitoring, efficiency, product and process quality, cost reduction, predictive maintenance, performance improvement, efficiency, Security, improving customer experience, Environment health and safety.

Sensors and monitoring devices have evolved immensely in the last 3 to 5 years. Some of the important evolution and innovation with the Sensors include:

  • Transforming from analog to completely digital devices
  • Increasing ability to capture data seamlessly and store data temporarily
  • Transforming from wired devices to wireless (Wifi enabled) devices
  • High speed, Real time capture and streaming of data (even at microsecond latency)
  • Drastic reduction in size of the sensors with Micro IC chips and upcoming Nano chips
  • Advancement of controllers and monitoring software tools
  • Emergence of Industrial IOT (IIOT) with Industry 4.0
  • Advancement in medical electronics, robotics aided medical procedures
  • Common IOT sensors with usage in Smart homes, personal health, Vehicles, Logistics
  • Very low cost and affordable (some IOT sensors are lesser than $1 and most sensors are under $10)
  • Evolution of Industry leading IOT platforms
  • Wider adoption of IOT Data analytics Software tools and Custom applications for IOT analytics in enterprises

Types of IOT Sensors and Data generated

In a nutshell, IoT devices essentially capture data from sensors and device logs that capture details of Time, location physical parameters (temperature, pressure, density, etc.), mechanical parameters (RPM, distance, speed, force, etc.), weather parameters, State or condition of an object (E.g. On/Off, open/closed), Flow meters (for gases, liquids), data from medical electronic devices and few others. The following table captures a representative collection of such sensors:

Sensor Types Examples of Parameters involved
GPS Devices Location coordinates like latitude, longitude, altitude
Time monitors Timestamp associated to the variables recorded with second or millisecond accuracy
Sensors of Physical Parameters Temperature, Heat produced, Pressure, Humidity, Motion, presence of specific gases, RPM (rotations per minute), Accelerometers (tilting, shaking, shock), Vibration, Sound levels, light intensity, radiation, moisture level,
Proximity sensors Object detection, motion, relative distance, relative speed
Gas Sensors Presence of Specific Gases, measure their volume, identify toxic gases, air quality level
Flow Meters Rate of flow of gas or fluids in a pipeline, leakage
RFID Tags Identify specific objects using RFID Tag, location of the Objects, tracking their movement
Image sensors Object identification, facial recognition, tracking movement
Medical equipment, personal health devices ECG (heart’s electric activity), EEG (brain’s electric activity), Heart rate, pulse rate, body temperature, blood pressure, glucose levels, blood clot level, depression, tracking walking/running and other exercises, sleep monitoring
Biometrics Fingerprint, facial recognition, DNA, Iris recognition, voice recognition
Weather monitoring Devices Real time weather parameters like temperature, atmospheric pressure, rainfall, snow fall, humidity, air quality, wind speed, wind direction, solar radiation, evaporation

IoT Data Analytics across Industries

In 2018, International Data Corporation (IDC) had estimated worldwide spending in Internet of Things to grow to $1.2 Trillion in the year 2022. With the Pandemic situation, there has been a slowdown in Spend in 2020 which IDC forecasts to be at $746 Billion and achieve a CAGR rate of 11.3% through 2021-2024. Internet of Things is the way forward for many verticals with a wide variety of Use cases and applications to derive commercial value, innovation and improve quality of life. Use cases across Industries can be synthesized into a set of Business analytics focus areas as depicted below:

Data-analytics

Building the Enterprise IoT Data Analytics Platform itself is a major Business Use case and forms the foundation for enabling various IoT analytics themes and business cases. This section provides an overview of various Business use case scenarios for IoT Data Analytics across verticals, and this is only a small representative list of examples while the potential of IoT Analytics is continuously evolving with new products, startups, research organizations emerging and bringing new ideas to real life.

1. Manufacturing (Discrete manufacturing, process manufacturing)

  • Production process efficiency and quality analysis
  • Product quality enhancement and Product innovation
  • Modeling for most optimal operating conditions (threshold ranges for variables) to maximize production
  • Predictive failure of machinery or components and failure prevention
  • Safely extending usable life of equipment and cost reduction
  • Predictive maintenance of machinery components and minimizing downtime
  • Improving safety, Compliance to EHS standards and hazard prevention
  • Efficient Inventory tracking, loss/theft prevention and supply chain management
  • Minimize wastage, Optimizing usage of labor, raw materials, spare parts
  • Enhance efficiencies in reducing emission, pollution, carbon footprint,
  • Improving after Sale services, warranty and customer satisfaction

2. Automotive

Automotive Industry will cover Cars, Trucks, Buses, heavy vehicles, farm equipment, electric vehicles, motor bikes, etc. All the use case scenarios for Manufacturing industry will also be applicable as well. In addition, Automotive industry has additional special case scenarios like:

  • Connected Vehicles – monitoring, predictive and preventive maintenance
  • Driving pattern analysis and prescriptive recommendations
  • Fleet monitoring and optimization of fleet usage
  • Fuel consumption analysis and Fuel optimization
  • Driver performance analytics for safety and efficiency
  • Interconnected network of Vehicles, traffic systems for better coordination and safety

3. Transportation and Logistics

  • Real time tracking and Fleet management
  • Optimizing allocation and utilization of Vehicles and Drivers
  • Efficient tracking of goods and warehouse management using Bots
  • Automated tracking of Storage containers in warehouse or in transit for temperature, humidity and other critical parameters, for different food products, pharma products, raw materials and electronics
  • Remote near real time tracking of shipment from source to destination

4. Healthcare

Healthcare industry has been a frontrunner in the experimentation and adoption of sensors for diagnostics, treatment, monitoring, surgical procedures, and overall health management. There are a wide variety of proven use cases across all these areas in healthcare, some of the key areas represented here:

  • Remote patient monitoring through Sensor real time data and monitoring using connected medical devices
  • Internet of Medical Things (IoMT) is a fast-evolving area with various sensor based medical devices or wearables help in capturing vital parameters of patients and in diagnostics, personalized treatment procedures
  • Advanced models for analytics of patient data and assisting in disease analysis and derive treatment plan
  • Personalized Drug management for patients based on the continuous data collected and altering the specific drugs and dosage levels based on changing health conditions
  • Enhanced Patient engagement with collaborative effort, commitment from patients in the treatment process
  • Tracking and management of assets and medical equipment
  • Enable advancements in medical Research by combining IoT Data along with EMR/EHR and other diagnostic data and deriving insights though advanced analytics

5. Insurance

Insurance industry has been experimenting and some leading enterprises have implemented business case using Telematics and IoT data Analytics mainly for Dynamic pricing of policies, preventing fraudulent claims and providing proactive and preventive services like improving personal health. Few key examples are:

  • Usage based personalized Insurance using Telematics data analytics
  • Innovative pricing model for Car insurance with attractive Policy premiums based on Pay per mile
  • Provide personalized Health and Life insurance based on personal health tracking data
  • Prevent Fire accidents and resulting claims using Connected sensors in Homes and commercial establishments
  • Analyzing claims data and preventing fraudulent claims in agriculture and farming using sensor data and data from drones
  • Optimizing premiums by analyzing sensor data collected over a period and defining innovative pricing models for Insurance for Plant and machinery, Heavy equipment, Aircrafts, Ships and other transport systems

6. Telecommunications

Telecommunications industry captures and manages a majority of IoT data world-wide. All data transmissions from mobile devices and smart sensors are through the communication network provided by this industry. Telecom companies themselves gather and manage a vast amount of IoT data from their Network and Assets. Common use cases in the Retail Industry are:

  • Automation of network monitoring and analytics for Network Performance Management (NPM) to improve overall network performance, load balancing and quality of services
  • Reducing Customer churn by analyzing usage patterns, connected towers, minimizing call drops and improving quality of services
  • Analytics on usage patterns, time periods of peak and low usage across different services to gain insights for dynamic usage based innovative pricing models to increase profitability and improve customer retention
  • Offer new and innovative products and services for different industries looking to build their IoT use cases
  • With Narrowband IoT (NB-IoT), Telecom providers can offer connectivity to many devices and messages and enable IoT Analytics in Agriculture, Industries, Healthcare, Logistics and for Smart Cities

7. Retail

Retail industry, especially the large retailers have adopted sensor-based technologies to improve supply chain and inventory management and enhance customer experience. While most of the IoT usages are in the in-store scenarios, for online retail as well IoT is very useful in managing warehouse and distribution analytics and optimization. Common use cases in the Retail Industry are:

  • Inventory tracking and management using data from machine readable tags, RFIDs, smart shelves.
  • Improving Supply chain efficiency with automated tracking of shipments, vehicles and distribution networks
  • Providing an intuitive in-store customer experience through insights delivered on mobile apps for store views, search, recommendations, faster billing, and delivery
  • Capture data on footfall to the store, visitors for each store sections and analyze impact on the Sales

8. Maritime Industry

Maritime shipping is one of the largest and oldest industries carrying more than 90% of the world cargo connecting all continents and countries. In the recent years, there is a major transformation to adopt to digital ship with complete sensor-controlled engine operations, navigation and vessel management. Some of the leading maritime companies are also into Unmanned Marine Vehicles (UMV) which remotely operated completely based on sensor data. Maritime industry offers a huge potential for IoT Data analytics for Vessel Management, Voyage operations, Cargo operations, fuel efficiency and contributing to reducing carbon footprint. Some of the key use cases are

  • Vessel performance analytics by analyzing sensor data for engine parameters, sea conditions.
  • Hull condition monitoring for enhancing the performance and lifetime of the Hull
  • Fuel consumption analytics for improving Fuel efficiency, reducing cost and reducing emissions
  • Voyage performance analytics to enhance voyage profitability, improve safety
  • Cargo loading optimization by tracking the sensor data for efficient cargo handling
  • Predictive and preventive maintenance for the engine and other major equipment in the vessels
  • Analytics for route planning for safe and cost optimal sailing with ever changing sea and weather conditions
  • Monitoring containers for optimal temperature, humidity conditions for refrigerated cargo, pharmaceutical products, combustible gases or fuel and special goods

9. Oil & Gas

Oil and Gas industry verticals have three major sub areas – Upstream exploration and extraction, Midstream processing and refining, Downstream distribution networks. Oil fields are turning into Digital Oil fields with IoT technology for automation of almost all processes and leading to higher efficiency. IoT enabled devices operating in the fields generate a vast amount of sensor data in real time and IoT Data Analytics play a significant role in every area to manage the overall process efficiently, improve safety and maximize the optimal production and distribution. Some key areas for IoT Data analytics are:

  • Analyzing real time drilling data to identify presence of specific materials and predict potential output over longer term helps in defining and improving the exploration strategies.
  • Real Time Monitoring (RTM) for ensuring high efficiency and safety for the upstream extraction process
  • Predictive maintenance of Assets and components ensuring high performance and safety
  • Analyzing data for Blow out prevention Testing to eliminate any possible failures
  • Monitoring of refinery operations Analytics for every pump or valve level temperature, pressure, flow rate to ensure efficient production
  • Monitoring pipelines to detect any leakage and prevent explosion and avoid emission of toxic gases

10. Energy and Utilities

Energy and Utilities encompass several sub verticals like Hydro and Thermal Power generation and Distribution, Renewable energy, nuclear energy, Water Resource management and distribution, Retail Gas distribution among others. Majority of the operations are tracked and controlled through the use of sensors and there is a continuous flow of data generated which enables a variety of valuable IoT Data Analytics use cases.

  • Real time monitoring and alerting of the power generation and transmission using data from smart grids
  • Predictive analytics to forecast demand accurately and maintain a balance between demand and supply
  • Proactively identify failure points and defects to maintain the health of assets and improve maintenance
  • Prescriptive analytics for positioning of assets, predictive monitoring and management in Renewable energy industry to significantly improve the power generation
  • Optimizing power generation and distribution by analyzing data from Smart meters to identify consumption patterns and predict future demand
  • In Gas and Water utilities, IoT analytics help in real time tracking of consumption, dynamic pricing, leakage and loss prevention, distribution optimization, preventing failures, improving safety and efficient asset management

11. Travel

Travel Industry comprises of predominantly Airlines, Airports, Train Services, Bus services, Ferries, Cruise vessels. Some of the common use cases are:

  • Delivering guidance and insights on mobile to Connected passengers on updates, utilities, special offers and improving Customer experience and loyalty
  • Automated real time baggage tracking from check-in to delivery, predicting potential baggage loss in airports
  • Predictive analytics and recommendations for Route optimization leading to significant savings in fuel cost and time
  • Tracking transport systems and delivering insights for navigation, avoid traffic congestions and safety
  • Analytics on vital sensor data from aircrafts or other transport vehicles, to enable preventive maintenance of critical components and enhancing their performance and lifetime.

12. Hospitality

Hospitality Industry comprising mainly of Hotels, Resorts and Theme parks have a good potential in IoT adoption for enhancing customer experience and efficient maintenance and operations. Few common use cases:

  • Analytics for improving customer experience by providing automation features for lighting, air conditioning
  • Predictive maintenance of equipment like air conditioners, heaters, plumbing, lighting systems to ensure that any potential failure is detected and prevented leading to improved service quality and customer comfort
  • Automatically manage the lighting, heating, cooling, cleaning services based on occupancy, usage and optimize power consumption and reduce cost
  • Enhance safety by automated monitoring of air quality, detecting smoke, gas or water leakages without any manual intervention leading to reduced labor costs and enables continuous tracking and alerting.

13. Financial Services

The IoT devices touchpoint in Banking and Financial services mainly is through Smart phones and usage of the smart chips in the Credit/Debit cards. There are a few banks experimenting with Beacons that can detect a specific customer through their smart phones and provide personalized banking experience. There is also a potential and emerging use with IoT enabled wearables like a smart watch which can be used for payments and transactions in ATMS, but this is still an evolving idea. Use case in BFS Are mainly in few areas given below:

  • Analytics for location-based intelligence and sending personalized offers based on Customer’s location using their smart phones GPS location. Special offers include dining, entertainment, commute, shopping
  • Preventing card payment fraud by correlating location of Point of sale and Customer smart phone’s GPS location and alerting if the two locations do not match
  • Analytics to provide a rich customer experience when they visit the branch or a kiosk
  • Security monitoring for ATMs, Kiosks, Lockers and Bank branches
  • Analytics on IoT data collected from the shopping carts to provide special Coupons to Customers at Point of Sale which they can utilize at the same time rather than waiting for the next visit.

14. Security and Law enforcement

Law enforcement, traffic control departments can leverage IoT analytics by integrating with various systems that track data in a public place, data from telecom providers, transportation companies, satellite data, weather data, Fire and Ambulance services and Security cameras. Some of the key use cases are

  • Automated Security monitoring in public places with real-time alerts, threat prediction and prevention, tracking people, vehicles and unattended luggage or electronic equipment
  • Automated and efficient traffic monitoring and management to minimize congestions and prevent accidents
  • Provide preventive measures to Smart homes, commercial and office premises from fire accidents, natural calamities and disaster recovery by monitoring the IoT data from smart sensors installed.
  • Based on GPS data provided by Telecom operators, enable analytics for Crowd monitoring in large gatherings, predict and prevent a stampede, provide insights for emergency evacuation situations, and alter for deploying more security personnel at the required places at the right time.
  • Automated and on the spot evidence collection to aid in Case analysis, investigation, and proof.
  • Advanced analytics for Forensics by combining IoT data from various devices and systems like Surveillance cameras, GPS location of smart phones and connected vehicles, phone call records, bank transactions and every other observation recorded on victims, suspects or any connected people is a massive collection of correlation, pattern analysis and decision models
  • Real time monitoring and altering with IoT Enabled firearms to track their exact location, time and people involved at the time of usage.

Key Technologies and Enablers for IoT Analytics

With millions of devices emitting data every second or milli-second and continuously, IoT Data will involve a combination of high volume, high velocity and variety of data along with moderate to high complexity of the data for acquisition, parsing, processing, Storage, analysis and deriving insights. Technologies that are essential for IoT Data Analytics include:

Cloud platforms For large scale storage and high-performance compute
Big Data For managing data at very large scale for storage architecture and advanced analyti
Streaming data processing To capture, parsing and processing of real-time, low latency, high volume data
Real-time analytics For advanced analytical processing on streaming data to bring out insights for predictive monitoring, failure prevention, hazard prevention and in-process analytics
Artificial Intelligence Statistical Analysis, Mathematical Modeling, Machine Learning, Deep Learning tools and techniques for pattern analysis, predictive modeling, data mining
Advanced Visualization Provide intuitive and interactive Visualizations of the Data and the Analysis in various Dashboards and Charts
Edge Computing enables analytics at the device level itself saving bandwidth and latency issues
Digital Twin Digital Twin is a digital representation of a complete ecosystem like a workspace, industry premises, machinery, processes, and everything in the ecosystem. A Digital Twin can be the single place where all IOT data streams from across the enterprise come together and can be the single consolidated source for IoT Data analytics
5G Networks 5G is a major game changer for IoT technology with high speed, low latency and ability to scale to several millions of devices in an enterprise. 5G can also enable cross domain sharing of IoT Data which can for example integrate data across telecom providers, law enforcement, transport networks, fire services, hospital/ambulance services and many others to provide a safe, secure, efficient and healthy way of life to the world

Considerations for IoT Data processing

Raw IoT Data streams essentially comprise of the data items - Device ID/Sensor ID, Timestamp, Sensor value. IoT System controllers (micro controllers) or Control systems like SCADA or PLC will collect the data and put together data from multiple sensors into a data stream. Based on the type of IoT devices the raw data collected may be captured as binary or a Hexadecimal data stream or as ASCII text data. The control systems in most cases will have the capability to parse the data and convert this into an ASCII data stream. Each record in the data stream will have a specific timestamp and provide values for each of the senor parameters observed at that time. This data can be collected and processed in real-time or in micro batches (with a frequency of every minute, 5 minutes, or every hour, etc.) depending on the latency requirements for the Data Analytics use cases. Processing of IoT Data may involve several steps that are executed in real-time or in micro batches and these can include:

  1. Data acquisition from sensors directly or from IoT system controllers using a messaging service or APIs to support real time stream data capture
  2. Parsing of data to breakdown complex columns into individual values (e.g.: a byte stream of binary 8 bits may indicate on/off state of 8 different switches or valves) and convert them into a delimited data set like a CSV
  3. Perform data quality checks and corrections as may be necessary
  4. Processing the raw data and loading to a raw data layer (a file system or relational DB or NoSQL data store
  5. Associate the variables captured in the raw data to the related entities involved in the business-like People, Processes, Plant/machinery, Location, Date/Time, Products and every entity in the ecosystem that can be related to the IoT Data to provide a comprehensive view for analysis
  6. Create and update the metadata about the sensor variables and the values collected from the data streams
  7. Perform window functions like Min/Max/Median values in a window of 1 minute or 5 minutes
  8. Calculate statistics in real time – averages, standard deviation, variances, peak/trough values, correlations, frequency distributions
  9. Perform real-time aggregations of data for different time windows (data stream received at milli-second latency is aggregated to provide values at 100 or 200 milli-second level aggregation)
  10. Perform aggregations of Process event-based grouping of data (e.g. if a process involved 10 steps with each step running anywhere from a minute to a few hours, to calculate the aggregate values of the variables within each step like max temperature observed in step 1, total power consumed in execution of step2)
  11. Identify any critical threshold breaches identified in real time streaming data (e.g. temperature reading closer to the Max threshold)
  12. Split the data streams to multiple data sets to provide different views of data for Reporting and analysis
  13. Create analytical data sets with historical data for enabling analytics and deep data mining
  14. Build aggregates on historical data with various possible metrics and scores for long term data analysis

The technology platform and tools considered for IoT Analytics implementations needs to support all the above aspects well and provide for high-performance real-time data processing and integration.

Considerations for IoT Data Analytics

IoT Data comprises of a continuous stream of readings from sensors and coupled with data coming from application and device logs that may be generated. When we combine this data with Master data about all the entities (or objects or things) that are involved in the entire ecosystem, this data provides a complete view of enterprise data with respect to IoT analytics. This combined data set can provide deep insights into almost every context of the analysis that can be perceived though IoT Data analytics. In order to accomplish such deep analysis, several techniques and algorithms may be adopted. Given the vast extent of possibility with IoT Analytics, this list can extend to various other approaches as well depending on the specific industry need, complexity of the data and the analytics use case to be implemented. A representative list of methods and/or algorithms are given below as examples for the most common scenarios.

  1. Exploratory Data analysis to query and Visualize data using BI Charts to understand the data, make inferences
  2. Correlation Analysis to identify relationships or dependencies between different variables
  3. Multivariate analysis to assess interdependency and impact of multiple variables on the outcome
  4. Time Series analysis to understand the changes in a combination of variables over a sequential range of time
  5. Quintile Analysis to split the range of values of continuous variables into parts and study their relationship
  6. Principal Component Analysis to simplify analysis of large number of variables
  7. Pattern discovery to identify interesting observations on data – most common and unusual patterns
  8. Identify and profile parameter values for most optimal operating conditions (for maximizing output)
  9. Anomaly detection to identify unusual or unexpected behavior in data which can indicate a potential problem
  10. Hypothesis analysis to validate a phenomenon or an assumption to be true or false
  11. Failure pattern analysis to study data patterns associated with a failure scenario and profile them
  12. Classification and Clustering models to identify similarity and group / segregate data sets or scenarios
  13. Metaheuristics Algorithms for Optimization problems
  14. Predictive models to identify the most likely outcome and help in taking a decision
  15. Prescriptive models to recommend the next best action to be taken

Conceptual Architecture for IoT Data Lake and IoT Analytics

Building the IoT Data Lake and enabling advanced analytics follows similar architecture approach as with the Business Data Lake architecture. The main difference is in the Real time data processing and real time data analytics and managing different layers of data at different granularity of time and other Business entities involved. A representative Conceptual architecture for IoT Data Lake and Analytics is depicted below:

IOT-Data-Analytics-2

Data sources for IoT generate sensor data continuously and this data flows through the streaming raw data processing layer. Data souces also include Master data sets that are associated to the IoT data like People, places, processes, devices/machinery, objects, events and others. Operations data will cover data about day to day operations like product schedules, supply chain movement, transactions, events, etc.

Raw data processing layer is the main real-time streaming data processing engine which needs to run continuously with a high performnace and high scalability and execute bulk of the data crunching and loading to the IoT Data lake.

Analysis & Insights layer provides a variety of tools and applications to analyze the data, build analytical models, derive insights, search for information and collaborate with internal teams and external partner enterprises.

Managing Data Governance, Data Privacy and Secrecy

Governance and control is an extremely critical aspect of managing IoT Data for both Stored data as well as real-time incoming data. Some of the key aspects of governance include:

Data Privacy – Managing Personally Identifiable Information (PII) is guideded by various Standards and Regulations across the world:

  • Payment Card Industry Data Security Standard (PCI DSS)
  • Health Insurance Portability and Accounting Act (HIPAA)
  • Gramm Leach Bliley Act (GLBA)
  • Telephone Consumer Protection Act (TCPA)
  • California Consumer Privacy Act (CCPA) and other similar Acts for various US states
  • Children's Online Privacy Protection Act (COPPA)
  • European Union's General Data Protection Regulation (GDPR)
  • European Union's upcoming Digital Services Act and Digital Markets Act
  • European Union's upcoming EU’s Artificial Intelligence Act
  • Various Data privacy Regulations across different Countries

Securing PII Data can be achived through various ways like separating the PII Data from other data and restricting their access, de-identification of the data, masking of the data or complete data obfuscation such that the unmasking is not possible. Data privacy guidelines and implementing them will need to be applied at every stage from the point of collection of the data to processing stages, data storage, analysis and reporting and should also be auditable.

Data Secrecy – IoT Data in some cases may contain business critical information that need to be kept highly confidential (for E.g: Sensor data in Oil Extraction may indicate potential quantum of Oil resources; Sensor data in Research and Product development; data analyzed in Forensics). Data Security measures like Cybersecurity, Cloud Security, Access Controls, Audit logs and other procedures need to be implemented to manage the Data secrecy.

Data Access Control – Access to IoT data should be governed and controlled based on which individuals or roles or applications needs to access which part of the IoT Data generated across the enterprise. The governance policies and procedures need to implement various levels of data access based on specific roles and need and manage the access control of the data accordingly.

Data Archival and Purge – As millions of IoT sensors produce a vast amount of data every second and throughout the year, the data volumes can grow to multiple terabytes to petabytes depending on the scale of IoT data generated. Particularly in cases where a mix of structured data from sensors and unstructured data from cameras, scanners is present, data volumes can grow drastically in a few days. The governance policy should define procedures for maintaining different layers of data like raw data, processed granular data, aggregated data, enriched data, analytical data sets, calculated statistics, metrics and scorecards, output data from analytics, labeling them based on associated entities and time periods and having a policy for periodically archiving them to secondary storage and purging older data. Archival and purge policies will also need to be defined for Reports/dashboards created from time to time.

Leading IoT Analytics Platforms

In the last four to five years a number of IoT platforms have emerged with most of them providing hardware and software tools to set up devices and collect the data. There are also a number of IoT Startups with products specialized in IoT analytics focused on a specific industry segment. A full-fledged IoT Platform should provide features and functionality covering all the points mentioned in Considerations for IoT Data processing and IoT Data analytics in previous sections of this document and offer a generic platform with complete infrastructure and tools for processing, storage, analyzing and delivering insights at high performance and large scale. We need to carry out a detailed analysis based on the IoT Analytics requirements of an enterprise, evaluate different platforms on the features offered, limitations, pricing model, infrastructure requirements and overall fit for purpose assessment of the platforms and decide the best choice.

There are over 600 IoT platforms as of 2021 providing capability in IoT Data processing, analysis and advanced analytics. Hyperscaler Cloud platforms and leading product companies are in the forefront of IoT Data Analytics platforms. Among the 600+ IoT platforms in the market and a lot of new companies emerging, a small set of the prominent platforms is given below (in alphabetical order):

AWS IoT Platform https://aws.amazon.com/iot/
Ayla Networks IoT https://www.aylanetworks.com/iot-platform
Cisco IoT Cloud Connect https://www.cisco.com/c/en_in/solutions/internet-of-things/overview.html
Cumulocity IoT https://www.softwareag.cloud/site/dev-center/cumulocity-iot.html
Google Cloud IoT Platform https://cloud.google.com/solutions/iot/
IBM Watson IoT Platform https://internetofthings.ibmcloud.com/
IRI Verocity https://www.iri.com/solutions/big-data/iot
Kaa IoT (Opensource) https://www.kaaiot.com/
Microsoft Azure IoT Suite https://azure.microsoft.com/en-in/overview/iot/#products
OpenRemote (Opensource) https://openremote.io/
Oracle IoT Platform https://www.oracle.com/internet-of-things/
PTC ThingWorx https://www.ptc.com/en/products/thingworx/
SAP IoT Platform https://www.sap.com/products/iot-data-services.html
Senzary IoT https://senzary.com/
Thinger IoT (Opensource) https://thinger.io/
ThingsBoard IoT (Opensource) https://thingsboard.io/

Coforge’s Solutions and Enablers for IoT Data Analytics

At Coforge’s Data & Analytics practice we specialize in implementing transformational engagement for Data modernization of Enterprise Data Warehouses or Data Lakes and in delivering business value through data analytics and Data science. Our technology research and development initiatives are focused on building solutions for data engineering, data governance and advanced analytics which we offer as solutions and accelerators in our customer engagements. Led by our Data & Analytics Center of Excellence, and in collaboration with our technology partners offering leading IoT Data Analytics platforms we provide a comprehensive offering for a successful implementation of IoT Data Analytics programs. We provide the methodology, IoT Platform expertise, tools and technology expertise on Big Data, Cloud, AI /Machine Learning, Advanced Visualization enterprise Data Governance, IoT strategy and technology consulting, end to end implementation of data science use cases for IoT Data Analytics across industries.

References

IoT connected devices worldwide 2019-2030 | Statista

IoT Analytics Market | 2021 - 26 | Industry Share, Size, Growth - Mordor Intelligence

IoT in Healthcare: 20 Examples That'll Make You Feel Better (ubuntupit.com)

Top 10 benefits of IOMT In the healthcare sector (folio3.com)

IoT for All

 

Let’s engage