https://www.iotworldtoday.com/wp-content/themes/ioti_child/assets/images/logo/IoTWorldToday-mobile-logo.png
  • Home
  • News
    • Back
    • Roundups
  • Strategy
  • Special Reports
  • Business Resources
    • Back
    • Webinars
    • White Papers
    • Industry Perspectives
    • Featured Vendors
  • Other Content
    • Back
    • Q&As
    • Case Studies
    • Features
    • How-to
    • Opinion
    • Podcasts
    • Strategic Partners
    • Latest videos
  • More
    • Back
    • About Us
    • Contact
    • Advertise
    • Editorial Submissions
  • Events
Iot World Today
  • NEWSLETTER
  • Home
  • News
    • Back
    • Roundups
  • Strategy
  • Special Reports
  • Business Resources
    • Back
    • Webinars
    • White Papers
    • Industry Perspectives
    • Featured Vendors
  • Other Content
    • Back
    • Q&As
    • Case Studies
    • Features
    • How-to
    • Opinion
    • Podcasts
    • Strategic Partners
    • Latest videos
  • More
    • Back
    • About Us
    • Contact
    • Advertise
    • Editorial Submissions
  • Events
  • newsletter
  • IIoT
  • Cities
  • Energy
  • Homes/Buildings
  • Transportation/Logistics
  • Connected Health Care
  • Retail
  • AI
  • Metaverse
  • Development
  • Security
ioti.com

Metaverse


Using NoSQL and Embedded Databases to Prevent Corrupted Systems

Embedded data management for IoT has entered the limelight following two upsized IPOs for Confluent and Couchbase.
  • Written by Callum Cyrus
  • 4th August 2021

As IoT engineers cram more data analysis onto devices to enable better decision making in the moment, there’s a renewed focus on database protocols that accelerate queries and prevent information loss.

In July 2021 Couchbase became the latest embedded database provider to try its luck on the trading floor, raising $200 million in its Nasdaq listing. Couchbase focuses on providing multi-model databases, documents records and key value stores for enterprises building mission-critical IoT applications.

Among Couchbase’s clients is the Irish budget airline Ryanair, which implemented the technology to direct airline data in its memory-constrained smartphone booking app.  Ryanair claims mobile bookings that had taken 5 minutes to complete were reduced to 30 seconds, even without a reliable network connection.

Historically, Internet of Things (IoT) endpoints with limited resources have transported information to data servers for post-processing and analysis because these servers have greater resources. But the risks of not having an adequate database system for co-ordinating information at source are also significant and have increased alongside data volumes collected by intelligent IoT applications – everything from computer vision to medical diagnostics.

Power outages or system reboots could jeopardize the readings in machine-to-machine networks and undermine the performance of connected systems. Moreover, delays in retrieving information could hinder machine learning models deployed at the edge, which were designed to draw on cloud resources less often.

SQL vs. NoSQL

SQL is the most mature and perhaps well-known language for building and querying databases, but it was historically considered a poor fit for IoT applications. The language uses rigid columns and rows to organize data according to relational logic. However this is less appropriate for unstructured information, which lack labels to denote its significance – as is often produced by cloud servers and smart devices.

In addition, storing SQL is pretty data and resource intensive. Some of the benefits -such as relational schema which govern how each data set links to one another – are dampened given that many IoT logs are principally a basic record. Despite the drawbacks, SQL is still sometimes preferred for IoT use-cases where the database must be rock solid, particularly in line with a standard known as ACID compliance (atomicity, consistency, isolation and durability.)

Operators in sectors such as finance or public policy may need to ensure SQL can be ported onto IoT gateways in order to maintain ACID compliance. In addition, some of the more recent SQL flavors incorporate document handling features that supports IoT implementation more easily.

NoSQL database languages refer to techniques which incorporate elements of SQL but do not store data tables in relational schema. These alternatives are often used by IoT device developers because they offer flexibility in key areas. But they often lack some of the contingencies afforded with relational models.

Popular NoSQL varieties include document databases, which efficiently store data as JSON documents for general-purpose usage – – or columnar databases that can query each column of a dataset without scanning every row.   More generally, some NoSQL database query systems appear to be match-made for IoT. Time series databases, in particular, are best suited for efficiently categorizing each IoT recording, as part of a log file or data history. Time-stamped information can then be dispatched to the cloud for more complex analytics functions, providing a user with complete oversight of the field as monitored by IoT over time.

“The smartest organizations understand that keeping a historical record of real-time samples and the metrics and key performance indicators they power is key to detect, remediate, and restore when things go wrong, and to introspect and amplify when things go right,” said  Brian Gilmore, director of IoT product management at InfluxData, a san Francisco-based time series database provider.

By applying machine learning, time series analyses can be contextualized to benefit transactional IoT records in sectors ranging from supply chain management to e-commerce and online advertising. Among other uses, these strategies deploy compression to reduce database entries taken up by fluctuating IoT readings. For example, a rolling average integer calculated every hour can substitute minute-by-minute datapoints.

The Compatibility Dilemma

Regardless of the database protocol implemented, engineers must ensure compatibility with the specifications of all endpoints in the network.  While embedded database languages will have more modest specifications than their traditional cousins, there is no guarantee they can be installed on every node within a large machine-to-machine ecosystem.

Some database packages require at least 24-bit microprocessor technology, and they cannot be installed on legacy 16-bit endpoints. The operator would then have to decide whether the use-case merits spending to upgrade, or else backhaul information to the cloud where post-processing is standardized.

Moreover, many IoT device varieties pose unique challenges for database engineers to circumvent. Sensors will have slender memory profiles, for instance, while IoT gateways need data writing to take place concurrently with read access, to exchange information from multiple endpoints.

But as new IoT microprocessors deliver more compute power at the edge — and often with on-board capacity for implementing machine learning – demand has increased for new database offerings which incorporate bespoke features for embedded environments.

Embedded database systems increasingly court IoT with low-latency architectures, security barriers to prevent decryption of stored information and enrichment fields that can record data from images and sound.

Efficient data relays at the source of their generation would also be of great help to IT engineers as updating databases over wireless local or wide area networks may hinder rapid machine learning implementation at the edge, especially where connectivity is unreliable.

InfluxData’s Gilmore said: “Computer vision and digital audio processing are an extension of the sensor model, and while their outputs are far more complex than your typical thermistor, serializing and encoding images and audio clips brings them into the time-series domain.

“Tagged with ML-derived enrichment fields, these images and clips can be recalled, analyzed, modeled, and correlated with other time-series data in the business.”

 

Tags: IoT platforms Metaverse Technologies

Related Content


  • Move to the Cloud. Go Beyond.
    An innovative new category of application for building high-performance microservices and APIs with no operations required.
  • Dell Technologies World 2022: Michael Dell Talks What’s Next in Tech
    A key opportunity for the company is the growth in edge computing
  • Nations Ranking Highest for Efficiently Deploying Cloud
    Where did the U.S. place?
  • Image shows a metaverse concept background with perspective and copy space - 3d illustration
    Businesses Gear up for the Metaverse
    What is the Metaverse and does it already exist?

Leave a comment Cancel reply

-or-

Log in with your IoT World Today account

Alternatively, post a comment by completing the form below:

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Latest News

  • Experts in IoT: IoT Data Collection With InfluxData
  • Digital transformation concept. Binary code. Programming. Quantum computer.
    How a Quantum Computer Actually Works
  • Nvidia Launches Toolset to Accelerate Quantum Adoption
  • Image shows: Three dimensional memory cube, the representation of cloud computing or quantum computing.
    Researchers Launch First Quantum Computer in Israel

Roundups

View all

IoT Product Roundup: Canonical, InfluxData, Wiliot and More

23rd June 2022

IoT Product Roundup: Cisco, Telit, Draganfly and More

9th June 2022

IoT Deals, Partnerships Roundup: Google, Arm, Senet and More

26th May 2022

White Papers

View all

The Role of Manufacturing Technology in Continuous Improvement Ebook

6th April 2022

IIoT Platform Trends for Manufacturing in 2022

6th April 2022

Latest Videos

View all
Image shows Unilever's Alberto Prado at AI Summit 2022 in London

AI Summit 2022: Unilever’s Alberto Prado

Prado talks about how Unilever is using AI to accelerate the speed of new discoveries and gives them access to more breakthrough innovation

Image Shows John Lewis' Barry Panai at AI Summit London 2022

AI Summit 2022: John Lewis’ Barry Panayi on AI in Retail

Panayi talks about data and AI in retail and how individuals and the technology can work together

E-books

View all

How Remote Access Helps Enterprises Improve IT Service and Employee Satisfaction

12th January 2022

An Integrated Approach to IoT Security

6th November 2020

Webinars

View all

Rethinking the Database in the IoT Era

18th May 2022

Jumpstarting Industrial IoT solutions with an edge data management platform

12th May 2022

AI led Digital Transformation of Manufacturing: Time is NOW

9th December 2021

Special Reports

View all

Omdia’s Smart Home Market Dynamics Report

7th January 2022

Cybersecurity Protection Increasingly Depends on Machine Learning

28th October 2020

IoT Security Best Practices for Industry and Enterprise

20th October 2020

Twitter

IoTWorldToday, IoTWorldSeries

IoT Product Roundup: Nokia, Energous, Dashbot and more dlvr.it/STRKDh https://t.co/YgTAI5SXSB

6th July 2022
IoTWorldToday, IoTWorldSeries

A new #IoT bug monitoring system from @CENSIS121 is helping the UK’s #forestry industry fight pests, and save money… twitter.com/i/web/status/1…

6th July 2022
IoTWorldToday, IoTWorldSeries

NHTSA Boss Hints at Federally Regulating Autonomous Vehicles dlvr.it/STQrrw https://t.co/Yjp1UKuaE5

6th July 2022
IoTWorldToday, IoTWorldSeries

Nvidia Powered Driverless Three-Wheelers Set to Debut dlvr.it/STQq0H https://t.co/RrYyVPgFzB

6th July 2022
IoTWorldToday, IoTWorldSeries

New Drone System Aims for Full Autonomy dlvr.it/STQnvV https://t.co/S4O8hb6gQh

6th July 2022
IoTWorldToday, IoTWorldSeries

Bosch, VW Approved to Develop Automated Driving dlvr.it/STQllD https://t.co/neI30dVmC6

6th July 2022
IoTWorldToday, IoTWorldSeries

🤔 Looking for 3 Strategies to Avoid IoT Key Theft? We’ve got you covered! As tech companies continue to develop an… twitter.com/i/web/status/1…

5th July 2022
IoTWorldToday, IoTWorldSeries

AI Summit 2022: Unilever’s Alberto Prado dlvr.it/STMpRN https://t.co/1dyLREr8N6

5th July 2022

Newsletter

Sign up for IoT World Today newsletters: vertical industry coverage on Tuesdays and horizontal tech coverage on Thursdays.

Special Reports

Our Special Reports take an in-depth look at key topics within the IoT space. Download our latest reports.

Business Resources

Find the latest white papers and other resources from selected vendors.

Media Kit and Advertising

Want to reach our audience? Access our media kit.

DISCOVER MORE FROM INFORMA TECH

  • IoT World Series
  • Channel Futures
  • RISC-V
  • Dark Reading
  • ITPro Today
  • Web Hosting Talk

WORKING WITH US

  • Contact
  • About Us
  • Advertise
  • Login/Register

FOLLOW IoT World Today ON SOCIAL

  • Privacy
  • CCPA: “Do Not Sell My Data”
  • Cookies Policy
  • Terms
Copyright © 2022 Informa PLC. Informa PLC is registered in England and Wales with company number 8860726 whose registered and Head office is 5 Howick Place, London, SW1P 1WG.
This website uses cookies, including third party ones, to allow for analysis of how people use our website in order to improve your experience and our services. By continuing to use our website, you agree to the use of such cookies. Click here for more information on our Cookie Policy and Privacy Policy.
X