https://www.iotworldtoday.com/wp-content/themes/ioti_child/assets/images/logo/footer-logo.png
  • Home
  • News
    • Back
    • IoT World 2020 News
  • Strategy
  • Special Reports
  • Galleries
  • Business Resources
    • Back
    • Webinars
    • White Papers
    • Industry Perspectives
    • Featured Vendors
  • Other Content
    • Back
    • IoT World 2020 News
    • Q&As
    • Case Studies
    • Features
    • How-to
    • Opinion
    • Video / Podcasts
  • More
    • Back
    • About Us
    • Contact
    • Advertise
    • Strategic Partners
  • IOT World Events
    • Back
    • Internet of Things World: San Jose
    • IoT World 2020 News
Iot World Today
  • NEWSLETTER
  • Home
  • News
    • Back
    • IoT World 2020 News
  • Strategy
  • Special Reports
  • Galleries
  • Business Resources
    • Back
    • Webinars
    • White Papers
    • Industry Perspectives
    • Featured Vendors
  • Other Content
    • Back
    • IoT World 2020 News
    • Q&As
    • Case Studies
    • Features
    • How-to
    • Opinion
    • Video / Podcasts
  • More
    • Back
    • About Us
    • Contact
    • Advertise
    • Strategic Partners
  • IOT World Events
    • Back
    • Internet of Things World: San Jose
    • IoT World 2020 News
  • newsletter
  • IIoT
  • Cities
  • Energy
  • Homes/Buildings
  • Transportation/Logistics
  • Connected Health Care
  • Retail
  • AI
  • Architecture
  • Engineering/Development
  • Security
ioti.com

Architecture


Getty Images

Image shows deep learning artificial intelligence and big data algorithms.

TinyML Could Democratize AI Programming for IoT

Upgrading microcontrollers with small, essentially self-contained neural networks enables organizations to deploy efficient AI capabilities for IoT without waiting for specialized AI chips.
  • Written by Pete Bartolik
  • 3rd November 2020

Much of the development in machine language (ML) implementations follows a “bigger is better” path: more data, more storage, more compute power, more bandwidth all equals better results – or so the mantra goes.

But a community-based effort is moving in the opposite direction, building “TinyML” implementations for use on low-powered devices with scarce computer and memory assets — like the millions of sensors deployed in Internet of Things (IoT) implementations.

TinyML downsizes the technology to deploy neural networks on low-cost microprocessors where they can operate completely or semi-independently using long-lasting, low-power batteries. While semiconductor companies have created chipsets to exploit this technology, proponents say they can deploy TinyML software to existing microcontrollers in the field. 

The TinyML effort coalesced in early 2019 at a meeting to formalize effort around the fast-growing movement, which drew nearly 200 attendees and led to the formation of the tinyML Foundation. 

“We are really exploring machine learning for low-power inexpensive applications, rather than big machine learning algorithms running in a data center,” said Zach Shelby, then an executive with the Arm Ltd. semiconductor and software design company, who left to co-found Edge Impulse, which provides TinyML developer resources.

Making Sense of Noisy Sensor Data With Tiny ML for IoT

TinyML started as a hashtag from Pete Warden of Google, one of the proponents of the movement. In a book he co-authored for TinyML developers, Warden wrote, “It became clear to me that there was a whole new class of products emerging, with the key characteristics that they used ML to make sense of noisy sensor data, could run using a battery or energy harvesting for years, and cost only a dollar or two.”

TinyML encompasses efforts that have accelerated over the past few years. Alexander Wong and Mohammad Javad Shafiee, systems design engineering professors at the University of Waterloo, announced in 2017 they had achieved a 200-fold reduction in the size of deep-learning AI software used for a particular object recognition task. 

“Tiny ML is essentially about the premise of building very small and efficient machine learning algorithms,” Wong said in a recent interview. “So, what we’ve done is we’ve created an AI that builds these tiny ML models automatically.”

One example is TinyML speech code, as small as 16 kilobits, said Wong. “It could recognize a number of different commands like, ‘yes,’ ‘no,’ ‘left,’ ‘right,’ ‘stop,’ and this really caters to advancing on-device, voice assistance that’s untethered to the cloud,” he explained.  

‘Simple Software Fix’

The ability to upgrade already deployed microcontrollers with these small, essentially self-contained neural networks provides opportunities for organizations to deploy AI capabilities across IoT implementations without having to wait for development of specialized AI chip products that could take years to develop.

“If you have millions of 8-bit or 16-bit, or 32-bit microcontrollers deployed into various systems or applications, you now have the ability to some degree to offer to your customer base AI as a fairly simple software fix,” explained Richard Wawrzyniak, senior market analyst, ASIC & SoC, with Semico Research Corp.

Advancements in embedded AI are driven not only by innovation and invention but also of necessity given the downsides of data transmission to the cloud. “People finally figured out that sending every bit of data to the cloud is a nonstarter,” said Wawrzyniak. “There isn’t enough bandwidth to support that.” 

The vast amount of IoT sensors and the flood of data they generate represents too great a volume to cost-effectively transmit to the cloud or data center for data extraction, analysis and refining AI training models.

Proponents of TinyML make the case that more traditional ML implementations discard as much as 90% of the data collected by devices before sending them to a cloud service or data center. In contrast, TinyML can sift through all that data. 

“Sensors produce an amazing amount of information, of very high-quality data,” said Shelby. “Today, we can do some pattern matching, but it is difficult, and we throw away most of the data. When we do send data to the cloud, it is too much to deal with.” 

With TinyML algorithms, devices can do complex pattern matching locally, such as detecting an elderly person falling, or recognizing endangered species, or potentially spotting COVID-19 hot spots based on the type and frequency of coughing. According to Shelby, one electric utility is deploying sensors with TinyML and 10-year life batteries on ceramic capacitors that can monitor real-time disruptions to power lines.

“TinyML has the potential to be massive in implication,” Nikolas Kairinos, founder of international think tank Fountech.ai, wrote in an email exchange. “It is going to force us to develop more elegant algorithms and move beyond deep learning — reducing the brute-force approach to developing AI. We are also going to be able to deploy complex models on devices in KB of RAM, overcoming restrictions like bandwidth and power constraints.”

Democratizing AI for IoT

One of the most disruptive aspects of TinyML may be the potential to demystify ML and expand the numbers of developers working with AI. As Warden and co-author Daniel Situnayake wrote, “In reality, machine learning can be simple to understand and is accessible to anyone with a text editor. After you learn a few key ideas, you can easily use it in your own projects. Beneath all the mystique is a handy set of tools for solving various types of problems. It might sometimes feel like magic, but it’s all just code, and you don’t need a Ph.D. to work with it.”

There are only so many data scientists around to create algorithms. So, the development of TinyML developers aided by life cycle tools such as compilers and modelers will be vital to exploiting the explosive growth of microcontrollers and other AI-embedded chips. In addition to the potentially billions of existing microcontrollers today that could be upgraded with TinyML, tech market advisory firm ABI Research recently predicted that TinyML-specific chipsets will ship in 2.5 billion devices by 2030.

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

For more on AI in IoT, check out our AI in IoT conference. Register here.

Tags: Artificial intelligence/machine learning IoT platforms Architecture Other Content Features

Related


  • abstract global digital technology with internet of things icon
    IoT Trends 2021: A Focus on Fundamentals, Not Nice-to-Haves
    IoT trends in 2021 will focus on core needs such as health-and-safety efforts and equipment monitoring, but IoT in customer experience will also develop.
  • Image shows a 3D illustration of network wires and nodes.
    Data Strategies for Efficient and Secure Edge Computing Services
    If you want to exploit edge computing here are some data strategies to optimize and secure edge computing services.
  • Image shows Internet of things (IoT) and networking concept for connected devices.
    IoT Automation Trend Rides Next Wave of Machine Learning, Big Data
    IoT automation has found new raison d’etre in the COVID-19 era.
  • Image shows a global communication network concept.
    5G Is Just One IoT Connectivity Option
    Internet of Things deployments may benefit from the expanded capacity of 5G, but there are other worthy connectivity options.

Leave a comment Cancel reply

-or-

Log in with your IoT World Today account

Alternatively, post a comment by completing the form below:

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Content

  • Why Edge Computing Architecture Is Coming to Your Enterprise
  • Architecting a Cloud-to-Edge Computing Strategy
  • Could Agile IoT Development Gain Favor?
  • Sensor Fusion Technology Brings Data-Rich Environments to Fruition

News

View all

Private LTE Market Projected to Grow to $13 Billion

12th January 2021

IoT World Announces 2021 IoT World Advisory Board

9th December 2020

White Papers

View all

The eSIM Cookbook – Towards the Next Generation of Connected Devices

22nd February 2021

eSIM Delivers Greater Freedom for OEMs – by Beecham Research and Truphone

22nd February 2021

Special Reports

View all

Cybersecurity Protection Increasingly Depends on Machine Learning

28th October 2020

Webinars

View all

Weber’s Journey: How a Top Grill Maker Serves Up Connected Cooking

25th February 2021

From Insights to Action: Best Practices for Implementing Connected Device Security

15th December 2020

Galleries

View all

Top IoT Trends to Watch in 2020

26th January 2020

Five of the Most Promising Digital Health Technologies

14th January 2020

Industry Perspectives

View all

IoT Spending Holds Firm — Tempered by Dose of ‘IoT Pragmatism’

1st December 2020

The Great IoT Connectivity Lockdown

11th May 2020

Events

View all

IoT at the Edge

17th March 2021

Embedded IoT World 2021

28th April 2021 - 29th April 2021

IoT World 2021

2nd November 2021 - 4th November 2021

Twitter

IoTWorldToday, IoTWorldSeries

📢 Announcing #EIOTWORLD sponsor, @aicas_IoT — a flexible, more efficient approach to embedded realtime application… twitter.com/i/web/status/1…

4th March 2021
IoTWorldToday, IoTWorldSeries

Microsoft Ignite 2021: Innovation in COVID-19 Era Signals Future Trends dlvr.it/RtwYcg

4th March 2021
IoTWorldToday, IoTWorldSeries

At Microsoft Ignite: How IoT and Robotics Are Driving Industry 4.0 dlvr.it/Rttgwj

3rd March 2021
IoTWorldToday, IoTWorldSeries

🎙️ Introducing #EIOTWORLD speaker, Obinna Ilochonwu, Industrial IoT Architect at Schlumberger. 📅 Join his session… twitter.com/i/web/status/1…

2nd March 2021
IoTWorldToday, IoTWorldSeries

#Smartbuilding technology lays the foundation for #energyefficiency efforts but also new COVID-19 goals, such as… twitter.com/i/web/status/1…

2nd March 2021

Newsletter

Sign up for IoT World Today newsletters: vertical industry coverage on Tuesdays and horizontal tech coverage on Thursdays.

Special Reports

Our Special Reports take an in-depth look at key topics within the IoT space. Download our latest reports.

Business Resources

Find the latest white papers and other resources from selected vendors.

Media Kit and Advertising

Want to reach our audience? Access our media kit.

DISCOVER MORE FROM INFORMA TECH

  • IoT World Series
  • Channel Futures
  • RISC-V
  • Dark Reading
  • ITPro Today
  • Web Hosting Talk

WORKING WITH US

  • Contact
  • About Us
  • Advertise
  • Login/Register

FOLLOW IoT World Today ON SOCIAL

  • Privacy
  • CCPA: “Do Not Sell My Data”
  • Cookies Policy
  • Terms
Copyright © 2021 Informa PLC. Informa PLC is registered in England and Wales with company number 8860726 whose registered and Head office is 5 Howick Place, London, SW1P 1WG.
This website uses cookies, including third party ones, to allow for analysis of how people use our website in order to improve your experience and our services. By continuing to use our website, you agree to the use of such cookies. Click here for more information on our Cookie Policy and Privacy Policy.
X