https://www.iotworldtoday.com/wp-content/themes/ioti_child/assets/images/logo/IoTWorldToday-mobile-logo.png
  • Home
  • News
    • Back
    • Roundups
  • Strategy
  • Special Reports
  • Business Resources
    • Back
    • Webinars
    • White Papers
    • Industry Perspectives
    • Featured Vendors
  • Other Content
    • Back
    • Q&As
    • Case Studies
    • Features
    • How-to
    • Opinion
    • Podcasts
    • Strategic Partners
    • Latest videos
  • More
    • Back
    • About Us
    • Contact
    • Advertise
    • Editorial Submissions
  • Events
Iot World Today
  • NEWSLETTER
  • Home
  • News
    • Back
    • Roundups
  • Strategy
  • Special Reports
  • Business Resources
    • Back
    • Webinars
    • White Papers
    • Industry Perspectives
    • Featured Vendors
  • Other Content
    • Back
    • Q&As
    • Case Studies
    • Features
    • How-to
    • Opinion
    • Podcasts
    • Strategic Partners
    • Latest videos
  • More
    • Back
    • About Us
    • Contact
    • Advertise
    • Editorial Submissions
  • Events
  • newsletter
  • IIoT
  • Cities
  • Energy
  • Homes/Buildings
  • Transportation/Logistics
  • Connected Health Care
  • Retail
  • AI
  • Metaverse
  • Development
  • Security
ioti.com

Metaverse


Getty Images

Edge computing applications

Trends Continue to Push Processing to the Edge for AI

Recent developments, including the NVIDIA-Arm deal and VMware’s Project Monterey, reveal big bets on edge computing.
  • Written by Lauren Horwitz
  • 13th October 2020

Key takeaways from this article include the following:

  • Device proliferation and data volumes now favor distributed computing models for speed, performance and data security reasons
  • Recent vendor moves by NVIDIA and VMware provide support for data-intensive processing, such as AI and machine learning, at the edge.
  • Many processes and industries will benefit from pushing processing to the edge, including Industrial IoT and consumer-based IoT.

As connected devices proliferate, new ways of processing have come to the fore to accommodate device and data explosion.

For years, organizations have moved toward centralized, off-site processing architecture in the cloud and away from on-premises data centers. Cloud computing enabled startups to innovate and expand their businesses without requiring huge capital outlays on data center infrastructure or ongoing costs for IT management. It enabled large organizations to scale quickly and stay agile by using on-demand resources.

But as enterprises move toward more remote models, video-intensive communications and other processes, they need an edge computing architecture to accommodate data-hogging tasks.

These data-intensive processes need to happen within fractions of a second: Think self-driving cars, video streaming or tracking shipping trucks in real time on their route. Sending data on a round trip to the cloud and back to the device takes too much time. It can also add cost and compromise data in transit.

“Customers realize they don’t want to pass a lot of processing up to the cloud, so they’re thinking the edge is the real target,” according to Markus Levy, head of AI technologies at NXP Semiconductors, in a piece on the rise of embedded AI.

In recent years, edge computing architecture has moved to the fore, to accommodate the proliferation of data and devices as well as the velocity at which this data is moving.

The edge computing market is expected to grow from $3.6 billion in 2020 to $15.7 billion by 2025, according to MarketsandMarkets data.

Market Moves Continue to Push Processing to the Edge: NVIDIA

Recent moves by NVIDIA, a giant in the graphical processing unit (GPU) market, and VMware, the virtualization vendor, support these new distributed processing architectures and clearly pave the way for lightning-fast processing at the edge.

First, in September, for example, NVIDIA announced its intention to pay $40 billion for Arm — in part to continue to push AI closer to the edge. While NVIDIA has dominated in the data center with its GPUs, Arm has a stronghold in the mobile market, supplying chips to Apple, Qualcomm and others.

“If you believe the future is AI, and you believe that is powered by GPUs and CPUs, then NVIDIA’s ability to create these end-to-end systems has just gone way up,” said Zeus Kerravala, in a video interview on the NVIDIA-Arm deal and prospects for AI at the edge. “Especially in the edge computing market — [NVIDIA] will be all over that.”

There are regulatory concerns about the NVIDIA-Arm deal, including whether it could imperil Arm’s successful licensing business. Arm has hundreds of licenses with its partners — which, in addition to competitors AMD and Intel — includes giants like Apple, Qualcomm and Broadcom. There are also serious antitrust concerns about NVIDIA’s newfound control of the mobile CPU market.

SmartNICs: Moving Processing Down to the Edge

Second, at the VMworld 2020 virtual conference in late September, VMware announced Project Monterey to provide improved AI performance with SmartNIC (or smart network interface card) technology and NVIDIA’s data processing units (DPUs). Project Monterey involves partnership with several companies, including NVIDIA, to bolster infrastructure to support AI applications at the edge.

Monterey offloads hypervisor, networking, security and storage tasks from a host CPU to NVIDIA’s BlueField DPU. Moving this processing to DPUs andSmartNics can forward AI, machine learning and other data-centric applications.

A SmartNIC runs non-application tasks from a server CPU, so the server can run more applications faster.

“There has been a general wave of interest in moving computation closer to the data,” said Alexander Harrowell, senior analyst at Omdia.

“It moves the abstraction of the hypervisor down from the host to the network … and offloads some of the work that the hypervisor itself does into that card,” Harrowell said. “It makes more of the processing power you paid for available. So there is a story here of a shift away from the classic Intel x86 model to the so-called Harvard Computing Model.”

This trend toward distributed computing, Harrowell noted, will continue apace and enable more complex processing, such as AI processing.

“By offloading a lot of that I/O work onto the Arm core and taking advantage of hardware offloads in those SmartNICs,” said Greg Lavender, senior vice president and chief technology officer at VMware,“you can offload that processing and free up even as much as 30% of the CPU … and give that back to the application so [it]  gets the benefit of those extra compute and memory resources.

For the connected-things market, moving processing down the stack and into these distributed edge architectures will be a major boon for data-intensive processes that need rapid response times.

“Now that you can do AI at the edge, you can turn the IoT into something with real capabilities,” said NXP’s Levy.

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

For more coverage on Industrial IoT, take part in Industrial IoT World this December.

Tags: Edge computing IIoT/Manufacturing Metaverse Technologies

Related Content


  • Move to the Cloud. Go Beyond.
    An innovative new category of application for building high-performance microservices and APIs with no operations required.
  • Dell Technologies World 2022: Michael Dell Talks What’s Next in Tech
    A key opportunity for the company is the growth in edge computing
  • Nations Ranking Highest for Efficiently Deploying Cloud
    Where did the U.S. place?
  • Image shows a metaverse concept background with perspective and copy space - 3d illustration
    Businesses Gear up for the Metaverse
    What is the Metaverse and does it already exist?

Leave a comment Cancel reply

-or-

Log in with your IoT World Today account

Alternatively, post a comment by completing the form below:

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Latest News

  • Partnership to Globally Expand Robotics Solutions
  • Researchers Use Robotic Prey to Track Predator Behavior
  • IoT Deals and Partnerships Roundup: Sony, Emnify, Nexxiot and more
  • IoT Product Roundup: Canonical, InfluxData, Wiliot and More

Roundups

View all

IoT Product Roundup: Canonical, InfluxData, Wiliot and More

23rd June 2022

IoT Product Roundup: Cisco, Telit, Draganfly and More

9th June 2022

IoT Deals, Partnerships Roundup: Google, Arm, Senet and More

26th May 2022

White Papers

View all

The Role of Manufacturing Technology in Continuous Improvement Ebook

6th April 2022

IIoT Platform Trends for Manufacturing in 2022

6th April 2022

Latest Videos

View all
Image shows Unilever's Alberto Prado at AI Summit 2022 in London

AI Summit 2022: Unilever’s Alberto Prado

Prado talks about how Unilever is using AI to accelerate the speed of new discoveries and gives them access to more breakthrough innovation

Image Shows John Lewis' Barry Panai at AI Summit London 2022

AI Summit 2022: John Lewis’ Barry Panayi on AI in Retail

Panayi talks about data and AI in retail and how individuals and the technology can work together

E-books

View all

How Remote Access Helps Enterprises Improve IT Service and Employee Satisfaction

12th January 2022

An Integrated Approach to IoT Security

6th November 2020

Webinars

View all

Rethinking the Database in the IoT Era

18th May 2022

Jumpstarting Industrial IoT solutions with an edge data management platform

12th May 2022

AI led Digital Transformation of Manufacturing: Time is NOW

9th December 2021

Special Reports

View all

Omdia’s Smart Home Market Dynamics Report

7th January 2022

Cybersecurity Protection Increasingly Depends on Machine Learning

28th October 2020

IoT Security Best Practices for Industry and Enterprise

20th October 2020

Twitter

IoTWorldToday, IoTWorldSeries

IoT Product Roundup: Nokia, Energous, Dashbot and more dlvr.it/STRKDh https://t.co/YgTAI5SXSB

6th July 2022
IoTWorldToday, IoTWorldSeries

A new #IoT bug monitoring system from @CENSIS121 is helping the UK’s #forestry industry fight pests, and save money… twitter.com/i/web/status/1…

6th July 2022
IoTWorldToday, IoTWorldSeries

NHTSA Boss Hints at Federally Regulating Autonomous Vehicles dlvr.it/STQrrw https://t.co/Yjp1UKuaE5

6th July 2022
IoTWorldToday, IoTWorldSeries

Nvidia Powered Driverless Three-Wheelers Set to Debut dlvr.it/STQq0H https://t.co/RrYyVPgFzB

6th July 2022
IoTWorldToday, IoTWorldSeries

New Drone System Aims for Full Autonomy dlvr.it/STQnvV https://t.co/S4O8hb6gQh

6th July 2022
IoTWorldToday, IoTWorldSeries

Bosch, VW Approved to Develop Automated Driving dlvr.it/STQllD https://t.co/neI30dVmC6

6th July 2022
IoTWorldToday, IoTWorldSeries

🤔 Looking for 3 Strategies to Avoid IoT Key Theft? We’ve got you covered! As tech companies continue to develop an… twitter.com/i/web/status/1…

5th July 2022
IoTWorldToday, IoTWorldSeries

AI Summit 2022: Unilever’s Alberto Prado dlvr.it/STMpRN https://t.co/1dyLREr8N6

5th July 2022

Newsletter

Sign up for IoT World Today newsletters: vertical industry coverage on Tuesdays and horizontal tech coverage on Thursdays.

Special Reports

Our Special Reports take an in-depth look at key topics within the IoT space. Download our latest reports.

Business Resources

Find the latest white papers and other resources from selected vendors.

Media Kit and Advertising

Want to reach our audience? Access our media kit.

DISCOVER MORE FROM INFORMA TECH

  • IoT World Series
  • Channel Futures
  • RISC-V
  • Dark Reading
  • ITPro Today
  • Web Hosting Talk

WORKING WITH US

  • Contact
  • About Us
  • Advertise
  • Login/Register

FOLLOW IoT World Today ON SOCIAL

  • Privacy
  • CCPA: “Do Not Sell My Data”
  • Cookies Policy
  • Terms
Copyright © 2022 Informa PLC. Informa PLC is registered in England and Wales with company number 8860726 whose registered and Head office is 5 Howick Place, London, SW1P 1WG.
This website uses cookies, including third party ones, to allow for analysis of how people use our website in order to improve your experience and our services. By continuing to use our website, you agree to the use of such cookies. Click here for more information on our Cookie Policy and Privacy Policy.
X