https://www.iotworldtoday.com/wp-content/themes/ioti_child/assets/images/logo/footer-logo.png
  • Home
  • News
    • Back
    • IoT World 2020 News
  • Strategy
  • Special Reports
  • Galleries
  • Business Resources
    • Back
    • Webinars
    • White Papers
    • Industry Perspectives
    • Featured Vendors
  • Other Content
    • Back
    • IoT World 2020 News
    • Q&As
    • Case Studies
    • Features
    • How-to
    • Opinion
    • Video / Podcasts
  • More
    • Back
    • About Us
    • Contact
    • Advertise
    • Strategic Partners
  • IOT World Events
    • Back
    • Internet of Things World: San Jose
    • IoT World 2020 News
Iot World Today
  • NEWSLETTER
  • Home
  • News
    • Back
    • IoT World 2020 News
  • Strategy
  • Special Reports
  • Galleries
  • Business Resources
    • Back
    • Webinars
    • White Papers
    • Industry Perspectives
    • Featured Vendors
  • Other Content
    • Back
    • IoT World 2020 News
    • Q&As
    • Case Studies
    • Features
    • How-to
    • Opinion
    • Video / Podcasts
  • More
    • Back
    • About Us
    • Contact
    • Advertise
    • Strategic Partners
  • IOT World Events
    • Back
    • Internet of Things World: San Jose
    • IoT World 2020 News
  • newsletter
  • IIoT
  • Cities
  • Energy
  • Homes/Buildings
  • Transportation/Logistics
  • Connected Health Care
  • Retail
  • AI
  • Architecture
  • Engineering/Development
  • Security
ioti.com

Architecture


Getty Images

Edge computing applications

Trends Continue to Push Processing to the Edge for AI

Recent developments, including the NVIDIA-Arm deal and VMware’s Project Monterey, reveal big bets on edge computing.
  • Written by Lauren Horwitz
  • 13th October 2020

Key takeaways from this article include the following:

  • Device proliferation and data volumes now favor distributed computing models for speed, performance and data security reasons
  • Recent vendor moves by NVIDIA and VMware provide support for data-intensive processing, such as AI and machine learning, at the edge.
  • Many processes and industries will benefit from pushing processing to the edge, including Industrial IoT and consumer-based IoT.

As connected devices proliferate, new ways of processing have come to the fore to accommodate device and data explosion.

For years, organizations have moved toward centralized, off-site processing architecture in the cloud and away from on-premises data centers. Cloud computing enabled startups to innovate and expand their businesses without requiring huge capital outlays on data center infrastructure or ongoing costs for IT management. It enabled large organizations to scale quickly and stay agile by using on-demand resources.

But as enterprises move toward more remote models, video-intensive communications and other processes, they need an edge computing architecture to accommodate data-hogging tasks.

These data-intensive processes need to happen within fractions of a second: Think self-driving cars, video streaming or tracking shipping trucks in real time on their route. Sending data on a round trip to the cloud and back to the device takes too much time. It can also add cost and compromise data in transit.

“Customers realize they don’t want to pass a lot of processing up to the cloud, so they’re thinking the edge is the real target,” according to Markus Levy, head of AI technologies at NXP Semiconductors, in a piece on the rise of embedded AI.

In recent years, edge computing architecture has moved to the fore, to accommodate the proliferation of data and devices as well as the velocity at which this data is moving.

The edge computing market is expected to grow from $3.6 billion in 2020 to $15.7 billion by 2025, according to MarketsandMarkets data.

Market Moves Continue to Push Processing to the Edge: NVIDIA

Recent moves by NVIDIA, a giant in the graphical processing unit (GPU) market, and VMware, the virtualization vendor, support these new distributed processing architectures and clearly pave the way for lightning-fast processing at the edge.

First, in September, for example, NVIDIA announced its intention to pay $40 billion for Arm — in part to continue to push AI closer to the edge. While NVIDIA has dominated in the data center with its GPUs, Arm has a stronghold in the mobile market, supplying chips to Apple, Qualcomm and others.

“If you believe the future is AI, and you believe that is powered by GPUs and CPUs, then NVIDIA’s ability to create these end-to-end systems has just gone way up,” said Zeus Kerravala, in a video interview on the NVIDIA-Arm deal and prospects for AI at the edge. “Especially in the edge computing market — [NVIDIA] will be all over that.”

There are regulatory concerns about the NVIDIA-Arm deal, including whether it could imperil Arm’s successful licensing business. Arm has hundreds of licenses with its partners — which, in addition to competitors AMD and Intel — includes giants like Apple, Qualcomm and Broadcom. There are also serious antitrust concerns about NVIDIA’s newfound control of the mobile CPU market.

SmartNICs: Moving Processing Down to the Edge

Second, at the VMworld 2020 virtual conference in late September, VMware announced Project Monterey to provide improved AI performance with SmartNIC (or smart network interface card) technology and NVIDIA’s data processing units (DPUs). Project Monterey involves partnership with several companies, including NVIDIA, to bolster infrastructure to support AI applications at the edge.

Monterey offloads hypervisor, networking, security and storage tasks from a host CPU to NVIDIA’s BlueField DPU. Moving this processing to DPUs andSmartNics can forward AI, machine learning and other data-centric applications.

A SmartNIC runs non-application tasks from a server CPU, so the server can run more applications faster.

“There has been a general wave of interest in moving computation closer to the data,” said Alexander Harrowell, senior analyst at Omdia.

“It moves the abstraction of the hypervisor down from the host to the network … and offloads some of the work that the hypervisor itself does into that card,” Harrowell said. “It makes more of the processing power you paid for available. So there is a story here of a shift away from the classic Intel x86 model to the so-called Harvard Computing Model.”

This trend toward distributed computing, Harrowell noted, will continue apace and enable more complex processing, such as AI processing.

“By offloading a lot of that I/O work onto the Arm core and taking advantage of hardware offloads in those SmartNICs,” said Greg Lavender, senior vice president and chief technology officer at VMware,“you can offload that processing and free up even as much as 30% of the CPU … and give that back to the application so [it]  gets the benefit of those extra compute and memory resources.

For the connected-things market, moving processing down the stack and into these distributed edge architectures will be a major boon for data-intensive processes that need rapid response times.

“Now that you can do AI at the edge, you can turn the IoT into something with real capabilities,” said NXP’s Levy.

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

For more coverage on Industrial IoT, take part in Industrial IoT World this December.

Tags: Edge computing IIoT/Manufacturing Architecture Technologies

Related


  • Jetting to the Stars Using Containers for Development
    The Department of Defense develops for space travel, bombers and jets. It turned to containers for development to build and battle-test its mission-critical systems.
  • Data-Driven Digital Transformation Propels Airbus to New Heights
    Airbus wanted to get more customer focused through data-driven strategies. But instead of gathering new data, it brought discipline to its existing data.
  • AT CES 2021, Verizon Touts 5G Connectivity as Enabler in Pandemic Times
    Verizon touts 5G as a present-day reality for improved network speed and performance, but most enterprises are still waiting for 5G benefits.
  • Private LTE Market Projected to Grow to $13 Billion
    The private LTE market may reach $13 billion by 2026, according to Global Market Insights, driven the need for greater network performance and productivity.

Leave a comment Cancel reply

-or-

Log in with your IoT World Today account

Alternatively, post a comment by completing the form below:

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Content

  • IoT Spending Is a Mixed Picture in 2020
  • Smart Transportation Projects Foundational for Sustainable Cities
  • Network Machine Learning Offers Refuge for Taxed Managers
  • Tactics for Successfully Selling IoT Technologies

News

View all

Private LTE Market Projected to Grow to $13 Billion

12th January 2021

IoT World Announces 2021 IoT World Advisory Board

9th December 2020

White Papers

View all

Zero Trust Manufacturing: Navigating Complex Supply Chains to Build Trusted IoT Devices

27th January 2021

IoTConnect and How to Get Started

27th January 2021

Special Reports

View all

Cybersecurity Protection Increasingly Depends on Machine Learning

28th October 2020

Webinars

View all

Weber’s Journey: How a Top Grill Maker Serves Up Connected Cooking

25th February 2021

From Insights to Action: Best Practices for Implementing Connected Device Security

15th December 2020

Galleries

View all

Top IoT Trends to Watch in 2020

26th January 2020

Five of the Most Promising Digital Health Technologies

14th January 2020

Industry Perspectives

View all

IoT Spending Holds Firm — Tempered by Dose of ‘IoT Pragmatism’

1st December 2020

The Great IoT Connectivity Lockdown

11th May 2020

Events

View all

IoT at the Edge

17th March 2021

Embedded IoT World 2021

28th April 2021 - 29th April 2021

IoT World 2021

2nd November 2021 - 4th November 2021

Twitter

IoTWorldToday, IoTWorldSeries

Zero Trust Manufacturing: Navigating Complex Supply Chains to Build Trusted IoT Devices dlvr.it/RrTDP4 https://t.co/fuH0GrHJrX

27th January 2021
IoTWorldToday, IoTWorldSeries

PKI: The Solution for Designing Secure IoT Devices dlvr.it/RrTDNF https://t.co/KBWcsksAQi

27th January 2021
IoTWorldToday, IoTWorldSeries

Five Guiding Tenets for IoT Security dlvr.it/RrTDGS https://t.co/Ss17Vn4sFw

27th January 2021
IoTWorldToday, IoTWorldSeries

📢 Announcing #EIOTWORLD Silver Sponsor @ONETech_AI! 💡 Learn more about sponsoring Embedded IoT World here:… twitter.com/i/web/status/1…

27th January 2021
IoTWorldToday, IoTWorldSeries

IoTConnect and How to Get Started dlvr.it/RrT1gl https://t.co/6Vci1hvOV2

27th January 2021
IoTWorldToday, IoTWorldSeries

RT @IoTWorldToday: #IoTsecuritytrends in 2021 will feature new threats given #remotework, #digitalhealth and #edgecomputing. https://t.co/S…

27th January 2021
IoTWorldToday, IoTWorldSeries

#IoTsecuritytrends in 2021 will feature new threats given #remotework, #digitalhealth and #edgecomputing.… twitter.com/i/web/status/1…

25th January 2021
IoTWorldToday, IoTWorldSeries

Protecting Your Network Against Ripple20 Vulnerabilities dlvr.it/RrJhpD https://t.co/Q2xe5hoy4U

25th January 2021

Newsletter

Sign up for IoT World Today newsletters: vertical industry coverage on Tuesdays and horizontal tech coverage on Thursdays.

Special Reports

Our Special Reports take an in-depth look at key topics within the IoT space. Download our latest reports.

Business Resources

Find the latest white papers and other resources from selected vendors.

Media Kit and Advertising

Want to reach our audience? Access our media kit.

DISCOVER MORE FROM INFORMA TECH

  • IoT World Series
  • Channel Futures
  • RISC-V
  • Dark Reading
  • ITPro Today
  • Web Hosting Talk

WORKING WITH US

  • Contact
  • About Us
  • Advertise
  • Login/Register

FOLLOW IoT World Today ON SOCIAL

  • Privacy
  • CCPA: “Do Not Sell My Data”
  • Cookies Policy
  • Terms
Copyright © 2021 Informa PLC. Informa PLC is registered in England and Wales with company number 8860726 whose registered and Head office is 5 Howick Place, London, SW1P 1WG.
This website uses cookies, including third party ones, to allow for analysis of how people use our website in order to improve your experience and our services. By continuing to use our website, you agree to the use of such cookies. Click here for more information on our Cookie Policy and Privacy Policy.
X