Nvidia Releases GPT-Powered Robot Training Software

The system, Eureka, autonomously generates algorithms to train robots using reinforcement learning

Scarlett Evans, Assistant Editor, IoT World Today

October 27, 2023

1 Min Read
Nvidia's system autonomously generates algorithms to train robots

Nvidia has released a new AI-enabled system, the company says can teach robots complex skills.

The Eureka system, which is powered by GPT-4, autonomously creates reward algorithms to train robots. The software is also self-learning, generating insights from each robot training session and modifying its algorithm generation in response.

The company demonstrated the system by training a robotic hand to spin a pen between its fingers, demonstrating its dexterity.

The pen-spinning capabilities are one of nearly 30 new tasks robots can be taught using Eureka, including opening drawers, catching and throwing a ball, and using scissors.

According to a paper released by Nvidia as part of the announcement, the reinforcement-learning system allows robots to outperform human-written algorithms on more than 80% of the tasks considered. 

“Reinforcement learning has enabled impressive wins over the last decade, yet many challenges still exist, such as reward design, which remains a trial-and-error process,” said Anima Anandkumar, Nvidia’s senior director of AI research. “Eureka is a first step toward developing new algorithms that integrate generative and reinforcement learning methods to solve hard tasks.”

“Eureka is a unique combination of large language models and Nvidia…simulation technologies,” said Linxi ‘Jim’ Fan, Nvidia’s senior research scientist. “We believe that Eureka will enable dexterous robot control and provide a new way to produce physically realistic animations for artists.”

Related:Nvidia, Segway-Ninebot Launch Robotics Development Platform

About the Author(s)

Scarlett Evans

Assistant Editor, IoT World Today

Scarlett Evans is the assistant editor for IoT World Today, with a particular focus on robotics and smart city technologies. Scarlett has previous experience in minerals and resources with Mine Australia, Mine Technology and Power Technology. She joined Informa in April 2022.

Sign Up for the Newsletter
The most up-to-date news and insights into the latest emerging technologies ... delivered right to your inbox!

You May Also Like