Physical Address
304 North Cardinal St.
Dorchester Center, MA 02124
Nvidia today announced that it is releasing a family of foundational AI models called Cosmos that can be used for training. humanoidsIndustrial robots, and Self-driving cars. While language models learn to generate text through training on a large amount of books, articles, and social media posts, Cosmos is designed to generate images and 3D models of the physical world.
During a keynote presentation at the annual CES conference in Las Vegas, Nvidia CEO Jensen Huang Shows examples of using Cosmos to simulate operations inside warehouses Cosmos was “trained on 20 million hours of real footage of people walking, moving hands, moving things,” Jensen said. “It’s not about creating creative content, but teaching AI to understand the physical world.”
Researchers and startups hope that such foundational models can Give robots used in factories and homes More sophisticated capabilities. For example, Cosmos can create realistic video footage of boxes falling off shelves inside a warehouse, which can be used to train a robot to detect accidents. Users can fine-tune the models using their own data.
Nvidia says several companies are already using Cosmos, including humanoid robot startups Agility and Figure AI, as well as self-driving car companies like Uber, Wabi and Wave.
Nvidia also announced software designed to help a variety of robots learn to perform new tasks more efficiently. The new feature is part of Nvidia’s existing Isaac robot simulation platform that allows robot builders to take a small number of examples of a desired task, such as grasping a specific object, and generate large amounts of synthetic training data.
Nvidia hopes Cosmos and Isaac will appeal to companies looking to build and use humanoid robots. Jensen was joined on stage at CES by life-size images of 14 different humanoid robots created by companies including Tesla, Boston Dynamics, Agility and Figure.
Along with Cosmos, Nvidia also announced Project Digits, a $3,000 “Personal AI Supercomputer” One that can run a large language model of 200 billion parameters without the need for a cloud service from the likes of AWS or Microsoft. It announced its highly anticipated next-generation RTX Blackwell GPUs and upcoming software tools to help build it AI agent.
