Huang Confirms Full Production of Nvidia’s Next-Gen Processors
CEO Jensen Huang said that the company’s next generation of chips is in “full production,” to deliver five times the artificial-intelligence computing of the company’s previous chips when serving up chatbots and other AI apps.
In a speech at the Consumer Electronics Show in Las Vegas, the leader of the world's most valuable company revealed new details about its chips, which will arrive later this year..
The Vera Rubin platform is observed to havemade up of six separate Nvidia chips, and is expected to debut later this year, with the flagship server containing 72 of the company’s graphics units and 36 of its new central processors.
Huang showed how they can be strung together into "pods" with more than 1,000 Rubin chips and said they could improve the efficiency of generating what are known as "tokens" - the fundamental unit of AI systems - by 10 times.
To get the new performance results, however, Huang said the Rubin chips use a proprietary kind of data that the company hopes the wider industry will adopt.
"This is how we were able to deliver such a gigantic step up in performance, even though we only have 1.6 times the number of transistors," Huang said.
Also Read: EAM Jaishankar Meets German MP, Discusses Growing Bilateral Ties
Additionally, Nvidia showcased a new generation of networking switches with a new kind of connection called co-packaged optics. The technology is believed to be key to linking together thousands of machines into one, and could compete with offerings from Broadcom and Cisco Systems.
Also Read: Nvidia Considers Increasing H200 Chip Output
The company said that CoreWeave will be among the first to have the new Vera Rubin systems and that it expects Microsoft to adopt them as well.
Also Read: US to Review Nvidia AI Chip Sales to China
Furthermore, Huang highlighted new software that can help self-driving cars make decisions about which path to take - and leave a paper trail for engineers to use afterward