Hewlett Packard Enterprise Ships First Nvidia Grace Blackwell System For Large AI Deployments
Hewlett Packard Enterprise announced that it has shipped its first Nvidia Blackwell family-based solution, the GB200 NVL72. This rack-scale system is designed to help service providers and enterprises quickly deploy large, complex artificial intelligence clusters with advanced, direct liquid cooling solutions to optimise efficiency and performance.
The GB200 NVL72 features shared-memory, low-latency architecture with the latest GPU technology designed for extremely large AI models of over a trillion parameters, in one memory space. The system offers integration of Nvidia CPUs, GPUs, compute and switch trays, networking, and software, addressing heavy workloads like generative AI model training and inferencing, along with Nvidia software applications.
“AI service providers and large enterprise model builders are under tremendous pressure to offer scalability, extreme performance, and fast time-to-deployment,” said Trish Damkroger, senior vice president and general manager of HPC & AI Infrastructure Solutions, HPE. “HPE offers customers lower cost per token training and best-in-class performance with industry-leading services expertise.”
Nvidia GB200 NVL72 Features
The system is equipped with 72 Nvidia Blackwell GPUs and 36 Nvidia Grace CPUs interconnected via high-speed Nvidia NVLink, and packs up to 13.5 TB total HBM3e memory with 576 TB/sec bandwidth.
It also features HPE direct liquid cooling technology, which is better than air-cooled systems, to keep up with increasing power and compute requirements.
Services And Support
HPE supports massive, custom AI clusters with services including expert on-site support, customised services, sustainability services and more. The company provides enhanced incident management with proactive support through dedicated remote engineers, ensuring rapid installation and faster time-to-value.
According to HPE, its services include:
Onsite Engineering Resources: On-site support through trained resident engineers who work closely with a customer's IT teams to ensure optimal system performance and availability.
Performance And Benchmarking Engagements: Team of experts to fine tune solutions throughout the life of a system.
Sustainability Services: Energy and emissions reporting, sustainability workshops, and resource monitoring to reduce environmental impact.
“Building on continued collaboration between HPE and Nvidia, HPE's first shipment of Nvidia GB200 NVL72 will help service providers and large enterprises efficiently build, deploy and scale large AI clusters,” said Bob Pette, vice president of enterprise platforms at Nvidia.
-
We May Need Another Tukaram Mundhe To Fight Air Pollution | The Reason Why
Developers may install basic measures such as sprinklers and green nets, resume work, and continue violating rules when this equipment stops working.
-
Extracting Value From Battery Scrap Could Be Challenging For India | The Reason Why
A discarded lithium-ion battery still contains valuable materials such as lithium, nickel and cobalt. These can be recovered and reused. When such batteries are crushed and shredded, they produce a dark powder called black mass.
-
One El Nino, India Can Handle. Two Could Break The Granary
India's grain stocks can absorb one bad year, but a second El Nino could drain the buffer in two to three years, economists say.
-
India's Troika Of Good Luck | Joining The Dots
As Jensen Huang's exit drags Nvidia down, a cooling AI trade and resilient earnings have revived investor interest in India. A likely RBI rate hike looms.
-
Talking Points This Week: Leadership Shock At Nvidia, Earnings Strength, And The Fog Over Hormuz
The Anthropic IPO pricing and first trading day, Nvidia's upcoming earnings, and any fresh signals from Iran will set the tone for the following week.
-
Signature Play: The Classic Cocktail Is Dead. Or Is It?
Classic cocktails are disappearing from India's cocktail menus. But they're still being ordered, taught to bartenders and borrowed from. So, who's really having the last drink?
-
A New Samvat Wishlist: Inclusive Prosperity And Human Development
India has strengthened its economic foundations through infrastructure, digital access and enterprise. Its next growth chapter must deepen productivity, create better livelihoods and widen participation in prosperity.
-
Love, Sex Aur Dhokha: The Audacious Plot To Spy On Jensen Huang
A Taipei dinner, a Singapore chip buyer and a suspected Chinese asset: inside the alleged spy operation that got close to NVIDIA's Jensen Huang.
-
Ten Things I Learnt This Samvat
Patience can be a trap. Cheap stocks can stay cheap. Leverage can wipe you out. What did Samvat 2082 teach us? Niraj Shah writes on 10 lessons from the year gone by.
-
Talking Points This Week: Tech Nerves, FII Buying, And A Faraway Banking Shock
The global markets are not shining this Diwali. The exception in the large markets is, India.