For anyone - including, apparently, this article’s author’s - who is confused about the form factor, this is the next generation to follow the Grace Blackwell “GB300-NVL72”, their full rack interconnected system.
It’s the same technology as the matching 8-GPU “HGX” board that is built into larger individual servers - which in this generation’s case is just called “B300” as it has the “Blackwell” GPU but not the “Grace” CPU - but not sold in smaller units than an entire rack.
Here are some pictures and a video of that NVL72 version (you can buy these from Dell and others, as well as direct from Nvidia):
The full rack has 18 compute trays, each with 2 of the pictured board inside (for a total of 36 CPUs and 72 GPUs), and 9 NVLink switch trays that connect every GPU together. PSUs and networking make up the rest.
For anyone - including, apparently, this article’s author’s - who is confused about the form factor, this is the next generation to follow the Grace Blackwell “GB300-NVL72”, their full rack interconnected system.
It’s the same technology as the matching 8-GPU “HGX” board that is built into larger individual servers - which in this generation’s case is just called “B300” as it has the “Blackwell” GPU but not the “Grace” CPU - but not sold in smaller units than an entire rack.
Here are some pictures and a video of that NVL72 version (you can buy these from Dell and others, as well as direct from Nvidia):
https://www.servethehome.com/dell-and-coreweave-show-off-first-nvidia-gb300-nvl72-rack/ https://www.ingrasys.com/solutions/NVIDIA/nvidia_gb300_nvl72/
The full rack has 18 compute trays, each with 2 of the pictured board inside (for a total of 36 CPUs and 72 GPUs), and 9 NVLink switch trays that connect every GPU together. PSUs and networking make up the rest.