The AMD Instinct MI350 – ServeTheHome

AMD Instinct MI350 Package

This week, we grabbed a few photos at AMD’s Advancing AI 2025 event. We thought they would be worth showing since AMD said it is already shipping the Instinct MI350 series to customers.

AMD Instinct MI350 Package

Here is a straight-on shot of the AMD Instinct MI350 package. You can see the eight HBM3E 12-high stacks around the central compute tiles and two I/O dies.

AMD Instinct MI350 Package

Here is the package from a different angle.

AMD Instinct MI350 Package Angle

AMD had the pad side affixed to a stand, but here is what the pads look like on the other side.

AMD Instinct MI350 Pads

The GPU package is then soldered onto its OAM board to make an OAM package that can be installed in servers.

AMD Instinct MI350 OAM Package

That OAM package is installed into an OCP UBB.

AMD Instinct MI350 UBB

Here is the MI350 OAM package installed into a UBB alongside seven other GPUs for a total of eight.

AMD Instinct MI350 On UBB 8 GPU No Cooling 2

Here is another angle of that.

AMD Instinct MI350 On UBB 8 GPU No Cooling 1

Here is a look at the entire UBB with eight GPUs installed.

AMD Instinct MI350 UBB 8 GPU No Cooling

In a lot of ways, this is similar to the previous generation AMD Instinct MI325X board, and that is the point.

AMD Instinct MI350 On UBB 8 GPU No Cooling 3

On one end, we have the UBB connectors and a heatsink for the PCIe retimers.

AMD Instinct MI350X UBB PCIe Retimers

There is also a SMC for management.

AMD Instinct MI350 SMC

Beyond the board itself, is also the cooling.

AMD Instinct MI350X Air Cooling

Here is an OAM module with a big air cooling heatsink. This air cooling is the AMD Instinct MI350X.

AMD Instinct MI350X Cooler

Here are eight of these on the UBB. This is similar to what we saw above, just with the eight big heatsins.

AMD Instinct MI350X UBB 8 GPU

Here is another view of the heatsinks from the SMC and handle side.

AMD Instinct MI350X UBB 8 GPU Heatsink Profile

For some reference, here is the AMD MI300X’s UBB:

AMD MI300X 8 GPU OAM UBB 1

AMD also has the MI355X liquid-cooled version of this which allows for higher TDP and higher performance per card.

Final Words

Is always neat to see new generations of AI chips. We still have some AMD Instinct MI325X content coming up, but this new generation we expect to ramp this year. With 2304GB of HMB3E on each UBB, this has a lot of memory.