High Power Thermal Test Vehicle with 2-Phase Cooling for AI Datacenters, 5G RAN, and EDGE Compute Nodes

Yang Liu, Nagesh Basavanhally, Mark Earnshaw, Todd Salamon, Rick Papazian, Ting Chen Hu, Mark Cappuzzo, Rose Kopf, David Apigo, Bob Farah, Syed Faisal, Rishav Roy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we introduce the design and fabrication of a high-power thermal test vehicle (TTV) equipped with a two-phase cooling system, targeting improved thermal management in Multi-Chip Modules (MCMs) for AI datacenters, 5G RAN, and EDGE compute nodes. With the rise in device integration and component power densities, conventional cooling methods fall short, prompting the need for innovative approaches to achieve efficient heat dissipation. The TTV utilizes advanced heterogeneous integration techniques on a low-temperature co-fired ceramic (LTCC) substrate, designed to reliably dissipate over 1000 W of heat. This provides a robust platform for testing advanced two-phase cooling strategies to effectively remove heat from densely packed silicon dies, thus addressing the thermal challenges inherent in modern electronics.We elaborate on the fabrication of two variations of the TTV: the first comprising six X1 MCM modules, each measuring 25 mm × 38 mm, and the second a single X6 module measuring 76 mm × 76 mm, showcasing the robustness of the process. These TTVs are engineered to manage power dissipation of up to 1008 W, with logic chips experiencing background power densities of approximately 34 W/cm^2 and hotspots peaking at 400W/cm^2, while HBM stack chips exhibit a heat flux of 16 W/cm^2. The logic chips, measuring 20 mm x 20 mm, and the HBM stacks, measuring 10 mm x 10 mm, closely replicate the specifications of cutting-edge AI hardware.The importance of this work lies in its capacity to offer a scalable and dependable testing platform for advanced thermal management strategies in high-performance computing. By leveraging two-phase cooling, it paves the way toward more reliable and efficient computing infrastructures, effectively addressing the challenges posed by high power and heat flux in contemporary electronic devices.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE 74th Electronic Components and Technology Conference, ECTC 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1030-1035
Number of pages6
ISBN (Electronic)9798350375985
DOIs
StatePublished - 2024
Event74th IEEE Electronic Components and Technology Conference, ECTC 2024 - Denver, United States
Duration: May 28 2024May 31 2024

Publication series

NameProceedings - Electronic Components and Technology Conference
ISSN (Print)0569-5503

Conference

Conference74th IEEE Electronic Components and Technology Conference, ECTC 2024
Country/TerritoryUnited States
CityDenver
Period5/28/245/31/24

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Electrical and Electronic Engineering

Keywords

  • MCM
  • Multi-chip Module
  • OHP
  • TTV
  • Thermal Test Vehicle
  • two-phase cooling

Fingerprint

Dive into the research topics of 'High Power Thermal Test Vehicle with 2-Phase Cooling for AI Datacenters, 5G RAN, and EDGE Compute Nodes'. Together they form a unique fingerprint.

Cite this