+353-1-416-8900REST OF WORLD
+44-20-3973-8888REST OF WORLD
1-917-300-0470EAST COAST U.S
1-800-526-8630U.S. (TOLL FREE)

Development Trends of AI Servers: From Full System to Rack-Level Design

  • Report

  • 14 Pages
  • August 2024
  • Region: Global
  • Market Intelligence & Consulting Institute (MIC)
  • ID: 5993393

Since the beginning of 2024, the artificial intelligence (AI) server market has experienced a significant surge, with numerous manufacturers unveiling their latest AI server products at Computex 2024.

In addition to the servers themselves, major chipmakers like Nvidia, AMD, and Intel also showcased a wide array of rack-level and thermal management solutions, with the Nvidia DGX GB200 NVLink 72 standing out as a key product. This shift marks an important development for pure server manufacturers, who are now focusing not only on server production but also on advancing into the supply chain for rack-level solutions.

This report provides insights into the latest development trends in the AI server market, examining the new rollouts from leading GPU suppliers. It also explores the major product strategies of prominent AI server manufacturers such as Supermicro, Ingrasys, QCT, and Gigabyte, alongside traditional server manufacturers like Wiwynn, Inventec, and Tyan, as revealed through their product launches at Computex 2024.

Table of Contents

1. Promising AI Server Market with Diverse Product Offerings
1.1 AI Servers Featuring Nvidia HGX and MGX Architectures
1.1.1 Air-Cooled and Liquid-Cooled HGX Architecture Servers Launched Simultaneously, with Liquid Cooling Solutions Effectively Limiting Server Height
1.1.2 Nvidia MGX Offers Greater Flexibility in Server Design, Leading to Diverse AI Server Models
1.2 AMD and Intel Separately Collaborate with Manufacturers to Enter the AI Server Market

2. Server Makers Actively Collaborate with Nvidia for Rack-Level Solutions
2.1 Manufacturers Compete with Nvidia DGX GB200 NVLink 72 Racks within the Same Architecture
2.2 Manufacturers Seek Differentiation in Rack Design, Collaborating with Various Upstream and Liquid Cooling Vendors

3. Analyst Perspective
3.1 The AI Server Market Remains Hot, with a Significant Increase in Product Specs and the Number of Vendors
3.2 Air-Cooled and Liquid-Cooled Servers Target Different Customer Groups; Liquid Cooling Enhances AI Computing Density in a Single Rack
3.3 High Power Consumption of AI Servers Accelerates the Adoption of Liquid Cooling, Making Rack-Level Solutions a Norm
3.4 Nvidia Continues to Dominate the AI Server Market, with AMD and Intel Making Progress AI

AppendixList of Companies
List of Tables
Table 1: Comparison of DGX GB200 NVLink 72 Systems Displayed at Computex 2024

List of Figures
Figure 1: Nvidia HGX Architecture Air-Cooled Servers Displayed by Various Vendors at Computex 2024
Figure 2: Nvidia HGX Architecture Liquid-Cooled Servers Displayed by Various Vendors at Computex 2024
Figure 3: Nvidia MGX Architecture Servers Displayed by Various Manufacturers at Computex 2024
Figure 4: AMD AI Training Servers Displayed by Various Vendors at Computex 2024
Figure 5: Intel AI Training Servers Displayed by Various Vendors at Computex 2024
Figure 6: Nvidia DGX GB200 NVLink 72 Racks Displayed by Various Manufacturers at Computex 2024.
Figure 7: Product Specifications Inside the DGX GB200 NVLink 72 Rack

Companies Mentioned (Partial List)

A selection of companies mentioned in this report includes, but is not limited to:

  • Nvidia
  • AMD
  • Intel 
  • Supermicro
  • Ingrasys
  • QCT
  • Gigabyte
  • Wiwynn
  • Inventec
  • Tyan

Methodology

Primary research with a holistic, cross-domain approach

The exhaustive primary research methods are central to the value that the analyst delivers. A combination of questionnaires and on-site visits to the major manufacturers provides a first view of the latest data and trends. Information is subsequently validated by interviews with the manufacturers' suppliers and customers, covering a holistic industry value chain. This process is backed up by a cross-domain team-based approach, creating an interlaced network across numerous interrelated components and system-level devices to ensure statistical integrity and provide in-depth insight.

Complementing primary research is a running database and secondary research of industry and market information. Dedicated research into the macro-environmental trends shaping the ICT industry also allows the analyst to forecast future development trends and generate foresight perspectives. With more than 20 years of experience and endeavors in research, the methods and methodologies include:

Method

  • Component supplier interviews
  • System supplier interviews
  • User interviews
  • Channel interviews
  • IPO interviews
  • Focus groups
  • Consumer surveys
  • Production databases
  • Financial data
  • Custom databases

Methodology

  • Technology forecasting and assessment
  • Product assessment and selection
  • Product life cycles
  • Added value analysis
  • Market trends
  • Scenario analysis
  • Competitor analysis

Loading
LOADING...