Tag: cooling

GPU Server Room : Changes

Posted on by lechuck park

Image Overview

This dashboard displays the cascading resource changes that occur when GPU workload increases in an AI data center server room monitoring system.

Key Change Sequence (Estimated Values)

  1. GPU Load Increase: 30% → 90% (AI computation tasks initiated)
  2. Power Consumption Rise: 0.42kW → 1.26kW (3x increase)
  3. Temperature Delta Rise: 7°C → 17°C (increased heat generation)
  4. Cooling System Response:
    • Water flow rate: 200 LPM → 600 LPM (3x increase)
    • Fan speed: 600 RPM → 1200 RPM (2x increase)

Operational Prediction Implications

  • Operating Costs: Approximately 3x increase from baseline expected
  • Spare Capacity: 40% cooling system capacity remaining
  • Expansion Capability: Current setup can accommodate additional 67% GPU load

This AI data center monitoring dashboard illustrates the cascading resource changes when GPU workload increases from 30% to 90%, triggering proportional increases in power consumption (3x), cooling flow rate (3x), and fan speed (2x). The system demonstrates predictable operational scaling patterns, with current cooling capacity showing 40% remaining headroom for additional GPU load expansion. Note: All values are estimated figures for demonstration purposes.

Note: All numerical values are estimated figures for demonstration purposes and do not represent actual measured data.

With Claude

Data in AI DC

Posted on by lechuck park

This image illustrates a data monitoring system for an AI data center server room. Titled “Data in AI DC Server Room,” it depicts the relationships between key elements being monitored in the data center.

The system consists of four main components, each with detailed metrics:

  1. GPU Workload – Right center
    • Computing Load: GPU utilization rate (%) and type of computational tasks (training vs. inference)
    • Power Consumption: Real-time power consumption of each GPU (W) – Example: NVIDIA H100 GPU consumes up to 700W
    • Workload Pattern: Periodicity of workload (peak/off-peak times) and predictability
    • Memory Usage: GPU memory usage patterns (e.g., HBM3 memory bandwidth usage)
  2. Power Infrastructure – Left
    • Power Usage: Real-time power output and efficiency of UPS, PDU, and transformers
    • Power Quality: Voltage, frequency stability, and power loss rate
    • Power Capacity: Types and proportions of supplied energy, ensuring sufficient power availability for current workload operations
  3. Cooling System – Right
    • Cooling Device Status: Air-cooling fan speed (RPM), liquid cooling pump flow rate (LPM), and coolant temperature (°C)
    • Environmental Conditions: Data center internal temperature, humidity, air pressure, and hot/cold zone temperatures – critical for server operations
    • Cooling Efficiency: Power Usage Effectiveness (PUE) and proportion of power consumed by the cooling system
  4. Server/Rack – Top center
    • Rack Power Density: Power consumption per rack (kW) – Example: GPU server racks range from 30 to 120 kW
    • Temperature Profile: Temperature (°C) of GPUs, CPUs, memory modules, and heat distribution
    • Server Status: Operational state of servers (active/standby) and workload distribution status

The workflow sequence indicated at the bottom of the diagram represents:

  1. ① GPU WORK: Initial execution of AI workloads – GPU computational tasks begin, generating system load
  2. ② with POWER USE: Increased power supply for GPU operations – Power demand increases with GPU workload, and power infrastructure responds accordingly
  3. ③ COOLING WORK: Cooling processes activated in response to heat generation
    • Sensing: Temperature sensors detect server and rack thermal conditions, monitoring hot/cold zone temperature differentials
    • Analysis: Analysis of collected temperature data, determining cooling requirements
    • Action: Adjustment of cooling equipment (fan speed, coolant flow rate, etc. automatically regulated)
  4. ④ SERVER OK: Maintenance of normal server operation through proper power supply and cooling – Temperature and power remain stable, allowing GPU workloads to continue running under optimal conditions

The arrows indicate data flow and interrelationships between systems, showing connections from power infrastructure to servers and from cooling systems to servers. This integrated system enables efficient and stable data center operation by detecting increased power demand and heat generation from GPU workloads, and adjusting cooling systems in real-time accordingly.

With Claude

Key Factors in DC

Posted on by lechuck park

This image is a diagram showing the key components of a Data Center (DC).

The diagram visually represents the core elements that make up a data center:

  1. Building – Shown on the left with a building icon, representing the physical structure of the data center.
  2. Core infrastructure elements (in the central blue area):
    • Network – Data communication infrastructure
    • Computing – Servers and processing equipment
    • Power – Energy supply systems
    • Cooling – Temperature regulation systems
  3. The central orange circle represents server racks, which is connected to power supply units (transformers), cooling equipment, and network devices.
  4. Digital Service – Displayed on the right, representing the end services that all this infrastructure ultimately delivers.

This diagram illustrates how a data center flows from a physical building through core elements like network, computing, power, and cooling to ultimately provide digital services.

With Claude

Connected in AI DC

Posted on by lechuck park

This diagram titled “Data is Connected in AI DC” illustrates the relationships starting from workload scheduling in an AI data center.

Key aspects of the diagram:

  1. The entire system’s interconnected relationships begin with workload scheduling.
  2. The diagram divides the process into two major phases:
    • Deterministic phase: Primarily concerned with power requirements that operate in a predictable, planned manner.
    • Statistical phase: Focused on cooling requirements, where predictions vary based on external environmental conditions.
  3. The “Prophet Commander” at the workload scheduling stage can predict/direct future requirements, allowing the system to prepare power (1.1 Power Ready!!) and cooling (1.2 Cooling Ready!!) in advance.
  4. Process flow:
    • Job allocation from workload scheduling to GPU cluster
    • GPUs request and receive power
    • Temperature rises due to operations
    • Cooling system detects temperature and activates cooling

This diagram illustrates the interconnected workflow in AI data centers, beginning with workload scheduling that enables predictive resource management. The process flows from deterministic power requirements to statistical cooling needs, with the “Prophet Commander” enabling proactive preparation of power and cooling resources. This integrated approach demonstrates how workload prediction can drive efficient resource allocation throughout the entire AI data center ecosystem.

With Claude

Data Explosion in Data Center

Posted on by lechuck park

This image titled “Data Explosion in Data Center” illustrates three key challenges faced by modern data centers:

  1. Data/Computing:
    • Shows the explosive growth of data from computing servers to internet/cloud infrastructure and AI technologies.
    • Visualizes the exponential increase in data volume from 1X to 100X, 10,000X, and ultimately to 1,000,000,000X (one billion times).
    • Depicts how servers, computers, mobile devices, and global networks connect to massive data nodes, generating and processing enormous amounts of information.
  2. Power:
    • Addresses the increasing power supply requirements needed to support the data explosion in data centers.
    • Shows various energy sources including traditional power plants, wind turbines, solar panels, and battery storage systems to meet the growing energy demands.
    • Represents energy efficiency and sustainable power supply through a cyclical system indicated by green arrows.
  3. Cooling:
    • Illustrates the heat management challenges resulting from increased data processing and their solutions.
    • Explains the shift from traditional air cooling methods to more efficient server liquid cooling technologies.
    • Visualizes modern cooling solutions with blue circular arrows representing the cooling cycle.

This diagram comprehensively explains how the exponential growth of data impacts data center design and operations, particularly highlighting the challenges and innovations in power consumption and thermal management.

With Claude

Data Center NOW

Posted on by lechuck park

This image shows a data center architecture diagram titled “Data Center Now” at the top. It illustrates the key components and flow of a modern data center infrastructure.

The diagram depicts:

  1. On the left side: An “Explosion of data” icon with data storage symbols, pointing to computing components with the note “More Computing is required”
  2. In the center: Server racks connected to various systems with colored lines indicating different connections (red, blue, green)
  3. On the right side: Several technology components illustrated with circular icons and labels:
    • “Software Defined” with a computer/gear icon
    • “AI & GPU” with neural network and GPU icons and note “Big power is required”
    • “Renewable Energy & Grid Power” with solar panel and wind turbine icons
    • “Optimized Cooling /w Using Water” with cooling system icon
    • “Enhanced Op System & AI Agent” with a robotic/AI system icon

The diagram shows how data flows through processing units and connects to different infrastructure elements, emphasizing modern data center requirements like increased computing power, AI capabilities, power management, and cooling solutions.

With Claude

Power Usage of Cooling

Posted on by lechuck park

Data Center Cooling System Power Usage Analysis

This diagram illustrates the cooling system configuration of a data center and the power consumption proportions of each component.

Cooling Facility Stages:

  1. Cooling Tower: The first stage, generating Cooling Water through contact between outside air and water.
  2. Chiller: Receives cooling water and converts it to Chilled Water at a lower temperature through the compressor.
  3. CRAH (Computer Room Air Handler): Uses chilled water to produce Cooling Air for the server room.
  4. Server Rack Cooling: Finally, cooling air reaches the server racks and absorbs heat.

Several auxiliary devices operate in this process:

  • Pump: Regulates the pressure and speed of cooling water and chilled water.
  • Header: Efficiently distributes and collects water.
  • Heat Exchanger: Optimizes the heat transfer process.
  • Fan: Circulates cooling air.

Cooling Facility Power Usage Proportions:

  • Chiller/Compressor: The largest power consumer, accounting for 60-80% of total cooling power.
  • Pump: Consumes 10-15% of power.
  • Cooling Tower: Uses approximately 10% of power.
  • CRAH/Fan: Uses approximately 10% of power.
  • Other components: Account for the remaining 10%.

Purpose of Energy Usage (Efficiency):

  • As indicated in the blue box on the lower right, “Most of the power is to lower the temperature and transfer it.”
  • The system operates through Supply and Return loops to remove heat from the “Sources of heat.”
  • The note “100% Free Cooling = Chiller Not working” indicates that when using natural cooling methods, the most power-intensive component (the chiller) doesn’t need to operate, potentially resulting in significant energy efficiency improvements.

This data center cooling system diagram illustrates how cooling moves from Cooling Tower to Chiller to CRAH to server racks, with compressors consuming the majority (60-80%) of power usage, followed by pumps (10-15%) and other components (10% each). The system primarily functions to lower temperatures and transfer heat, with the important insight that 100% free cooling eliminates the need for chillers, potentially saving significant energy.

With Claude