Tag: data center

AI DC COST

Posted on by lechuck park

This infographic, titled “THE SHIFT IN DATA CENTER COST STRUCTURE,” compares the financial and operational profiles of Legacy Data Centers on the left with next-generation AI Data Centers on the right, showcasing the transition from traditional real estate environments to high-density, compute-heavy systems.

Detailed Visualization Analysis

1. Legacy Data Center (5–15kW/Rack) — Left Column

The legacy profile illustrates a traditional, real-estate-anchored model characterized by moderate energy needs and lower rack densities.

  • CAPEX (including IT Assets): The capital investment is heavily tied up in infrastructure. Building & Space accounts for 30%. MEP (Power & Cooling) is the largest chunk at 50%, shown via industrial air conditioning units and basic transformer equipment. IT & Network is relatively modest at 20%.
  • OPEX (excluding Asset Depreciation): Operating expenses are fairly balanced under a standard efficiency level of PUE 1.5–1.6. Power represents 40%, accompanied by stable and evenly distributed requirements for Maintenance (30%) and Labor & Ops (30%). This reflects a steady, predictable environment where space and housing are the primary considerations.

2. AI Data Center (40–130+ kW/Rack) — Right Column

The AI-optimized profile illustrates an incredibly dense, capital-intensive model dominated by advanced compute power and thermal risk.

  • CAPEX (including IT Assets): The footprint for Building shrinks drastically to 15%, but the core spend flips. GPU & Advanced IT takes over a massive 60% of the CAPEX, highlighted with a “MASSIVE ACQUISITION COST” indicator. Beneath it, a red highlight highlights a 3–5 Years (Rapid Depreciation) GPU replacement cycle, a highly demanding capital reinvestment burden. To support this, High-Density MEP & Liquid Cooling rises to 25%, depicted by complex piping, liquid cooling loops, and sub-stations.
  • OPEX (excluding Asset Depreciation): Operational costs are driven by extremely high rack density, despite a highly efficient PUE 1.1–1.3. Power now dominates the operating budget at 75%, labeled as a “HEAVY GPU BURDEN”. Because of the lower footprint, Maintenance drops to 15% and Labor & Ops to 10%.
  • Red Highlights (The Risks): The right side introduces crucial risk metrics. The orange and red “OPEX RISK: GPU DAMAGE & DOWNTIME” highlight identifies Hidden OPEX arising from thermal and power stress. Under this, it lists a real-world case study: “Meta Llama 3 training experienced 400+ interruptions in 54 days due to hardware stress,” highlighting that keeping expensive processors active and cool is the paramount operational challenge.

3. Paradigm Shift (Bottom Footer)

The bottom horizontal arrow highlights the core evolutionary theme: the industry has shifted away From “Space & Shell” (providing room and basic utility services) To “Compute, Power & Uptime” (managing dense, high-heat compute assets and assuring continuous, zero-failure operations).

Summary

The image demonstrates that AI Data Centers have fundamentally shifted from a physical real-estate play to an extreme compute-and-power equation. CAPEX is heavily front-loaded into high-cost GPU systems that deprecate rapidly (3–5 years), backed by specialized liquid cooling. Meanwhile, OPEX is overwhelmingly consumed by electricity (75%) and the acute, invisible threat of downtime. In this new landscape, maintaining continuous “Uptime” and mitigating thermal/power stress is no longer just a facility maintenance checklist—it is the ultimate driver of ROI.

#AIDataCenter #DataCenterEconomics #CAPEXvsOPEX #GPUInfrastructure #LiquidCooling #PUEEfficiency #ComputePowerUptime #TCOOptimization #DataCenterRisk

Telemetry Data Collaboration

Posted on by lechuck park

1. Infographic Overview & Top Architecture

  • Headline: “Data Center Landlord – Tenant Collaboration: 5 Reasons Real-Time Telemetry Data Collaboration is Essential”
  • System Flow Diagram:
    • Illustrates a high-level data pipeline where the Data Center Building (Landlord OT) and the Server Racks / Users (Tenant IT) are seamlessly connected through a bidirectional DATA STREAM, symbolizing the critical bridge between OT infrastructure and enterprise IT systems.

2. Breakdown of the 5 Core Collaboration Areas

01. Real-Time Incident Response & Coordinated Load Shedding

  • Visual Icon: Warning sign and high-voltage transmission tower
  • Key Concept: Real-time alert sharing during thermal or power abnormalities enables mutual load shedding, safeguarding the facility from full-scale building blackouts and critical downtime.

02. Power Efficiency (PUE/WUE) Optimization & Workload Profiling

  • Visual Icon: Energy bolt and an ascending performance bar chart
  • Key Concept: Environmental telemetry empowers tenants to pinpoint power-wasting hotspots and dynamically rebalance compute workloads, maximizing performance per watt and lowering utility costs.

03. Regulatory Compliance & Environmental/Emissions Reporting

  • Visual Icon: Globe, legal gavel, and compliance documentation
  • Key Concept: Addressing worldwide ESG and sustainability mandates by synchronizing reporting metrics, including PUE, WUE, backup generator runtimes, fuel consumption, and greenhouse gas emissions.

04. Crossing Trust Boundaries & Zero Trust Data Exchange

  • Visual Icon: Secure lock, network telemetry nodes, and firewall barrier
  • Key Concept: Mitigates lateral traversal and network vulnerability risks across OT/IT trust boundaries using unidirectional data diodes, DMZ message brokers (e.g., Kafka), and mTLS-encrypted API gateways.

05. Landlord-Tenant Standard API Integration (Appendix A)

  • Visual Icon: API gear, bidirectional synchronization arrows, and service clipboard
  • Key Concept: Formalizes standard APIs to automate operational service requests, case notes, documentation exchanges, and physical access badge provisioning with an audit-ready workflow.

3. Bottom Slogan

  • “Essential Data Connectivity for Sustainable and Secure Data Center Growth”
    • Underscores that bridging the information gap between facility operators and tenants is a prerequisite for resilient and energy-conscious infrastructure scalability.

4. Summary

This infographic systematically visualizes why modern data centers require real-time telemetry sharing across the facility operator (OT) and enterprise tenant (IT) boundary. By deploying Zero Trust secure architectures, facilities can execute coordinated emergency load shedding, optimize energy efficiency (PUE/WUE), comply with environmental regulations, and standardize day-to-day operational API integrations.

#DataCenter #Telemetry #LandlordTenant #LoadShedding #PUE #WUE #ZeroTrust #OTSecurity #InfrastructureManagement #AIOps #Sustainability

With Gemini

Is the data accurate?

Posted on by lechuck park

Looking at how my career started…
From a young age, computer programming has been something I have enjoyed with great interest.
What we do is use logic that works precisely based on data.
Making it… Especially at the system kernel level, details like how to operate for optimization… So I wasn’t very interested in data coming in from outside, nor was I used to doubting the data itself.

But… Data center? Upon entering the world… A little later, about DCIM… What is the newest thing you learned while getting to know it… How difficult it is to make the data itself accurate and stable at the desired level. “Preparing accurate data (numbers).”

Moreover. Now, at AI DC… From the perspective of expanding automation to respond to larger, high-density, and high-volatility…
“Is that data (number) accurate?”
“Is the explanation of that data (number) accurate?”
is the most important thing above all. This is the beginning of everything.

There’s something I often say.

In the past, in “1+1=0,” we used to do +,= (calculation)… I never knew it would be so difficult for this guy to get even one ‘1’ so accurate.”

As expected, the more you know, the harder the world becomes.
Sometimes I just want to do programming I liked—or maybe maybe I want to create something on my own…. That’s just a temporary thought… What I liked was about making things, and I know very well that we have to work together for that. Now, 🙂

DC Power(R)

Posted on by lechuck park

Data Center DC Power System Comprehensive Overview

This diagram illustrates the complete DC (Direct Current) power supply system for a data center infrastructure.

1. Core Components

① Power Source

  • 15.4 KV High Voltage AC Power
  • Received from utility grid
  • Efficient long-distance transmission (Efficient Delivery)
  • High voltage warning indicator (High Warning)

② Primary Transformer

  • Voltage conversion: 15.4 KV → 6.6 KV
  • Function: Steps down high voltage to medium voltage
  • Transformation method: Voltage Step-down
  • Adjusts voltage for internal data center distribution

③ Backup Power #1 – Generator System (Long-Time Backup)

  • Configuration: Diesel generator + Fuel tank
  • Characteristic: Long-duration backup capability
  • Purpose: Continuous power supply during main power outage
  • Advantage: Unlimited operation as long as fuel is supplied

④ Secondary Transformer

  • Voltage conversion: 6.6 KV → 380 V
  • Function: Steps down medium voltage to low voltage
  • Transformation method: Voltage Step-down
  • Provides appropriate voltage for UPS and final loads

⑤ Backup Power #2 – UPS System (Short-Time Backup)

  • Configuration: UPS + Battery
  • Characteristic: Short-duration instantaneous backup
  • Purpose: Ensures uninterrupted power during main-to-generator transition
  • Role: Supplies power during generator startup time (10-30 seconds)

⑥ Final Load (Power Use)

  • Output voltage: 220 V AC or 48 V DC
  • Target: Servers, network equipment, storage systems
  • Feature: Stable IT infrastructure operation with DC power

2. Voltage Conversion Flow

15.4 KV (AC)  →  6.6 KV (AC)  →  380 V (AC)  →  48 V (DC) / 220 V
  [Reception]   [Primary TX]   [Secondary TX]   [Final Conversion]

3. Redundant Backup Architecture

Two-Tier Backup System

Main Power (15.4 KV) ─────┐
                          ├──→ Transform ──→ Load
Generator (Long-term) ────┘
         ↓
    UPS/Battery (Short-term) ──→ Instantaneous uninterrupted guarantee

Backup Strategy:

  • Generator: Hours to days operation (fuel-dependent)
  • UPS: Minutes to tens of minutes operation (battery capacity-dependent)
  • Combined effect: UPS covers generator startup gap to achieve complete uninterrupted power

4. Operating Scenarios

Scenario 1: Normal Operation

Utility power (15.4KV) → Primary transform (6.6KV) → Secondary transform (380V) → UPS → DC load (48V)

Scenario 2: Momentary Power Outage

  1. Main power interruption detected (< 4ms)
  2. UPS battery immediately engaged
  3. Continuous power supply to load with zero interruption

Scenario 3: Extended Power Outage

  1. Main power interruption detected
  2. UPS battery immediately engaged (maintains uninterrupted power)
  3. Generator automatically starts (10-30 seconds required)
  4. Generator reaches rated capacity and replaces main power
  5. Generator power charges UPS + supplies load
  6. Long-term operation with continuous fuel supply

Scenario 4: Generator Failure

  • Limited-time operation within UPS battery capacity
  • Priority operation for critical systems or graceful shutdown

5. Additional Protection and Control Devices

Supplementary devices for system stability and safety:

Circuit Breaker Hierarchy

  • GCB (Generator Circuit Breaker): Primary protection at reception point
  • VCB (Vacuum Circuit Breaker): Vacuum interruption, medium voltage protection
  • ACB (Air Circuit Breaker): Low voltage distribution panel protection
  • MCCB (Molded Case Circuit Breaker): Individual load protection
  • Role: Circuit interruption during overload or short circuit to protect equipment and personnel

Switching Devices

  • STS (Static Transfer Switch): High-speed transfer between main power ↔ generator
  • ATS (Automatic Transfer Switch): Automatic transfer between power sources ( UPS level)
  • ALTS (Automatic Load Transfer Switch): Automatic load transfer ( for 22.9kV class)
  • CCTS: Circuit breaker control and transfer system
  • Role: Automatic/immediate transfer to backup power during power failure

Switching Points (Red circle indicators)

  • Reception point, before/after transformers, backup power injection points
  • Critical points for power path changes and redundancy implementation

6. Key System Features

✅ Uninterruptible Power Supply: Three-stage protection with main power → generator → UPS
✅ Multi-stage Voltage Conversion: Ensures both transmission efficiency and usage safety
✅ Automated Backup Transfer: Automatic switching without human intervention
✅ Hierarchical Protection: Stage-by-stage circuit breakers prevent cascading failures
✅ Scalable Architecture: Modular configuration enables easy capacity expansion

Summary

This DC power system architecture ensures continuous, uninterrupted operation of mission-critical data center infrastructure through a sophisticated combination of redundant power sources, automated failover mechanisms, and multi-layered protection systems. The integration of long-term generator backup and short-term UPS battery systems creates a seamless power continuity solution that can handle any grid interruption scenario. The multi-stage voltage transformation (15.4KV → 6.6KV → 380V → 48V DC) optimizes both transmission efficiency and end-user safety while providing flexibility for diverse IT equipment requirements.

#DataCenter #DCPower #PowerSystems #CriticalInfrastructure #UPS #BackupPower #DataCenterDesign #ElectricalEngineering #PowerDistribution #MissionCritical #DataCenterInfrastructure #FacilityManagement #PowerReliability #UninterruptiblePowerSupply #DataCenterOperations

With Claude

CDU ( OCP Project Deschutes ) Numbers

Posted on by lechuck park

OCP CDU (Deschutes) Standard Overview

The provided visual summarizes the key performance metrics of the CDU (Cooling Distribution Unit) that adheres to the OCP (Open Compute Project) ‘Project Deschutes’ specification. This CDU is designed for high-performance computing environments, particularly for massive-scale liquid cooling of AI/ML workloads.

Key Performance Indicators

  • System Availability: The primary target for system availability is 99.999%. This represents an extremely high level of reliability, with less than 5 minutes and 15 seconds of downtime per year.
  • Thermal Load Capacity: The CDU is designed to handle a thermal load of up to 2,000 kW, which is among the highest thermal capacities in the industry.
  • Power Usage: The CDU itself consumes 74 kW of power.
  • IT Flow Rate: It supplies coolant to the servers at a rate of 500 GPM (approximately 1,900 LPM).
  • Operating Pressure: The overall system operating pressure is within a range of 0-130 psig (approximately 0-900 kPa).
  • IT Differential Pressure: The pressure difference required on the server side is 80-90 psi (approximately 550-620 kPa).
  • Approach Temperature: The approach temperature, a key indicator of heat exchange efficiency, is targeted at ≤3∘C. A lower value is better, as it signifies more efficient heat removal.

Why Cooling is Crucial for GPU Performance

Cooling has a direct and significant impact on GPU performance and stability. Because GPUs are highly sensitive to heat, if they are not maintained within an optimal temperature range, they will automatically reduce their performance through a process called thermal throttling to prevent damage.

The ‘Project Deschutes’ CDU is engineered to prevent this by handling a massive thermal load of 2,000 kW with a powerful 500 GPM flow rate and a low approach temperature of ≤3∘C. This robust cooling capability ensures that GPUs can operate at their maximum potential without being limited by heat, which is essential for maximizing performance in demanding AI workloads.

with Gemini