Tag: data center

Multi-DCs Operation with a LLM (4)

Posted on by lechuck park

LLM-Based Multi-Datacenter Operation System

System Architecture

3-Stage Processing Pipeline: Collector → Integrator → Analyst

  • Event collection from various protocols
  • Data normalization through local integrators
  • Intelligent analysis via LLM/AI analyzers
  • RAG data expansion through bottom Data Add-On modules

Core Functions

1. Time-Based Event Aggregation Analysis

  • 60-second intervals (adjustable) for event bundling
  • Comprehensive situational analysis instead of individual alarms
  • LLM queries with predefined prompts

Effectiveness:

  • ✅ Resolves alarm fatigue and enables correlation analysis
  • ✅ Improves operational efficiency through periodic comprehensive reports
  • ⚠️ Potential delay in immediate response to critical issues ( -> Using a legacy/local monitoring system )

2. RAG-Based Data Enhancement

  • Extension data: Metrics, manuals, configurations, maintenance records
  • Reuse of past analysis results as learning data
  • Improved accuracy through domain-specific knowledge accumulation

Effectiveness:

  • ✅ Continuous improvement of analysis quality and increased automation
  • ✅ Systematization of operational knowledge and organizational capability enhancement

Innovative Value

  • Paradigm Shift: Reactive → Predictive/Contextual analysis
  • Operational Burden Reduction: Transform massive alarms into meaningful insights
  • Self-Evolution: Continuous learning system through RAG framework

Executive Summary: This system overcomes the limitations of traditional individual alarm approaches and represents an innovative solution that intelligentizes datacenter operations through time-based event aggregation and LLM analysis. As a self-evolving monitoring system that continuously learns and develops through RAG-based data enhancement, it is expected to dramatically improve operational efficiency and analysis accuracy.

With Claude

Switching of the power

Posted on by lechuck park

This diagram illustrates two main power switching methods used in electrical systems: ATS (Automatic Transfer Switch) and STS (Static Transfer Switch).

System Configuration

  • Power Sources: Utility grid and Generator
  • Protection: UPS systems
  • Load: Server infrastructure

ATS (Automatic Transfer Switch)

Location: Switchgear Area (Power Distribution Board)

Characteristics:

  • Mechanism: Mechanical breakers/contacts
  • Transfer Time: Several seconds (including generator start-up)
  • Advantages: Relatively simple, lower cost
  • Application: Standard power transfer systems

STS (Static Transfer Switch)

Location: Panelboard Area (Distribution Panel)

Characteristics:

  • Mechanism: Semiconductor devices (SCR, IGBT)
  • Transfer Time: A few milliseconds (near seamless)
  • Advantages: Ensures high-quality power supply
  • Disadvantages: Expensive

Key Differences

  1. Transfer Speed: STS is significantly faster (milliseconds vs seconds)
  2. Technology: ATS uses mechanical switching, STS uses electronic switching
  3. Cost: ATS is more economical
  4. Power Quality: STS provides more stable power delivery
  5. Complexity: STS requires more sophisticated semiconductor control

Applications

  • ATS: Suitable for applications that can tolerate brief power interruptions
  • STS: Critical for sensitive equipment like servers, data centers, and medical facilities requiring uninterrupted power

Summary: This diagram shows a redundant power system where ATS provides cost-effective backup power switching while STS offers near-instantaneous transfer for critical loads. Both systems work together with UPS backup to ensure continuous power supply to servers and sensitive equipment.

With Claude

Multi-DCs Operation with a LLM(3)

Posted on by lechuck park

This diagram presents the 3 Core Expansion Strategies for Event Message-based LLM Data Center Operations System.

System Architecture Overview

Basic Structure:

  • Collects event messages from various event protocols (Log, Syslog, Trap, etc.)
  • 3-stage processing pipeline: Collector → Integrator → Analyst
  • Final stage performs intelligent analysis using LLM and AI

3 Core Expansion Strategies

1️⃣ Data Expansion (Data Add On)

Integration of additional data sources beyond Event Messages:

  • Metrics: Performance indicators and metric data
  • Manuals: Operational manuals and documentation
  • Configures: System settings and configuration information
  • Maintenance: Maintenance history and procedural data

2️⃣ System Extension

Infrastructure scalability and flexibility enhancement:

  • Scale Up/Out: Vertical/horizontal scaling for increased processing capacity
  • To Cloud: Cloud environment expansion and hybrid operations

3️⃣ LLM Model Enhancement (More Better Model)

Evolution toward DC Operations Specialized LLM:

  • Prompt Up: Data center operations-specialized prompt engineering
  • Nice & Self LLM Model: In-house development of DC operations specialized LLM model construction and tuning

Strategic Significance

These 3 expansion strategies present a roadmap for evolving from a simple event log analysis system to an Intelligent Autonomous Operations Data Center. Particularly, through the development of in-house DC operations specialized LLM, the goal is to build an AI system that achieves domain expert-level capabilities specifically tailored for data center operations, rather than relying on generic AI tools.

With Claude

Multi-DCs Operation with a LLM (2)

Posted on by lechuck park

This diagram illustrates a Multi-Data Center Operation with LLM architecture system configuration.

Overall Architecture Components

Left Side – Event Sources:

  • Various systems supporting different event protocols (Log, Syslog, Trap, etc.) generating events

Middle – 3-Stage Processing Pipeline:

  1. Collector – Light Blue
    • Composed of Local Integrator and Integration Deliver
    • Collects and performs initial processing of all event messages
  2. Integrator – Dark Blue
    • Stores/manages event messages in databases and log files
    • Handles data integration and normalization
  3. Analyst – Purple
    • Utilizes LLM and AI for event analysis
    • Generates event/periodic or immediate analysis messages

Core Efficiency of LLM Operations Integration (Bottom 4 Features)

  • Already Installed: Leverages pre-analyzed logical results from existing alert/event systems, enabling immediate deployment without additional infrastructure
  • Highly Reliable: Alert messages are highly deterministic data that significantly reduce LLM error possibilities and ensure stable analysis results
  • Easy Integration: Uses pre-structured alert messages, allowing simple integration with various systems without complex data preprocessing
  • Nice LLM: Operates reliably based on verified alert data and provides an optimal strategy for rapidly applying advanced LLM technology

Summary

This architecture enables rapid deployment of advanced LLM technology by leveraging existing alert infrastructure as high-quality, deterministic input data. The approach minimizes AI-related risks while maximizing operational intelligence, offering immediate deployment with proven reliability.

With Claude

Power Circuit Breaker

Posted on by lechuck park

This image presents a Power Circuit Breaker classification diagram showing the types and characteristics of electrical circuit breakers used in power systems.

System Overview

Power Flow: The diagram illustrates the electrical power path from power plant → transmission lines → circuit breakers → distribution panels.

Circuit Breaker Classification

The breakers are categorized by voltage levels and arc extinguishing methods:

Voltage Classifications

  • Very High Voltage: 66~800kV
  • High Voltage: 3.3~38kV
  • Using Voltage: 380~690V, 110~600V, 110~440V

Breaker Types and Arc Extinguishing Methods

  1. GIS/GCB (Gas Insulated Switchgear/Gas Circuit Breaker)
    • 66~800kV
    • Uses SF6 gas with high vacuum technology
  2. VCB (Vacuum Circuit Breaker)
    • 3.3~38kV
    • Vacuum arc extinguishing method
  3. ACB (Air Circuit Breaker)
    • 380~690V
    • Air + arc chute method
  4. MCCB (Molded Case Circuit Breaker)
    • 110~600V
    • Air + arc chute method
  5. ELCB (Earth Leakage Circuit Breaker)
    • 110~440V
    • Ground fault protection, no arc extinguishing

Key Safety Message

The diagram emphasizes “The bigger (Arc) the more dangerous” – highlighting that higher voltages require more sophisticated and safer arc extinguishing technologies.

Summary: This technical diagram systematically categorizes power circuit breakers from ultra-high voltage (800kV) to low voltage (110V) applications, demonstrating how arc extinguishing complexity increases with voltage levels. The chart serves as an educational reference showing that higher voltage systems require more advanced safety mechanisms like SF6 gas insulation, while lower voltage applications can use simpler air-based arc interruption methods.

With Claude

Multi-DCs Operation with a LLM (1)

Posted on by lechuck park

This diagram illustrates a Multi-Data Center Operations Architecture leveraging LLM (Large Language Model) with Event Messages.

Key Components

1. Data Collection Layer (Left Side)

  • Collects data from various sources through multiple event protocols (Log, Syslog, Trap, etc.)
  • Gathers event data from diverse servers and network equipment

2. Event Message Processing (Center)

  • Collector: Comprises Local Integrator and Integration Deliver to process event messages
  • Integrator: Manages and consolidates event messages in a multi-database environment
  • Analyst: Utilizes AI/LLM to analyze collected event messages

3. Multi-Location Support

  • Other Location #1 and #2 maintain identical structures for event data collection and processing
  • All location data is consolidated for centralized analysis

4. AI-Powered Analysis (Right Side)

  • LLM: Intelligently analyzes all collected event messages
  • Event/Periodic or Prompted Analysis Messages: Generates automated alerts and reports based on analysis results

System Characteristics

This architecture represents a modern IT operations management solution that monitors and manages multi-data center environments using event messages. The system leverages LLM technology to intelligently analyze large volumes of log and event data, providing operational insights for enhanced data center management.

The key advantage is the unified approach to handling diverse event streams across multiple locations while utilizing AI capabilities for intelligent pattern recognition and automated response generation.

With Claude

Data Center ?

Posted on by lechuck park

This infographic compares the evolution from servers to data centers, showing the progression of IT infrastructure complexity and operational requirements.

Left – Server

  • Shows individual hardware components: CPU, motherboard, power supply, cooling fans
  • Labeled “No Human Operation,” indicating basic automated functionality

Center – Modular DC

  • Represented by red cubes showing modular architecture
  • Emphasizes “More Bigger” scale and “modular” design
  • Represents an intermediate stage between single servers and full data centers

Right – Data Center

  • Displays multiple server racks and various infrastructure components (networking, power, cooling systems)
  • Marked as “Human & System Operation,” suggesting more complex management requirements

Additional Perspective on Automation Evolution:

While the image shows data centers requiring human intervention, the actual industry trend points toward increasing automation:

  1. Advanced Automation: Large-scale data centers increasingly use AI-driven management systems, automated cooling controls, and predictive maintenance to minimize human intervention.
  2. Lights-Out Operations Goal: Hyperscale data centers from companies like Google, Amazon, and Microsoft ultimately aim for complete automated operations with minimal human presence.
  3. Paradoxical Development: As scale increases, complexity initially requires more human involvement, but advanced automation eventually enables a return toward unmanned operations.

Summary: This diagram illustrates the current transition from simple automated servers to complex data centers requiring human oversight, but the ultimate industry goal is achieving fully automated “lights-out” data center operations. The evolution shows increasing complexity followed by sophisticated automation that eventually reduces the need for human intervention.

With Claude