ALL to LLM

Posted on by lechuck park

This image is an architecture diagram titled “ALL to LLM” that illustrates the digital transformation of industrial facilities and AI-based operational management systems.

Left Section (Industrial Equipment):

  • Cooling tower (cooling system)
  • Chiller (refrigeration/cooling equipment)
  • Power transformer (electrical power conversion equipment)
  • UPS (Uninterruptible Power Supply)

Central Processing:

  • Monitor with gears: Equipment data collection and preprocessing system
  • Dashboard interface: “All to Bit” analog-to-digital conversion interface
  • Bottom gears and human icon: Manual/automated operational system management

Right Section (AI-based Operations):

  • Purple area with binary code (0s and 1s): All facility data converted to digital bit data
  • Robot icons: LLM-based automated operational systems
  • Document/analysis icons: AI analysis results and operational reports

Overall, this diagram represents the transformation from traditional manual or semi-automated industrial facility operations to a fully digitized system where all operational data is converted to bit-level information and managed through LLM-powered intelligent facility management and predictive maintenance in an integrated operational system.

With Claude

Digital Op.

Posted on by lechuck park

Digital Operation Framework

Left Side – Fundamental Operating Characteristics:

  • Operation: Basic operational system
  • Stable: Stable operation
  • Efficient: Efficient operation
  • Trade-off exists between these two characteristics

Center – Digital Transformation:

  • “By Digital”: Core of change through digital technology
  • Win-Win: Achieving both stability and efficiency simultaneously through digitalization

Right Side – Implementation Directions (Updated Interpretation):

  1. Base Mission – Safe Operation
    • Predictive Operation
    • Automation
    • → Building a safe operational environment
  2. How-to Mission – Digitalization
    • Cost Down
    • → Specific implementation methods through digital technology
  3. Critical Mission – Operating/Energy Cost Reduction
    • Labor (workforce management)
    • Energy (energy management)
    • → Key areas for cost reduction

Core Message (Updated)

This framework demonstrates how digital technology can resolve the traditional trade-off between stability and efficiency. The approach is to establish safe operations as the foundation, utilize digitalization as the implementation method, and ultimately achieve reduction in both operating costs and energy costs.

The diagram shows a strategic pathway where digital transformation enables organizations to move beyond the traditional stability-efficiency dilemma toward a comprehensive cost optimization model.

3 Computing in AI

Posted on by lechuck park

AI Computing Architecture

3 Processing Types

1. Sequential Processing

  • Hardware: General CPU (Intel/ARM)
  • Function: Control flow, I/O, scheduling, Data preparation
  • Workload Share: Training 5%, Inference 5%

2. Parallel Stream Processing

  • Hardware: CUDA core (Stream process)
  • Function: FP32/FP16 Vector/Scalar, memory management
  • Workload Share: Training 10%, Inference 30%

3. Matrix Processing

  • Hardware: Tensor core (Matrix core)
  • Function: Mixed-precision (FP8/FP16) MMA, Sparse matrix operations
  • Workload Share: Training 85%+, Inference 65%+

Key Insight

The majority of AI workloads are concentrated in matrix processing because matrix multiplication is the core operation in deep learning. Tensor cores are the key component for AI performance improvement.

With Claude

‘IF THEN’ with AI

Posted on by lechuck park

This image is a diagram titled “IF-THEN with AI” that explains conditional logic and automation levels in AI systems.

Top Section: Basic IF-THEN Structure

  • IF (Condition): Conditional part shown in blue circle
  • THEN (Action): Execution part shown in purple circle
  • Marked as “Program Essential,” emphasizing it as a core programming element

Middle Section: Evolution of Conditional Complexity

AI is ultimately a program, and like humans who wanted to predict by sensing data, making judgments, and taking actions based on those criteria. IF-THEN is essentially prediction – the foundation of programming that involves recognizing situations, making judgments, and taking actions.

Evolution stages of data/formulas:

  • a = 1: Simple value
  • a, b, c … ?: Processing multiple complex values simultaneously
  • Z ≠ 1: A condition that finds the z value through code on the left and compares it to 1 (highlighted with red circle, with annotation “making ‘z’ by codes”)

Now we input massive amounts of data and analyze with AI, though it has somewhat probabilistic characteristics.

Bottom Section: Evolution of AI Decision-Making Levels

Starting from Big Data through AI networks, three development directions:

  1. Full AI Autonomy: Complete automation that evolved to “Fine, just let AI handle it”
  2. Human Validation: Stage where humans evaluate AI judgments and incorporate them into operations
  3. AI Decision Support: Approach where humans initially handle the THEN action

Key Perspective: While these three development directions exist, there’s a need for judgment regarding decisions based on the quality of data used in analysis/judgment. This diagram shows that it’s not just about automation levels, but that data quality-based reliability assessment is a crucial consideration.

Summary

This diagram illustrates the evolution from simple conditional programming to complex AI systems, emphasizing that AI fundamentally operates on IF-THEN logic for prediction and decision-making. The key insight is that regardless of automation level, the quality of input data remains critical for reliable AI decision-making processes.

With Claude

per Watt with AI

Posted on by lechuck park

This image titled “per Watt with AI” is a diagram explaining the paradigm shift in power efficiency following the AI era, particularly after the emergence of LLMs.

Overall Context

Core Structure of AI Development:

  • Machine Learning = Computing = Using Power
  • The equal signs (=) indicate that these three elements are essentially the same concept. In other words, AI machine learning inherently means large-scale computing, which inevitably involves power consumption.

Characteristics of LLMs: As AI, particularly LLMs, have proven their effectiveness, tremendous progress has been made. However, due to their technical characteristics, they have the following structure:

  • Huge Computing: Massively parallel processing of simple tasks
  • Huge Power: Enormous power consumption due to this parallel processing
  • Huge Cost: Power costs and infrastructure expenses

Importance of Power Efficiency Metrics

With hardware advancements making this approach practically effective, power consumption has become a critical issue affecting even the global ecosystem. Therefore, power is now used as a performance indicator for all operations.

Key Power Efficiency Metrics

Performance-related:

  • FLOPs/Watt: Floating-point operations per watt
  • Inferences/Watt: Number of inferences processed per watt
  • Training/Watt: Training performance per watt

Operations-related:

  • Workload/Watt: Workload processing capacity per watt
  • Data/Watt: Data processing capacity per watt
  • IT Work/Watt: IT work processing capacity per watt

Infrastructure-related:

  • Cooling/Watt: Cooling efficiency per watt
  • Water/Watt: Water usage efficiency per watt

This diagram illustrates that in the AI era, power efficiency has become the core criterion for all performance evaluations, transcending simple technical metrics to encompass environmental, economic, and social perspectives.

With Claude