Author: lechuck park

AI Infrastructure Architect & Technical Visualizer "Complex Systems, Simplified. I translate massive AI infrastructure into visual intelligence." I love to learn computer tech and help people by the digital.

Together is not easy

Posted on by lechuck park

This infographic titled “Together” emphasizes the critical importance of parallel processing = working together across all domains – computing, AI, and human society.

Core Concept:

The Common Thread Across All 5 Domains – ‘Parallel Processing’:

  1. Parallel Processing – Simultaneous task execution in computer systems
  2. Deep Learning – AI’s multi-layered neural networks learning in parallel
  3. Multi Processing – Collaborative work across multiple processors
  4. Co-work – Human collaboration and teamwork
  5. Social – Collective cooperation among community members

Essential Elements of Parallel Processing:

  • Sync (Synchronization) – Coordinating all components to work harmoniously
  • Share (Sharing) – Efficient distribution of resources and information
  • Optimize (Optimization) – Maximizing performance while minimizing energy consumption
  • Energy (Energy) – The inevitable cost required when working together

Reinterpreted Message: “togetherness is always difficult, but it’s something we have to do.”

This isn’t merely about the challenges of cooperation. Rather, it conveys that parallel processing (working together) in all systems requires high energy costs, but only through optimization via synchronization and sharing can we achieve true efficiency and performance.

Whether in computing systems, AI, or human society – all complex systems cannot advance without parallel cooperation among individual components. This is an unavoidable and essential process for any sophisticated system to function and evolve. The insight reveals a fundamental truth: the energy investment in “togetherness” is not just worthwhile, but absolutely necessary for progress.

With Claude

CPU with GPU (legacy)

Posted on by lechuck park

This image is a diagram explaining the data transfer process between CPU and GPU. Let me interpret the main components and processes.

Key Components

Hardware:

  • CPU: Main processor
  • GPU: Graphics processing unit (acting as accelerator)
  • DRAM: Main memory on CPU side
  • VRAM: Dedicated memory on GPU side
  • PCIe: High-speed interface connecting CPU and GPU

Software/Interfaces:

  • Software (Driver/Kernel): Driver/kernel controlling hardware
  • DMA (Direct Memory Access): Direct memory access

Data Transfer Process (4 Steps)

Step 1 – Data Preparation

  • CPU first writes data to main memory (DRAM)

Step 2 – DMA Transfer

  • Copy data from main memory to GPU’s VRAM via PCIe
  • ⚠️ Wait Time: Cache Flush – CPU cache is flushed before accelerator can access the data

Step 3 – Task Execution

  • GPU performs tasks using the copied data

Step 4 – Result Copy

  • After task completion, GPU copies results back to main memory
  • ⚠️ Wait Time: Synchronization – CPU must perform another synchronization operation before it can read the results

Performance Considerations

This diagram shows the major bottlenecks in CPU-GPU data transfer:

  • Memory copy overhead: Data must be copied twice (CPU→GPU, GPU→CPU)
  • Synchronization wait times: Synchronization required at each step
  • PCIe bandwidth limitations: Physical constraints on data transfer speed

CXL-based Improvement Approach

CXL (Compute Express Link) shown on the right side of the diagram represents next-generation technology for improving this data transfer process, offering an alternative approach to solve the complex 4-step process and related performance bottlenecks.

Summary

This diagram demonstrates how CPU-GPU data transfer involves a complex 4-step process with performance bottlenecks caused by memory copying overhead, synchronization wait times, and PCIe bandwidth limitations. CXL is presented as a next-generation technology solution that can overcome the limitations of traditional data transfer methods.

With Claude

Human Extends

Posted on by lechuck park

This image is a conceptual diagram titled “Human Extend” that illustrates the cognitive extension of human capabilities and the role of AI tools.

Core Concept

“Human See” at the center represents the core of human observation and understanding abilities.

Bidirectional Extension Structure

Left: Macro Perspective

  • Represented by an orange circle
  • “A deeper understanding of the micro leads to better macro predictions”

Right: Micro Perspective

  • Represented by a blue circle
  • “A deeper understanding of the macro leads to better micro predictions”

Role of AI and Data

The upper portion shows two supporting tools:

  1. AI (by Tool): Represented by an atomic structure-like icon
  2. Data (by Data): Represented by network and database icons

Overall Meaning

This diagram visually represents the concept that human cognitive abilities can be extended through AI tools and data analysis, enabling deeper mutual understanding between microscopic details and macroscopic patterns. It illustrates the complementary relationship where understanding small details leads to better prediction of the big picture, and understanding the big picture leads to more accurate prediction of details.

The diagram suggests that AI and data serve as amplifying tools that enhance human perception, allowing for more sophisticated analysis across different scales of observation and prediction.

with Claude

LMM Operation

Posted on by lechuck park

LLM Operations System Analysis

This diagram illustrates the architecture of an LLM Operations (LLMOps) system, demonstrating how Large Language Models are deployed and operated in industrial settings.

Key Components and Data Flow

1. Data Input Sources (3 Categories)

  • Facility: Digitized sensor data that gets detected and generates alert/event logs
  • Manual: Equipment manuals and technical documentation
  • Experience: Operational manuals including SOP/MOP/EOP (Standard/Maintenance/Emergency Operating Procedures)

2. Central Processing System

  • RAG (Retrieval-Augmented Generation): A central hub that integrates and processes all incoming data
  • Facility data is visualized through metrics and charts for monitoring purposes

3. LLM Operations

  • The central LLM synthesizes all information to provide intelligent operational support
  • Interactive interface enables user communication and queries

4. Final Output and Control

  • Dashboard for data visualization and monitoring
  • AI chatbot for real-time operational assistance
  • Operator Control: The bottom section shows checkmark (✓) and X-mark (✗) buttons along with an operator icon, indicating that final decision-making authority remains with human operators

System Characteristics

This system represents a smart factory solution that integrates AI into traditional industrial operations, providing comprehensive management from real-time data monitoring to operational manual utilization.

The key principle is that while AI provides comprehensive analysis and recommendations, the final operational decisions and approvals still rest with human operators. This is clearly represented through the operator icon and approval/rejection buttons at the bottom of the diagram.

This demonstrates a realistic and desirable AI operational model that emphasizes safety, accountability, and the importance of human judgment in unpredictable situations.

With Claude

3 Key on the AI era

Posted on by lechuck park

This diagram illustrates the 3 Core Technological Components of AI World and their surrounding challenges.

AI World’s 3 Core Technological Components

Central AI World Components:

  1. AI infra (AI Infrastructure) – The foundational technology that powers AI systems
  2. AI Model – Core algorithms and model technologies represented by neural networks
  3. AI Agent – Intelligent systems that perform actual tasks and operations

Surrounding 3 Key Challenges

1. Data – Left Area

Data management as the raw material for AI technology:

  • Data: Raw data collection
  • Verified: Validated and quality-controlled data
  • Easy to AI: Data preprocessed and optimized for AI processing

2. Optimization – Bottom Area

Performance enhancement of AI technology:

  • Optimization: System optimization
  • Fit to data: Data fitting and adaptation
  • Energy cost: Efficiency and resource management

3. Verification – Right Area

Ensuring reliability and trustworthiness of AI technology:

  • Verification: Technology validation process
  • Right?: Accuracy assessment
  • Humanism: Alignment with human-centered values

This diagram demonstrates how the three core technological elements – AI Infrastructure, AI Model, and AI Agent – form the center of AI World, while interacting with the three fundamental challenges of Data, Optimization, and Verification to create a comprehensive AI ecosystem.

With Claude