Tag: data

One Point

Posted on by lechuck park

From Claude with some prompting
This image presents a concept diagram titled “One Point”. It illustrates the process from the smallest unit in the universe to human data collection.

Key elements include:

  1. “The Point”: Representing the smallest unit.
  2. “From the universe”:
    • Quantum: Symbolized by an atom icon
    • Energy: Depicted with a lightning bolt icon
  3. “Sensing”: Shown as a yellow arrow process
  4. “By Humans”:
    • “0 and 1”: Representing digital data
    • “Diff”: Likely indicating data processing
    • “Data”: The final output
  5. “gathering”: The process from 0 and 1 to Data

At the bottom, there’s an infinity symbol with the phrase “not much different (infinite by the view of micro & macro)”. This suggests little difference between microscopic and macroscopic perspectives.

Simple & Complex

Posted on by lechuck park

This image illustrates the evolution of problem-solving approaches, contrasting traditional methods with modern AI-based solutions:

‘Before’ stage:

  1. Starts with Simple data
  2. Proceeds through Research
  3. Find out Rules with formula
  4. Resolves Complex problems

This process represents the traditional approach where humans collect simple data, conduct research, and discover rules to solve complex problems.

‘Now with AI Infra’ stage:

  1. Begins with Simple data
  2. Accumulates too much Simple data
  3. Utilizes Computing for big data and Computing AI
  4. Solves Complex problems by too much simple

This new process showcases a modern approach based on AI infrastructure. It involves analyzing vast amounts of simple data using computational power to address more evolved forms of complexity.

The ‘Complex Evolution’ arrow indicates that the level of complexity we can handle is evolving due to this shift in approach.

In essence, the image conveys that while the past relied on limited data to discover simple rules for solving complexity, the present leverages AI and big data to analyze enormous amounts of simple data, enabling us to tackle more sophisticated and complex problems. This shift represents a significant evolution in our problem-solving capabilities, allowing us to address complexities that were previously beyond our reach.

Operation with AI

Posted on by lechuck park

From Claude with some prompting
This diagram illustrates an integrated approach to modern operational management. The system is divided into three main components: data generation, data processing, and AI application.

The Operation & Biz section shows two primary data sources. First, there’s metric data automatically generated by machines such as servers and network equipment. Second, there’s textual data created by human operators and customer service representatives, primarily through web portals.

These collected data streams then move to the central Data Processing stage. Here, metric data is processed through CPUs and converted into time series data, while textual data is structured via web business services.

Finally, in the AI play stage, different AI models are applied based on data types. For time series data, models like RNN, LSTM, and Auto Encoder are used for predictive analytics. Textual data is processed through a Large Language Model (LLM) to extract insights.

This integrated system effectively utilizes data from various sources to improve operational efficiency, support data-driven decision-making, and enable advanced analysis and prediction through AI. Ultimately, it facilitates easy and effective management even in complex operational environments.

The image emphasizes how different types of data – machine-generated metrics and human-generated text – are processed and analyzed using appropriate AI techniques, all from the perspective of operational management.

Why digitalization?

Posted on by lechuck park

From Claude with some prompting
The image depicts the effects of digitalization in three distinct stages:

Stage 1: Long-Term Accumulated Efficiency Gains Initially, efforts towards digitalization, such as standardization, automation, system and data-based work, may not yield visible results for a considerable amount of time. However, during this period, continuous improvement and optimization gradually lead to an accumulation of efficiency gains.

Stage 2: Eventual Leaps Once the efforts from Stage 1 reach a critical point, significant performance improvements and innovative breakthroughs occur, backed by the experience and learning acquired. The previously accumulated data and process improvement know-how enable these sudden leaps forward.

Stage 3: Extensive Huge Upturn with Big Data & AI Through digitalization, big data is built, and when combined with artificial intelligence technologies, unprecedented and massive levels of performance can be achieved. Data-driven predictions and automated decision-making enable disruptive value creation across a wide range of domains.

Therefore, while the initial stage of digital transformation may seem to yield minimal visible gains, persevering with continuous efforts will allow the accumulation of experience and data, eventually opening up opportunities for rapid innovation and large-scale growth. The key is to maintain patience and commitment, as the true potential of digitalization can be unlocked through the combination of data and advanced technologies like AI.

TSDB flow for alerts

Posted on by lechuck park

From Claude with some prompting
This image illustrates the flow and process of a Time Series Database (TSDB) system. The main components are:

Time Series Data: This is the input data stream containing time-stamped values from various sources or metrics.

Counting: It performs change detection on the incoming time series data to capture relevant events or anomalies.

Delta Value: The difference or change observed in the current value compared to a previous reference point, denoted as NOW() – previous value.

Time-series summary Value: Various summary statistics like MAX, MIN, and other aggregations are computed over the time window.

Threshold Checking: The delta values and other aggregations are evaluated against predefined thresholds for anomaly detection.

Alert: If any threshold conditions are violated, an alert is triggered to notify the monitoring system or personnel.

The process also considers correlations with other metrics for improved anomaly detection context. Additionally, AI-based techniques can derive new metrics from the existing data for enhanced monitoring capabilities.

In summary, this flow diagram represents the core functionality of a time series database focused on capturing, analyzing, and alerting on anomalies or deviations from expected patterns in real-time data streams.

Who First

Posted on by lechuck park

From ChatGPT with some prompting
This image explores two potential scenarios related to the advancement of AI (Artificial Intelligence). It raises two main questions:

  1. Exponential Use of Data and Energy: The left side illustrates a scenario where data and energy created by humans are used exponentially by AI. This leads to the concern that data and energy might be depleted. It questions whether we will run out of data and energy first due to this exponential use.
  2. AI’s Self-Sufficiency: The right side presents the possibility that AI might be able to create new data and energy on its own. If AI can generate its own data and energy resources, it could overcome the problem of depletion.

Therefore, the image highlights a dilemma: on one hand, the rapid use of data and energy by AI might lead to their depletion, while on the other hand, AI might potentially find ways to create new data and energy to sustain itself. It questions which of these scenarios will happen first.

Trend & Prediction

Posted on by lechuck park

From Claude with some prompting
The image presents a “Trend & Predictions” process, illustrating a data-driven prediction system. The key aspect is the transition from manual validation to automation.

  1. Data Collection & Storage: Digital data is gathered from various sources and stored in a database.
  2. Manual Selection & Validation: a. User manually selects which metric (data) to use b. User manually chooses which AI model to apply c. Analysis & Confirmation using selected data and model
  3. Transition to Automation:
    • Once optimal metrics and models are confirmed in the manual validation phase, the system learns and switches to automation mode. a. Automatically collects and processes data based on selected metrics b. Automatically applies validated models c. Applies pre-set thresholds to prediction results d. Automatically detects and alerts on significant predictive patterns or anomalies based on thresholds

The core of this process is combining user expertise with system efficiency. Initially, users directly select metrics and models, validating results to “educate” the system. This phase determines which data is meaningful and which models are accurate.

Once this “learning” stage is complete, the system transitions to automation mode. It now automatically collects, processes data, and generates predictions using user-validated metrics and models. Furthermore, it applies preset thresholds to automatically detect significant trend changes or anomalies.

This enables the system to continuously monitor trends, providing alerts to users whenever important changes are detected. This allows users to respond quickly, enhancing both the accuracy of predictions and the efficiency of the system.