Prediction & Detection

Posted on by lechuck park

From Claude with some prompting
This image illustrates a Prediction and Detection system for time series data. Let me break down the key components:

  1. Left Large Box (Learning and Prediction Section):
  • Blue line: Actual Temperature data
  • Red dotted line: Predicted Temperature data
  • Uses time series prediction models like LSTM, ARIMA, and Prophet for learning
  1. Top Right (Threshold-based Anomaly Detection):
  • “Abnormal Detection with Threshold”
  • Detects abnormal temperature changes based on threshold values
  • The area marked with a red circle shows where values exceed the threshold
  • Includes “Warning” and “Critical” threshold levels
  1. Bottom Right (Pattern-based Anomaly Detection):
  • “Anomaly Detection with Predict-Pattern”
  • Compares predicted patterns with actual data to detect anomalies
  • The area marked with a green circle shows where actual data deviates from the predicted pattern

The system detects anomalies in two ways:

  1. When values exceed predetermined thresholds
  2. When actual data significantly deviates from predicted patterns

This type of system is particularly useful in:

  • Industrial monitoring
  • Equipment maintenance
  • Early warning systems
  • Quality control
  • System health monitoring

The combination of prediction and dual detection methods (threshold and pattern-based) provides a robust approach to identifying potential issues before they become critical problems.

ARIMA

Posted on by lechuck park

From Claude with some prompting
The image depicts the Autoregressive Integrated Moving Average (ARIMA) Integrated Moving Average Model, which is a time series forecasting technique.

The main components are:

  1. AR (Autoregressive):
    • This component models the past pattern in the data.
    • It performs regression analysis on the historical data.
  2. I (Integrated):
    • This component handles the non-stationarity in the time series data.
    • It applies differencing to make the data stationary.
  3. MA (Moving Average):
    • This component uses the past error terms to calculate the current forecast.
    • It applies a moving average to the error terms.

The flow of the model is as follows:

  1. Past Pattern: The historical data patterns are analyzed.
  2. Regression: The past patterns are used to perform regression analysis.
  3. Difference: The non-stationary data is made stationary through differencing.
  4. Applying Weights + Sliding Window: The regression analysis and differencing are combined, with a sliding window used to update the model.
  5. Prediction: The model generates forecasts based on the previous steps.
  6. Stabilization: The forecasts are stabilized and smoothed.
  7. Remove error: The model removes any remaining error from the forecasts, bringing them closer to the true average.

The diagram also includes visual representations of the forecast output, showing both upward and downward trends.

Overall, this ARIMA model integrates autoregressive, differencing, and moving average components to provide accurate time series forecasts while handling non-stationarity in the data.

Entropy

Posted on by lechuck park

From ChatGPT with some prompting
This image explains entropy growth from two perspectives: human and particle viewpoints.

1. Left (Human View: Ordered State)

  • Image: Dots tightly packed in a cube.
  • Human Perspective: A highly ordered state with low entropy, as dots are confined to specific positions.
  • Particle Perspective: Particles experience restrictions, resulting in a sense of disorder due to limited freedom.

2. Middle (Transition State)

  • Image: Dots spreading out.
  • Human Perspective: Increasing disorder as the system transitions to multiple possible states, leading to higher entropy.
  • Particle Perspective: Particles gain more freedom, moving toward their individual order.

3. Right (Human View: Disordered State)

  • Image: Dots randomly distributed.
  • Human Perspective: Maximum disorder, representing the highest entropy state.
  • Particle Perspective: Particles achieve their highest freedom, forming their unique “order” in randomness.

4. Entropy Growth (Human vs. Particle View)

  • Human Perspective: Order → Disorder (entropy increases).
  • Particle Perspective: Restrictions decrease, and particles transition from “disorder” to finding their own freedom and order.

This dual perspective illustrates entropy as both an increase in disorder (human view) and an emergence of particle freedom and order (particle view).

AI Prediction

Posted on by lechuck park

From Claude with some prompting
This diagram illustrates an AI Prediction System workflow, which is divided into two main sections:

  1. Upper Section (VIEW):
  • Starts with a UI/UX interface
  • Executes queries with tags (metadata)
  • Connects to time series data storage
  • Displays data visualization charts
  • Includes model selection step
  • Finally generates prediction charts
  1. Lower Section (Automation):
  • Selected ID
  • Selected Model
  • Periodic, new tags and additional configuration
  • Batch work processing (consisting of 4 steps):
    1. Registering
    2. Read Data
    3. Generate Predictions
    4. Add Tag
  • Writing new time series data

The system provides two main functionalities:

  1. A user interface for direct data viewing and prediction execution
  2. Automated batch processing for periodic predictions and data updates

Key Components:

  • Time Series Data storage as a central database
  • View Chart for data visualization
  • Model Selection with time selection (learn & predict)
  • Predict Chart as the final output
  • Batch Works system for automated processing

The workflow demonstrates a comprehensive approach to handling both manual and automated AI predictions, combining user interaction with systematic data processing and analysis. The system appears designed to handle time series data efficiently while providing both immediate and scheduled prediction capabilities.

Sensing Data

Posted on by lechuck park

From Claude with some prompting
This image is a diagram showing the data processing flow from TSDB (Time Series Database) to RDBMS (Relational Database Management System). Let me explain the main components and processes:

  1. Data Collection Stage:
  • Analog to Digital (conversion from analog to digital)
  • Time (time information)
  • Meta data
    These three elements combine to generate Time Series Data.
  1. ETL (Extract, Transform, Load) Processing: Data is processed through two paths:
  • Upper path:
  • Easy Calculation
  • Shorter Time Range
  • Stored in Time Series Database
  • Lower path:
  • Complex & Programmatic processing
  • Bigger Time Range
  • Stored in Relational Database
  1. Final Data Utilization:
  • Raw Data → Realtime Monitoring
  • Analyzed Data → Monitoring & Prediction

This diagram explains the overall data pipeline showing how time series data is collected, processed, and ultimately utilized for real-time monitoring and predictive analysis.