Category: machine learning

Humans with numbers

Posted on by lechuck park

From Claude with some prompting
This image depicts the progressive development of human capabilities and knowledge, showcasing how humans have strived to understand and explain the world through the use of numbers, mathematics, and computing technology.

  1. Human Groups: The image represents humans coming together in groups to explore and comprehend the world around them.
  2. Using Math: Humans have leveraged numbers and mathematical calculations in an effort to make sense of the world.
  3. Computing: Building upon their mathematical prowess, the advancement of computing technology has enhanced human analysis and understanding.
  4. High-Speed Infrastructure: The development of cutting-edge technological infrastructure has enabled further evolution of human activities.
  5. AI and Deep Learning: This series of technological advancements has led humans to a point where they may feel they have nearly reached the true essence of reality. However, the image suggests that the emergence of AI and deep learning technologies is now challenging this human-centric perspective, hinting that there may still be an infinite gap to traverse before fully grasping the fundamental nature of the world.

In essence, the image showcases the stepwise progression of human knowledge and capabilities, anchored in numbers, math, and computing, while also highlighting how these efforts are now being disrupted by the rise of advanced AI and deep learning, which may transcend the limitations of human understanding.

Prediction & Detection

Posted on by lechuck park

From Claude with some prompting
This image illustrates a Prediction and Detection system for time series data. Let me break down the key components:

  1. Left Large Box (Learning and Prediction Section):
  • Blue line: Actual Temperature data
  • Red dotted line: Predicted Temperature data
  • Uses time series prediction models like LSTM, ARIMA, and Prophet for learning
  1. Top Right (Threshold-based Anomaly Detection):
  • “Abnormal Detection with Threshold”
  • Detects abnormal temperature changes based on threshold values
  • The area marked with a red circle shows where values exceed the threshold
  • Includes “Warning” and “Critical” threshold levels
  1. Bottom Right (Pattern-based Anomaly Detection):
  • “Anomaly Detection with Predict-Pattern”
  • Compares predicted patterns with actual data to detect anomalies
  • The area marked with a green circle shows where actual data deviates from the predicted pattern

The system detects anomalies in two ways:

  1. When values exceed predetermined thresholds
  2. When actual data significantly deviates from predicted patterns

This type of system is particularly useful in:

  • Industrial monitoring
  • Equipment maintenance
  • Early warning systems
  • Quality control
  • System health monitoring

The combination of prediction and dual detection methods (threshold and pattern-based) provides a robust approach to identifying potential issues before they become critical problems.

ARIMA

Posted on by lechuck park

From Claude with some prompting
The image depicts the Autoregressive Integrated Moving Average (ARIMA) Integrated Moving Average Model, which is a time series forecasting technique.

The main components are:

  1. AR (Autoregressive):
    • This component models the past pattern in the data.
    • It performs regression analysis on the historical data.
  2. I (Integrated):
    • This component handles the non-stationarity in the time series data.
    • It applies differencing to make the data stationary.
  3. MA (Moving Average):
    • This component uses the past error terms to calculate the current forecast.
    • It applies a moving average to the error terms.

The flow of the model is as follows:

  1. Past Pattern: The historical data patterns are analyzed.
  2. Regression: The past patterns are used to perform regression analysis.
  3. Difference: The non-stationary data is made stationary through differencing.
  4. Applying Weights + Sliding Window: The regression analysis and differencing are combined, with a sliding window used to update the model.
  5. Prediction: The model generates forecasts based on the previous steps.
  6. Stabilization: The forecasts are stabilized and smoothed.
  7. Remove error: The model removes any remaining error from the forecasts, bringing them closer to the true average.

The diagram also includes visual representations of the forecast output, showing both upward and downward trends.

Overall, this ARIMA model integrates autoregressive, differencing, and moving average components to provide accurate time series forecasts while handling non-stationarity in the data.

Amazing ML

Posted on by lechuck park

From Claude with some prompting
This diagram effectively illustrates the core principles of machine learning.

Basic Components:

  1. Number Pattern at the Top: 1 → 4 → 7 → 10 → 14
  • Presented with the question “Have a pattern??”
  1. Neural Network Diagram in the Center
  • Visualizes the machine learning process of pattern discovery
  1. Discovered Rule at the Bottom: Y = 3x + 1
  • Mathematical expression of the pattern found in the data

Key Messages:

  1. Pattern Discovery from Data
  • Using just 5 data points
  • Clear mathematical pattern can be discovered
  • Rule where each number adds 3 to the previous one
  1. Infinite Scalability
  • One simple discovered rule (Y = 3x + 1)
  • Can predict infinite data points (Infinite Data)
  • Demonstrates machine learning’s power of ‘generalization’

This diagram showcases machine learning’s most powerful characteristic:

  • Learning from limited data
  • Discovering simple yet powerful rules
  • Ability to predict infinite new cases

It’s similar to how physical laws like E = mc² can explain infinite natural phenomena with a single equation. The diagram effectively shows how machine learning serves as a powerful tool for discovering these fundamental patterns hidden within data.

The beauty of this concept lies in its simplicity and power:

  • Using just 5 visible data points
  • Finding a mathematical pattern
  • Creating a rule that can predict an infinite number of future points

This demonstrates the essence of machine learning: the ability to take finite observations and transform them into a universal rule that can make predictions far beyond the original training data.

Both are equally unexplainable

Posted on by lechuck park

From Claude with some prompting
This image compares human intelligence and artificial intelligence, emphasizing that both are “equally unexplainable” in certain aspects:

  1. Human Intelligence:
    • Uses 100% math and logic, but based on limited experience and data.
    • Labeled “Not 100% depend on Experience,” indicating experience alone is insufficient.
    • When decision-making under time constraints, humans make the “best choice” rather than a 100% perfect choice.
    • Shows a process of: Event → Decision with Time Limit → Action.
  2. Artificial Intelligence:
    • Based on big data, GPU/CPU processing, and AI models (including LLMs).
    • Labeled as “Unexplainable AI Model,” highlighting the difficulty in fully interpreting AI decision-making processes.
    • Demonstrates a flow of: Data input → Neural network processing → “Nice but not 100%” output.
    • Like human intelligence, AI also makes best choices within limited data and time constraints.
  3. Key Messages:
    • AI is not a simple logic calculator but a system mimicking human intelligence.
    • AI decisions, like human decisions, are not 100% perfect but the best choice under given conditions.
    • We should neither overestimate nor underestimate AI, but understand its limitations and possibilities in a balanced way.
    • Both human and artificial intelligence have unexplainable aspects, reflecting the complexity and limitations of both systems.

This image emphasizes the importance of accurately understanding and appropriately utilizing AI capabilities by comparing it with human intelligence. It reminds us that while AI is a powerful tool, human judgment and ethical considerations remain crucial. The comparison underscores that AI, like human intelligence, is making the best possible decisions based on available data and constraints, rather than providing infallible, 100% correct answers.

“if then” by AI

Posted on by lechuck park

From Claude with some prompting
This image titled “IF THEN” by AI illustrates the evolution from traditional programming to modern AI approaches:

  1. Upper section – “Programming”: This represents the traditional method. Here, programmers collect data, analyze it, and explicitly write “if-then” rules. This process is labeled “Making Rules”.
    • Data collection → Analysis → Setting conditions (IF) → Defining actions (THEN)
  2. Lower section – “AI”: This shows the modern AI approach. It uses “Huge Data” to automatically learn patterns through machine learning algorithms.
    • Large-scale data → Machine Learning → AI model generation

Key differences:

  • Traditional method: Programmers explicitly define rules
  • AI method: Automatically learns patterns from data to create AI models that include basic “if-then” logic

The image effectively diagrams the shift in programming paradigms. It demonstrates how AI can process and learn from massive datasets to automatically generate logic that was previously manually defined by programmers.

This visualization succinctly captures how AI has transformed the approach to problem-solving in computer science, moving from explicit rule-based programming to data-driven, pattern-recognizing models.

Data Life

Posted on by lechuck park

From ChatGPT with some prompting
reflecting the roles of human research and AI/machine learning in the data process:

Diagram Explanation :

  1. World:
    • Data is collected from the real world. This could be information from the web, sensor data, or other sources.
  2. Raw Data:
    • The collected data is in its raw, unprocessed form. It is prepared for analysis and processing.
  3. Analysis:
    • The data is analyzed to extract important information and patterns. During this process, rules are created.
  4. Rules Creation:
    • This step is driven by human research.
    • The human research process aims for logical and 100% accurate rules.
    • These rules are critical for processing and analyzing data with complete accuracy. For example, creating clear criteria for classifying or making decisions based on the data.
  5. New Data Generation:
    • New data is generated during the analysis process, which can be used for further analysis or to update existing rules.
  6. Machine Learning:
    • In this phase, AI models (rules) are trained using the data.
    • AI/machine learning goes beyond human-defined rules by utilizing vast amounts of data through computing power to achieve over 99% accuracy in predictions.
    • This process relies heavily on computational resources and energy, using probabilistic models to derive results from the data.
    • For instance, AI can identify whether an image contains a cat or a dog with over 99% accuracy based on the data it has learned from.

Overall Flow Summary :

  • Human research establishes logical rules that are 100% accurate, and these rules are essential for precise data processing and analysis.
  • AI/machine learning complements these rules by leveraging massive amounts of data and computing power to find high-probability results. This is done through probabilistic models that continuously improve and refine predictions over time.
  • Together, these two approaches enhance the effectiveness and accuracy of data processing and prediction.

This diagram effectively illustrates how human logical research and AI-driven data learning work together in the data processing lifecycle.