Category: machine learning

ARIMA

Posted on by lechuck park

From Claude with some prompting
The image depicts the Autoregressive Integrated Moving Average (ARIMA) Integrated Moving Average Model, which is a time series forecasting technique.

The main components are:

  1. AR (Autoregressive):
    • This component models the past pattern in the data.
    • It performs regression analysis on the historical data.
  2. I (Integrated):
    • This component handles the non-stationarity in the time series data.
    • It applies differencing to make the data stationary.
  3. MA (Moving Average):
    • This component uses the past error terms to calculate the current forecast.
    • It applies a moving average to the error terms.

The flow of the model is as follows:

  1. Past Pattern: The historical data patterns are analyzed.
  2. Regression: The past patterns are used to perform regression analysis.
  3. Difference: The non-stationary data is made stationary through differencing.
  4. Applying Weights + Sliding Window: The regression analysis and differencing are combined, with a sliding window used to update the model.
  5. Prediction: The model generates forecasts based on the previous steps.
  6. Stabilization: The forecasts are stabilized and smoothed.
  7. Remove error: The model removes any remaining error from the forecasts, bringing them closer to the true average.

The diagram also includes visual representations of the forecast output, showing both upward and downward trends.

Overall, this ARIMA model integrates autoregressive, differencing, and moving average components to provide accurate time series forecasts while handling non-stationarity in the data.

Amazing ML

Posted on by lechuck park

From Claude with some prompting
This diagram effectively illustrates the core principles of machine learning.

Basic Components:

  1. Number Pattern at the Top: 1 → 4 → 7 → 10 → 14
  • Presented with the question “Have a pattern??”
  1. Neural Network Diagram in the Center
  • Visualizes the machine learning process of pattern discovery
  1. Discovered Rule at the Bottom: Y = 3x + 1
  • Mathematical expression of the pattern found in the data

Key Messages:

  1. Pattern Discovery from Data
  • Using just 5 data points
  • Clear mathematical pattern can be discovered
  • Rule where each number adds 3 to the previous one
  1. Infinite Scalability
  • One simple discovered rule (Y = 3x + 1)
  • Can predict infinite data points (Infinite Data)
  • Demonstrates machine learning’s power of ‘generalization’

This diagram showcases machine learning’s most powerful characteristic:

  • Learning from limited data
  • Discovering simple yet powerful rules
  • Ability to predict infinite new cases

It’s similar to how physical laws like E = mc² can explain infinite natural phenomena with a single equation. The diagram effectively shows how machine learning serves as a powerful tool for discovering these fundamental patterns hidden within data.

The beauty of this concept lies in its simplicity and power:

  • Using just 5 visible data points
  • Finding a mathematical pattern
  • Creating a rule that can predict an infinite number of future points

This demonstrates the essence of machine learning: the ability to take finite observations and transform them into a universal rule that can make predictions far beyond the original training data.

Both are equally unexplainable

Posted on by lechuck park

From Claude with some prompting
This image compares human intelligence and artificial intelligence, emphasizing that both are “equally unexplainable” in certain aspects:

  1. Human Intelligence:
    • Uses 100% math and logic, but based on limited experience and data.
    • Labeled “Not 100% depend on Experience,” indicating experience alone is insufficient.
    • When decision-making under time constraints, humans make the “best choice” rather than a 100% perfect choice.
    • Shows a process of: Event → Decision with Time Limit → Action.
  2. Artificial Intelligence:
    • Based on big data, GPU/CPU processing, and AI models (including LLMs).
    • Labeled as “Unexplainable AI Model,” highlighting the difficulty in fully interpreting AI decision-making processes.
    • Demonstrates a flow of: Data input → Neural network processing → “Nice but not 100%” output.
    • Like human intelligence, AI also makes best choices within limited data and time constraints.
  3. Key Messages:
    • AI is not a simple logic calculator but a system mimicking human intelligence.
    • AI decisions, like human decisions, are not 100% perfect but the best choice under given conditions.
    • We should neither overestimate nor underestimate AI, but understand its limitations and possibilities in a balanced way.
    • Both human and artificial intelligence have unexplainable aspects, reflecting the complexity and limitations of both systems.

This image emphasizes the importance of accurately understanding and appropriately utilizing AI capabilities by comparing it with human intelligence. It reminds us that while AI is a powerful tool, human judgment and ethical considerations remain crucial. The comparison underscores that AI, like human intelligence, is making the best possible decisions based on available data and constraints, rather than providing infallible, 100% correct answers.

“if then” by AI

Posted on by lechuck park

From Claude with some prompting
This image titled “IF THEN” by AI illustrates the evolution from traditional programming to modern AI approaches:

  1. Upper section – “Programming”: This represents the traditional method. Here, programmers collect data, analyze it, and explicitly write “if-then” rules. This process is labeled “Making Rules”.
    • Data collection → Analysis → Setting conditions (IF) → Defining actions (THEN)
  2. Lower section – “AI”: This shows the modern AI approach. It uses “Huge Data” to automatically learn patterns through machine learning algorithms.
    • Large-scale data → Machine Learning → AI model generation

Key differences:

  • Traditional method: Programmers explicitly define rules
  • AI method: Automatically learns patterns from data to create AI models that include basic “if-then” logic

The image effectively diagrams the shift in programming paradigms. It demonstrates how AI can process and learn from massive datasets to automatically generate logic that was previously manually defined by programmers.

This visualization succinctly captures how AI has transformed the approach to problem-solving in computer science, moving from explicit rule-based programming to data-driven, pattern-recognizing models.

Data Life

Posted on by lechuck park

From ChatGPT with some prompting
reflecting the roles of human research and AI/machine learning in the data process:

Diagram Explanation :

  1. World:
    • Data is collected from the real world. This could be information from the web, sensor data, or other sources.
  2. Raw Data:
    • The collected data is in its raw, unprocessed form. It is prepared for analysis and processing.
  3. Analysis:
    • The data is analyzed to extract important information and patterns. During this process, rules are created.
  4. Rules Creation:
    • This step is driven by human research.
    • The human research process aims for logical and 100% accurate rules.
    • These rules are critical for processing and analyzing data with complete accuracy. For example, creating clear criteria for classifying or making decisions based on the data.
  5. New Data Generation:
    • New data is generated during the analysis process, which can be used for further analysis or to update existing rules.
  6. Machine Learning:
    • In this phase, AI models (rules) are trained using the data.
    • AI/machine learning goes beyond human-defined rules by utilizing vast amounts of data through computing power to achieve over 99% accuracy in predictions.
    • This process relies heavily on computational resources and energy, using probabilistic models to derive results from the data.
    • For instance, AI can identify whether an image contains a cat or a dog with over 99% accuracy based on the data it has learned from.

Overall Flow Summary :

  • Human research establishes logical rules that are 100% accurate, and these rules are essential for precise data processing and analysis.
  • AI/machine learning complements these rules by leveraging massive amounts of data and computing power to find high-probability results. This is done through probabilistic models that continuously improve and refine predictions over time.
  • Together, these two approaches enhance the effectiveness and accuracy of data processing and prediction.

This diagram effectively illustrates how human logical research and AI-driven data learning work together in the data processing lifecycle.

Many Simple with THE AI

Posted on by lechuck park

From Claude with some prompting
This image illustrates the concept of “Many Simple” and demonstrates how simple elements combine to create complexity.

  1. Top diagram:
    • “Simple”: Starts with a single “EASY” icon.
    • “Many Simple”: Shows multiple “EASY” icons grouped together.
    • “Complex”: Depicts a system of intricate gears and connections.
  2. Bottom diagram:
    • Shows the progression from “Many Easy Rules” to “Complex Rules”.
    • Centers around the concept of “Machine Learning Works”.
    • This is supported by “With Huge Data” and “With Super Infra”.

The image provides a simplified explanation of how machine learning operates. It visualizes the process of numerous simple rules being processed through massive amounts of data and powerful infrastructure to produce complex systems.

No More data

Posted on by lechuck park

From Claude with some prompting
This image illustrates a flowchart about data and the learning process. Here’s a breakdown of the key elements:

  1. The title “No More Data” is at the top of the image.
  2. “Data in” section includes:
    • Experience: represented by a history icon
    • Number: shown as dice with 1, 2, 3
    • Text: represented by “IT” letters
    • Book: depicted by a book icon
    • Internet: symbolized by a global network icon
  3. These data sources feed into a “Learning & Learning” process, leading to a learning output represented by an icon resembling artificial intelligence or a brain.
  4. There’s a stage labeled “No More Data”, followed by the question “And the Next ??”
  5. Finally, there’s a lightbulb icon suggesting “New Creation?”

This diagram visualizes the process from data input to learning, and then poses the question of what happens when there’s no more data. It suggests the possibility of new creation as the next step. The flowchart prompts consideration of what follows after the learning phase when data input ceases, and whether this could lead to novel creation.