Tag: ai

Prediction & Detection

Posted on by lechuck park

From Claude with some prompting
This image illustrates a Prediction and Detection system for time series data. Let me break down the key components:

  1. Left Large Box (Learning and Prediction Section):
  • Blue line: Actual Temperature data
  • Red dotted line: Predicted Temperature data
  • Uses time series prediction models like LSTM, ARIMA, and Prophet for learning
  1. Top Right (Threshold-based Anomaly Detection):
  • “Abnormal Detection with Threshold”
  • Detects abnormal temperature changes based on threshold values
  • The area marked with a red circle shows where values exceed the threshold
  • Includes “Warning” and “Critical” threshold levels
  1. Bottom Right (Pattern-based Anomaly Detection):
  • “Anomaly Detection with Predict-Pattern”
  • Compares predicted patterns with actual data to detect anomalies
  • The area marked with a green circle shows where actual data deviates from the predicted pattern

The system detects anomalies in two ways:

  1. When values exceed predetermined thresholds
  2. When actual data significantly deviates from predicted patterns

This type of system is particularly useful in:

  • Industrial monitoring
  • Equipment maintenance
  • Early warning systems
  • Quality control
  • System health monitoring

The combination of prediction and dual detection methods (threshold and pattern-based) provides a robust approach to identifying potential issues before they become critical problems.

ARIMA

Posted on by lechuck park

From Claude with some prompting
The image depicts the Autoregressive Integrated Moving Average (ARIMA) Integrated Moving Average Model, which is a time series forecasting technique.

The main components are:

  1. AR (Autoregressive):
    • This component models the past pattern in the data.
    • It performs regression analysis on the historical data.
  2. I (Integrated):
    • This component handles the non-stationarity in the time series data.
    • It applies differencing to make the data stationary.
  3. MA (Moving Average):
    • This component uses the past error terms to calculate the current forecast.
    • It applies a moving average to the error terms.

The flow of the model is as follows:

  1. Past Pattern: The historical data patterns are analyzed.
  2. Regression: The past patterns are used to perform regression analysis.
  3. Difference: The non-stationary data is made stationary through differencing.
  4. Applying Weights + Sliding Window: The regression analysis and differencing are combined, with a sliding window used to update the model.
  5. Prediction: The model generates forecasts based on the previous steps.
  6. Stabilization: The forecasts are stabilized and smoothed.
  7. Remove error: The model removes any remaining error from the forecasts, bringing them closer to the true average.

The diagram also includes visual representations of the forecast output, showing both upward and downward trends.

Overall, this ARIMA model integrates autoregressive, differencing, and moving average components to provide accurate time series forecasts while handling non-stationarity in the data.

AI Prediction

Posted on by lechuck park

From Claude with some prompting
This diagram illustrates an AI Prediction System workflow, which is divided into two main sections:

  1. Upper Section (VIEW):
  • Starts with a UI/UX interface
  • Executes queries with tags (metadata)
  • Connects to time series data storage
  • Displays data visualization charts
  • Includes model selection step
  • Finally generates prediction charts
  1. Lower Section (Automation):
  • Selected ID
  • Selected Model
  • Periodic, new tags and additional configuration
  • Batch work processing (consisting of 4 steps):
    1. Registering
    2. Read Data
    3. Generate Predictions
    4. Add Tag
  • Writing new time series data

The system provides two main functionalities:

  1. A user interface for direct data viewing and prediction execution
  2. Automated batch processing for periodic predictions and data updates

Key Components:

  • Time Series Data storage as a central database
  • View Chart for data visualization
  • Model Selection with time selection (learn & predict)
  • Predict Chart as the final output
  • Batch Works system for automated processing

The workflow demonstrates a comprehensive approach to handling both manual and automated AI predictions, combining user interaction with systematic data processing and analysis. The system appears designed to handle time series data efficiently while providing both immediate and scheduled prediction capabilities.

Data with the AI

Posted on by lechuck park

From Claude with some prompting
the key points from the diagram:

  1. Reality of Internet Open Data:
    • Vast amount of open data exists on the internet including:
      • Mobile device data
      • Email communications
      • Video content
      • Location data
    • This open data is utilized by major AI companies for LLM training
    • Key players:
      • OpenAI’s ChatGPT
      • Anthropic’s Claude
      • Google’s Gemini
      • Meta’s LLaMA
  2. Competition Implications:
    • Competition between LLMs trained on similar internet data
    • “Who Winner?” and “A Winner Takes ALL?” suggests potential monopoly in the base LLM market
    • This refers specifically to models trained on public internet data
  3. Market Outlook:
    • While the base LLM market might be dominated by a few players
    • Private enterprise data remains a key differentiator
    • “Still Differentiated and Competitive” indicates ongoing competition through enterprise-specific data
    • Companies can leverage RAG-like technology to combine their private data with LLMs for unique solutions
  4. Key Implications:
    • Base LLM market (trained on internet data) may be dominated by few winners
    • Enterprise competition remains vibrant through:
      • Unique private data assets
      • RAG integration with base LLMs
      • Company-specific implementations
    • Market likely to evolve into dual structure:
      • Foundation LLMs (based on internet data)
      • Enterprise-specific AI services (leveraging private data)

This structure suggests that while base LLM technology might be dominated by a few players, enterprises can maintain competitive advantage through their unique private data assets and specialized implementations using RAG-like technologies.

This creates a market where companies can differentiate themselves even while using the same foundation models, by leveraging their proprietary data and specific use-case implementations.

From Data

Posted on by lechuck park

From Claude with some prompting
following the overall sequence from data collection to AI systems development.

  1. Data Collection and Processing (Upper “From Data” section): a) Collecting data from people worldwide b) “Get Data”: Acquiring raw data c) “Gathering Data”: Converting data into binary format d) “Statistics Analysis”: Performing data analysis e) “Making Rules/Formula”: Generating rules or formulas based on analysis
  2. Evolution of AI Systems (Lower “Human-made AI (Legacy)” section): a) Human-centered analysis:
    • “Combine formulas”: Combining rules and formulas directly created by humans
    b) Machine Learning-based analysis:
    • Rule-based Machine Learning: • Utilizes Big Data • Generates rules/formulas through machine learning • Results evaluated as “True or False”
    • Statistical Machine Learning (e.g., LLM): • Utilizes Big Data • Performs statistical analysis using advanced machine learning • Results evaluated as “Better or Worse”

Key Points Summary:

  1. Data Processing Flow: Illustrates the step-by-step process from raw data collection to rule/formula generation.
  2. AI System Evolution:
    • Begins with human-centered rule-based systems
    • Progresses to machine learning models that learn rules from data
    • Advances to sophisticated statistical models (like LLMs) that recognize complex patterns and provide nuanced results
  3. Shift in Result Interpretation:
    • Moves from simple true/false outcomes
    • To relative and context-dependent “better/worse” evaluations

This image effectively demonstrates the progression of data processing and AI technology, particularly highlighting how AI systems have become more complex and sophisticated. It shows the transition from human-derived rules to data-driven machine learning approaches, culminating in advanced statistical models that can handle nuanced analysis and produce more contextualized results.

A huge distinction

Posted on by lechuck park

From Claude with some prompting
Image Analysis: “A huge distinction”

  1. Human Data Processing:
    • “Feel a difference”: Humans start by recognizing basic differences.
    • “Make one diff (0 vs 1)”: Creating the most fundamental distinction.
    • “Found relations with many diff”: Discovering relationships among various differences.
    • “Make a formula”: Developing formulas based on discovered relationships.
    • “Make a Rules”: Establishing rules based on these formulas.
    • “Human-made All Data”: Accumulation of data created through this entire process.
  2. Process Recording:
    • “Logging all processes”: The data creation process itself is recorded as data.
  3. AI Data Processing:
    • “Sensing & Related Data”: AI receives basic sensory data and related information.
    • “Human-made All Data”: All human-created data serves as input for AI.
    • “Finding a Relations with huge diff”: AI analyzes relationships and differences within this vast dataset.
  4. Result:
    • AI icon: Represents the final derivation of insights through AI.

Evaluation:

  1. Insightfulness: The diagram effectively illustrates the fundamental difference between human data processing methods and AI’s data processing capabilities. It highlights how humans follow a step-by-step logical process, while AI can process large-scale data simultaneously.
  2. Process Continuity: The diagram well expresses how human data processing forms the foundation for AI learning. This conveys the important concept that AI develops based on human knowledge and experience.
  3. Importance of Data: By emphasizing the importance of digitalizing all processes, the diagram effectively represents the core of our modern data-centric society.
  4. Visualization Effectiveness: Complex concepts are represented using simple icons and arrows, making them easy to understand.
  5. Future Expectation: We look forward to seeing additional explanations about AI’s output results or its potential applications. This would enhance the comprehensiveness of the diagram, providing a fuller picture of the AI process from input to output and its real-world impact.

Overall, this image effectively contrasts human data processing with AI’s data analysis capabilities, showcasing how these two domains operate complementarily. It provides a clear visual representation of the journey from basic human distinctions to complex AI-driven insights, highlighting the ‘huge distinction’ in scale and capability between human and artificial intelligence processing.

New Infra Age

Posted on by lechuck park

From Claude with some prompting
This diagram illustrates the cyclical evolution of computing infrastructure, emphasizing the re-entry into a new computing infrastructure era driven by AI technology:

  1. Development cycle:
    • Traditional infrastructure era (Infra age) → Software era (SW Age) → New infrastructure era (New Infra age)
  2. Core elements of the new infrastructure era:
    • AI/ML (highlighted with red circles): Processing humanity’s accumulated experiences and data
    • GPU: Key computing infrastructure for AI
  3. Driving forces of development:
    • More Users
    • More Data
    • These are visualized by the icons at the bottom
  4. Key connection points (highlighted with red circles):
    • PC: Increased user base due to personal computer proliferation
    • Internet: Enhanced global connectivity
    • Web: Improved information accessibility
    • Mobile: Anytime, anywhere access environment
    • AI/ML: Processing and utilization of accumulated data
  5. Cyclical development:
    • User increase → Data increase → Infrastructure development to process this data → Attraction of more users, creating a cyclical structure

This diagram emphasizes that as AI technology begins to comprehensively process and utilize humanity’s accumulated experiences and data, it necessitates the expansion of new GPU-centric computing infrastructure to support this. It demonstrates a cyclical structure where processing more users and data leads to further infrastructure development, which in turn enables handling even more users and data.