Tag: ChangeDataCapture

Operations by Metrics

Posted on by lechuck park

1. Big Data Collection & 2. Quality Verification

  • Big Data Collection: Represented by the binary data (top-left) and the “All Data (Metrics)” block (bottom-left).
  • Data Quality Verification: The collected data then passes through the checklist icon (top flow) and the “Verification (with Resolution)” step (bottom flow). This aligns with the quality verification step, including ‘resolution/performance’.

3. Change Data Capture (CDC)

  • Verified data moves to the “Change Only” stage (central pink box).
  • If there are “No Changes,” it results in “No Actions,” illustrating the CDC (Change Data Capture) concept of processing only altered data.
  • The magnifying glass icon in the top flow also visualizes this ‘change detection’ role.

4. State/Numeric Processing & 5. Analysis, Severity Definition

  • State/Numeric Processing: Once changes are detected (after the magnifying glass), the data is split into two types:
    • State Changes (ON/OFF icon): Represents changes in ‘state values’.
    • Numeric Changes (graph icon): Represents changes in ‘numeric values’.
  • Statistical Analysis & Severity Definition:
    • These changes are fed into the “Analysis” step.
    • This stage calculates the “Count of Changes” (statistics on the number of changes) and “Numeric change Diff” (amount of numeric change).
    • The analysis result leads to “Severity Tagging” to define the ‘Severity’ level (e.g., “Critical? Major? Minor?”).

6. Notification & 7. Analysis (Retrieve)

  • Notification: Once the severity is defined, the “Notification” step (bell/email icon) is triggered to alert personnel.
  • Analysis (Retrieve):
    • The notified user then performs the “Retrieve” action.
    • This final step involves querying both the changed data (CDD results) and the original data (source, indicated by the URL in the top-right) to analyze the cause.

Summary

This workflow begins with collecting and verifying all data, then uses CDC to isolate only the changes. These changes (state or numeric) are analyzed for count and difference to assign a severity level. The process concludes with notification and a retrieval step for root cause analysis.

#DataProcessing #DataMonitoring #ChangeDataCapture #CDC #DataAnalysis #SystemMonitoring #Alerting #ITOperations #SeverityAnalysis

With Gemini