Materialization and CSV upload failures
Incident
Report for Sigma Computing
Postmortem
Sigma Engineering has completed the postmortem of this incident. A Root Cause Analysis (RCA) is available on the Sigma Community site: Postmortem for April 17, 2023 Materialization and CSV Upload incident - Sigma AWS & Sigma GCP
Resolved
Current Status: Our engineers have implemented mitigation measures to circumvent the issue and we are seeing materializations and CSV uploads are operational now.
Impacted Cloud Regions & Services: All Connection types, AWS and GCP deployments.
User Experience: We expect users should no longer see materialization and CSV upload failures due to this incident.
Incident Start Time: Approximately 13:00 UTC April 17, 2023
Incident End Time: Approximately 17:30 UTC April 19, 2023
We will perform a root cause analysis (RCA) and publish our findings in a postmortem note to the Sigma Community site in coming days. You will receive a notification when that occurs.
Impacted Cloud Regions & Services: All Connection types, AWS and GCP deployments.
User Experience: We expect users should no longer see materialization and CSV upload failures due to this incident.
Incident Start Time: Approximately 13:00 UTC April 17, 2023
Incident End Time: Approximately 17:30 UTC April 19, 2023
We will perform a root cause analysis (RCA) and publish our findings in a postmortem note to the Sigma Community site in coming days. You will receive a notification when that occurs.
Update
Current Status: Our engineers have implemented mitigation measures to circumvent the issue and we are monitoring their effect closely.
Impacted Cloud Regions & Services: All Connection types, AWS and GCP deployments.
User Experience: We expect the rate of errors to decrease for all materializations and CSV uploads.
Incident Start Time: Approximately 13:00 UTC April 17, 2023
Incident End Time: Approximately 17:30 UTC April 19, 2023
We will perform a root cause analysis (RCA) and publish our findings in a postmortem note to the Sigma Community site in coming days. You will receive a notification when that occurs.
Impacted Cloud Regions & Services: All Connection types, AWS and GCP deployments.
User Experience: We expect the rate of errors to decrease for all materializations and CSV uploads.
Incident Start Time: Approximately 13:00 UTC April 17, 2023
Incident End Time: Approximately 17:30 UTC April 19, 2023
We will perform a root cause analysis (RCA) and publish our findings in a postmortem note to the Sigma Community site in coming days. You will receive a notification when that occurs.
Monitoring
Current Status: Our engineers have implemented mitigation measures to circumvent the issue and we are monitoring their effect closely.
Impacted Cloud Regions & Services: All Connection types, AWS and GCP deployments
User Experience: We expect the rate of errors to decrease for all materializations and CSV uploads
Incident Start Time: Approximately 13:00 UTC April 17, 2023
Incident End Time: Approximately 17:30 UTC April 19, 2023
Impacted Cloud Regions & Services: All Connection types, AWS and GCP deployments
User Experience: We expect the rate of errors to decrease for all materializations and CSV uploads
Incident Start Time: Approximately 13:00 UTC April 17, 2023
Incident End Time: Approximately 17:30 UTC April 19, 2023
Investigating
Current Status: We are investigating an issue causing failures on write-back queries for materializations and CSV uploads. We are treating this as our highest priority and we expect this issue to be transitory. Our apologies for any inconvenience caused.
Impacted Cloud Regions & Services: All Connection types, AWS and GCP deployments
User Experience: Users are experiencing failures on materializations and CSV uploads
Incident Start Time: Approximately 13:00 UTC April 17, 2023
Impacted Cloud Regions & Services: All Connection types, AWS and GCP deployments
User Experience: Users are experiencing failures on materializations and CSV uploads
Incident Start Time: Approximately 13:00 UTC April 17, 2023
This incident affected: GCP (Sigma - GCP (US)) and AWS (Sigma - AWS (US)).