Changes / Sigma Computing / Workbooks not loading for Sigma users on AWS Snowflake

Sigma Computing: Major incident: Workbooks not loading for Sigma users on AWS Snowflake

Summary

Sigma Computing reported a major outage causing workbooks not to load and queries to hang for AWS US and AWS EU users using Snowflake CDW. The final update corrected the start to approximately 2023-09-14 12:49 UTC; mitigation resolved it at 2023-09-14 17:24 UTC (computed duration: 2 h 43 min).

Machine-written from the diff below (Sol; type: incident outage). Check the diff before relying on it.

Major incidentLabel: outage (model (Jev), 94%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Workbooks not loading for Sigma users on AWS Snowflake
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: postmortem
AddedStart time#4
Before: not present
After: 2023-09-14 14:41 UTC
AddedResolved time#5
Before: not present
After: 2023-09-14 17:24 UTC
AddedAffected components#6
Before: not present
After: AWS - Sigma - AWS (Canada), AWS - Sigma - AWS (Europe), AWS - Sigma - AWS (US), Azure - Sigma - Azure (US), GCP - Sigma - GCP (US), Sigma - AWS (Europe), Sigma - AWS (US)
AddedUpdateinvestigating#7
Before: not present
After: We are investigating an issue with workbooks not loading and queries hanging. We are treating this as our highest priority. Our apologies for any inconvenience caused. Impacted Cloud Regions & Services: Sigma users hosted on AWS US & AWS EU using Snowflake CDW Incident Start Time: Approximately 14:12 UTC September 14, 2023
AddedUpdateinvestigating#8
Before: not present
After: We are continuing to investigate this issue.
AddedUpdatemonitoring#9
Before: not present
After: Our engineers have implemented mitigation measures and we are monitoring the effect closely. Impacted Cloud Regions & Services: Sigma users hosted on AWS US & AWS EU using Snowflake CDW User Experience: We expected workbooks to load normally starting 14:48 UTC for AWS US users and at 15:01 UTC for AWS EU users. Incident Start Time: Approximately 14:12 UTC Sep 14, 2023 Note: A correction was made for the incident start time to be in 24-Hour time
AddedUpdateresolved#10
Before: not present
After: The mitigation measures have proven effective, and the issue is resolved. We will perform a root cause analysis (RCA) and publish our findings in a postmortem note to the Sigma Community site in coming days. You will receive a notification when that occurs. Impacted Cloud Regions & Services: Sigma users hosted on AWS US & AWS EU using Snowflake CDW Incident Start Time: Approximately 12:49 UTC September 14, 2023 Incident End Time: Approximately 14:39 UTC September 14, 2023
AddedUpdatepostmortem#11
Before: not present
After: Sigma Engineering has completed the postmortem of this incident. A Root Cause Analysis \(RCA\) is available on the Sigma Community site: [Postmortem for September 14th, 2023; Workbooks not loading for Sigma users on AWS Snowflake](https://community.sigmacomputing.com/t/post-mortem-for-september-14th-2023-workbooks-not-loading-for-sigma-users-on-aws-snowflake/2604)

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Workbooks not loading for Sigma users on AWS Snowflake (this change)
Sigma Computing reported a major outage causing workbooks not to load and queries to hang for AWS US and AWS EU users using Snowflake CDW. The final update corrected the start to approximately 2023-09-14 12:49 UTC; mitigation resolved it at 2023-09-14 17:24 UTC (computed duration: 2 h 43 min).
Major incident

All Sigma Computing changes → · Sigma Computing profile · Markdown · JSON