Changes / Sigma Computing / Query failures for select organizations connected to Snowflake
Sigma Computing: Critical incident: Query failures for select organizations connected to Snowflake
Summary
Sigma Computing reported a critical incident affecting Snowflake queries for a subset of users on AWS and GCP (US), returning "Bad request; operation not supported." It lasted 5 h 7 min, from 2023-10-03 13:41 UTC to 2023-10-03 18:48 UTC; Snowflake rolled back a server change globally, restoring access to workbooks and data warehouse connections.
Machine-written from the diff below (Sol; type: incident outage). Check the diff before relying on it.
What changed
Before: not present
After: Query failures for select organizations connected to Snowflake
Before: not present
After: critical
Before: not present
After: postmortem
Before: not present
After: 2023-10-03 13:41 UTC
Before: not present
After: 2023-10-03 18:48 UTC
Before: not present
After: AWS - Sigma - AWS (US), GCP - Sigma - GCP (US), Sigma - AWS (US), Sigma - GCP (US)
Before: not present
After: We are investigating an issue with queries resulting in the error message "Bad request; operation not supported." We are treating this as our highest priority. Our apologies for any inconvenience caused.
Before: not present
After: We are investigating an issue with queries resulting in the error message "Bad request; operation not supported." We have engaged with Snowflake support and are treating this as our highest priority. Our apologies for any inconvenience caused.
Before: not present
After: We were able to to reproduce locally and issue is fixed in our environment after Snowflake rolled back a server change on their side. We're now working with them to apply the rollback to all accounts.
Before: not present
After: We have received confirmation from Snowflake that they've rolled back globally for all impacted users. At this time we believe full functionality has been restored and expect all Snowflake users can now access their workbooks and data warehouse connections.
Impacted Cloud Regions & Services: Snowflake connections for a subset of Sigma users hosted on GCP and AWS
User Experience: Affected users can now access their workbooks and data warehouse connections.
Incident Start Time: Approximately 13:00 UTC October 3, 2023
Incident End Time: Approximately 18:03 UTC October 3, 2023
We will perform a root cause analysis (RCA) and publish our findings in a postmortem note to the Sigma Community site in coming days.
Before: not present
After: Sigma Engineering has completed the postmortem of this incident. A Root Cause Analysis \(RCA\) is available on the Sigma Community site: [Postmortem for Oct 03, 2023 Incident: Query failures for select organizations connected to Snowflake ](https://community.sigmacomputing.com/t/postmortem-for-oct-03-2023-incident-query-failures-for-select-organizations-connected-to-snowflake/2634)
First version of this incident archived by Rewindex. View the live incident (opens in new tab).
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Critical incident: Query failures for select organizations connected to Snowflake (this change) Sigma Computing reported a critical incident affecting Snowflake queries for a subset of users on AWS and GCP (US), returning "Bad request; operation not supported." It lasted 5 h 7 min, from 2023-10-03 13:41 UTC to 2023-10-03 18:48 UTC; Snowflake rolled back a server change globally, restoring access to workbooks and data warehouse connections. | Major incident |
All Sigma Computing changes → · Sigma Computing profile · Markdown · JSON