Search

Companies / Snowflake / incidents

Snowflake: Azure - East US 2 (Virginia): INC0105911

Impact: criticalStatus: resolvedStarted Resolved (4.1 h)1 updateSource: status.snowflake.com (opens in new tab)

Timeline of updates

  1. resolved

    Current status: We've implemented the fix for this issue and monitored the environment to confirm that service was restored. If you experience additional issues or have questions, please open a support case via Snowflake Community. Customer experience: Customers hosted in the specified regions may have been unable to use multiple Snowflake services and features. Incident start time: 09:18 UTC April 04, 2024 Incident end time: 12:30 UTC April 04, 2024 Preliminary root cause: We encountered a potential availability zone connectivity issue with the third-party cloud service provider (CSP) hosting the region, resulting in the metadata database infrastructure entering an unhealthy state. By design, we have availability zone redundancy that initially prevented this issue from impacting customers. However, upon recovery and re-introduction of the affected availability zone, internal automation intended to manage the increase and queue of incurred requests had elevated throttling to an extent that prevented the processing of a majority of requests. As a result, customers hosted in this region may not have been able to access or use multiple Snowflake services. Additionally, customer impact was prolonged as the internal infrastructure responsible for requesting and deploying virtual machines within the cloud services layer was affected by this issue and required a manual restart of the provisioning servers. Following the recovery of provisioning infrastructure, other cloud services layer systems and query processing systems required a gradual re-introduction over an extended period of time. A preliminary root cause analysis (RCA) document will be published within two business days, and a complete RCA that includes corrective actions will be provided within seven business days.

From Snowflake’s published incident history: for incidents before Rewindex began polling this status page, only the final update text is available.

Impact, status and times are the vendor’s own, as last archived. View on status.snowflake.com (opens in new tab). Snowflake profile · Recent Snowflake incidents · Markdown · JSON