Dremio: Unable to start Azure-based project engines in Dremio Cloud

Impact: majorStatus: resolvedStarted 2024-02-27 00:58 UTCResolved 2024-02-27 08:30 UTC (7.5 h)11 updatesSource: stspg.io

Summary

A major incident prevented Azure-based project engines from starting in Dremio Cloud - Europe and Dremio Cloud - US, affecting customers’ ability to start engines. It started at 2024-02-27 00:58 UTC and was resolved at 2024-02-27 08:30 UTC, lasting 7 h 31 min. Dremio rolled out a fix to all environments and verified engines were starting.

Machine-written from the archived incident (Sol). Check the timeline before relying on it.

Affected components: Dremio Cloud - EuropeDremio Cloud - US

Timeline of updates

investigating2024-02-27 00:58 UTC
Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We are currently investigating the issue. Expect updates every 30 minutes.
identified2024-02-27 01:38 UTC
Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have identified the issue and are working on a fix. We will provide another update by 6:45 PM PT.
identified2024-02-27 02:30 UTC
Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have identified the issue and are working on a fix. We will provide another update by 7:45 PM PT.
identified2024-02-27 03:32 UTC
Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have identified the issue and are working on rolling out a fix. We will provide another update by 8:45 PM PT.
identified2024-02-27 04:41 UTC
Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have identified the issue and are continuing to work on rolling out a fix. We will provide another update by 9:45 PM PT.
identified2024-02-27 05:44 UTC
Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have identified the issue and are continuing to work on rolling out a fix. We will provide another update by 10:45 PM PT.
identified2024-02-27 06:26 UTC
Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have verified a fix and are working on rolling out the fix to production environments. We will provide another update by 11:15 PM PT.
identified2024-02-27 07:08 UTC
Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have verified a fix and are continuing to roll out the fix to production environments. We will provide another update by 11:45 PM PT.
identified2024-02-27 07:44 UTC
Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have rolled out the fix to Dremio Cloud EU and are continuing to roll out the fix to Dremio Cloud US. We will provide another update by 12:15 AM PT.
identified2024-02-27 08:19 UTC
Users may be experiencing issues with starting engines in Dremio Cloud for Azure projects. We have rolled out the fix to Dremio Cloud EU and are completing the roll out of the fix to Dremio Cloud US. We will provide another update by 12:45 AM PT.
resolved2024-02-27 08:30 UTC
We have rolled out the fix to all Dremio Cloud environments and have verified engines are coming up for Azure-based projects. We apologize for any inconvenience this incident may have caused.

Rewindex changes for this incident

Major incident: Unable to start Azure-based project engines in Dremio Cloud 2024-02-27 00:58 UTC

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Dremio profile · Recent Dremio incidents · Markdown · JSON