Changes / Firebolt / Engines may fail to start and stop

Firebolt: Major incident: Engines may fail to start and stop

Summary

Firebolt reported a major outage in which engines could fail to start and stop due to an issue identified on AWS's side. It started at 2021-09-27 08:30 UTC and was resolved at 2021-09-27 12:13 UTC, lasting 3 h 42 min; Firebolt confirmed it was fully operational.

Machine-written from the diff below (Sol; type: incident outage). Check the diff before relying on it.

Major incidentLabel: outage (model (Jev), 99%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Engines may fail to start and stop
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2021-09-27 08:30 UTC
AddedResolved time#5
Before: not present
After: 2021-09-27 12:13 UTC
AddedAffected components#6
Before: not present
After: AWS - EC2, EC2, Engines, Firebolt Components - Engines
AddedUpdateinvestigating#7
Before: not present
After: Engines may fail to start and stop due to issues on 3rd pary provider.
AddedUpdateidentified#8
Before: not present
After: The issue has been identified on AWS side. We are waiting for a complete recovery.
AddedUpdatemonitoring#9
Before: not present
After: The issue has been partially resolved and we are waiting on AWS to confirm full recovery.
AddedUpdateresolved#10
Before: not present
After: The Incident has been resolved. Firebolt is fully operational.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Engines may fail to start and stop (this change)
Firebolt reported a major outage in which engines could fail to start and stop due to an issue identified on AWS's side. It started at 2021-09-27 08:30 UTC and was resolved at 2021-09-27 12:13 UTC, lasting 3 h 42 min; Firebolt confirmed it was fully operational.
Major incident

All Firebolt changes → · Firebolt profile · Markdown · JSON