Changes / Firebolt / starting & stopping engines takes long time.
Firebolt: Major incident: starting & stopping engines takes long time.
Summary
Firebolt reported a major degradation affecting engine starts and stops from 2022-06-08 08:18 UTC to 2022-06-08 11:08 UTC, lasting 2 h 50 min. Starting or stopping engines could be slow or fail; a production fix restored those operations at 09:37 UTC, and Firebolt confirmed normal service at resolution.
Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.
Major incidentLabel: degradation (model (Jev), 45%)Changed Detected Source: stspg.io (opens in new tab)
What changed
Before: not present
After: starting & stopping engines takes long time.
Before: not present
After: major
Before: not present
After: resolved
Before: not present
After: 2022-06-08 08:18 UTC
Before: not present
After: 2022-06-08 11:08 UTC
Before: not present
After: Engines, Firebolt Components - Engines
Before: not present
After: The issue is back, and Starting/Stopping engines may not work properly.
We are continuing to investigate this issue.
Before: not present
After: We are deploying a fix, and the issue should be resolved soon.
Before: not present
After: We are running some tests on staging to make sure the fix resolved the issue.
Before: not present
After: The fix deployed to production, and engines can be started and stopped again.
Before: not present
After: The issue resolved and the system is back to normal state.
First version of this incident archived by Rewindex. View the live incident (opens in new tab).
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Major incident: starting & stopping engines takes long time. (this change) Firebolt reported a major degradation affecting engine starts and stops from 2022-06-08 08:18 UTC to 2022-06-08 11:08 UTC, lasting 2 h 50 min. Starting or stopping engines could be slow or fail; a production fix restored those operations at 09:37 UTC, and Firebolt confirmed normal service at resolution. | Major incident |