Changes / Firebolt / UI issue - reporting engines states
Firebolt: Major incident: UI issue - reporting engines states
Summary
Summary pending. The diff below shows exactly what changed.
What changed
Before: not present
After: UI issue - reporting engines states
Before: not present
After: major
Before: not present
After: resolved
Before: not present
After: 2023-01-19 15:27 UTC
Before: not present
After: 2023-01-19 18:43 UTC
Before: not present
After: Firebolt Components - Web Application, Web Application
Before: not present
After: We have a current multi account and multi engine incident. We're still identifying the impact and severity, but as of now it looks like it impacts only the UI and not the engines themselves.
We are still checking it.
Before: not present
After: We are actively working on a fix for the UI issue. Please do not restart or stop engines until we have the issue resolved. We will have an ETA on a fix in 15 minutes.
Before: not present
After: We are still investigating and will update in 10 minutes or when we have a clear ETA
Before: not present
After: We identified the problem and working on a fix.
We will provide an ETA in 15 minutes.
Before: not present
After: We are still working on a resolution and can confirm in the majority case it is a UI issue. There are a few cases where engines have become unresponsive which we need to fix manually.
If an engine is not responsive via the API/SDK, please contact us, and do not restart/stop the engine.
Before: not present
After: We are currently working through the solution which will propagate across accounts over the next 15 minutes. We will continue to update as we resolve the issue and will mention when it's completely fixed.
Before: not present
After: We have confirmed the fix and are actively working on applying the fix across all engines. This fix will take approx 1 hour. As mentioned prior this issue should be purely UI related. If you notice connectivity issues during this hour please reach out to support as that is most likely an unrelated issue.
Before: not present
After: We have resolved the issue with a majority of the engines and are working through the last small fraction of them. We will post when completely resolved. In the interim if you see some engines running and others failed please notify support.
Before: not present
After: We have corrected the final set of engines and all services are available. Please contact support if you have any issues.
First version of this incident archived by Rewindex. View the live incident.
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Major incident: UI issue - reporting engines states (this change) | Major incident |