# Firebolt: Major incident: Engine Startup Issue in US-EAST-1 Region

**Summary:** Firebolt reported a major engine startup outage in US-EAST-1 caused by an AWS issue, primarily affecting new instance launches; running engines and other regions were unaffected. It started at 2023-09-28 20:10 UTC and was resolved at 2023-09-29 06:37 UTC, lasting 10 h 26 min, with normal service restored. _(machine-written, sol)_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2023-09-28 20:10 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/5ryx3qh8s8vn](https://stspg.io/5ryx3qh8s8vn)
- [Company: Firebolt](https://rewindex.com/company/firebolt.md)
- Versions: before (none: first archived) → after incident\_version:147/c7fp1tv52r93@e7e1bfaacc07
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Engine Startup Issue in US-EAST-1 Region
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2023-09-28 20:10 UTC
```

**5. Added: Resolved time**

```diff
+ 2023-09-29 06:37 UTC
```

**6. Added: Affected components**

```diff
+ AWS - AWS ec2-us-east-1, AWS ec2-us-east-1
```

**7. Added: Update** (investigating) · 2023-09-28 20:10 UTC

```diff
+ AWS experience an issue in US-EAST-1 region that may affect the startup of engines. This issue primarily impacts the launch of new instances within this specific region. Our team is actively monitoring the situation, and we are in close communication with AWS to expedite the resolution of this issue. We will provide updates as we receive more information or make progress toward a solution. You can also track it on the Status page of AWS -  https://health.aws.amazon.com/health/status
```

**8. Added: Update** (investigating) · 2023-09-28 20:24 UTC

```diff
+ AWS experience an issue in US-EAST-1 region that may affect the startup of engines. This issue primarily impacts the launch of new instances within this specific region. Our team is actively monitoring the situation, and we are in close communication with AWS to expedite the resolution of this issue. We will provide updates as we receive more information or make progress toward a solution. You can also track it on the Status page of AWS -  https://health.aws.amazon.com/health/status
```

**9. Added: Update** (identified) · 2023-09-28 20:39 UTC

```diff
+ As of now, we are awaiting an update from AWS to resolve the engine startup problem. While we await AWS's response, it's important to note that the issue continues to affect the launch of new instances in the US-EAST-1 region. However, our services in other regions as well as currently running engines remain unaffected and are functioning as expected.  Please continue to follow updates here and in AWS status page - https://health.aws.amazon.com/health/status
```

**10. Added: Update** (monitoring) · 2023-09-28 21:58 UTC

```diff
+ While the AWS outage is not fully resolved, it is gradually recovering, and so do our engines. We continue to monitor our affected engines until we gain a fully operational status.  For more updates on the AWS status, please see here: https://health.aws.amazon.com/health/status
```

**11. Added: Update** (monitoring) · 2023-09-28 23:24 UTC

```diff
+ No significant updates have been provided from AWS. We are monitoring their status page as well as our internal monitoring tools.  We do no expect to provide further interim updates, we will update here once the issue is resolved.
```

**12. Added: Update** (resolved) · 2023-09-29 06:37 UTC

```diff
+ The issue has been resolved and the service is operating normally
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2023-09-28 20:10 UTC | Major incident: Engine Startup Issue in US-EAST-1 Region (this change) | outage |

All Firebolt changes: [timeline](https://rewindex.com/company/firebolt/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i137c660505dee1 · Markdown: https://rewindex.com/change/i137c660505dee1.md · JSON: https://rewindex.com/api/v1/changes/i137c660505dee1 · Generated 2026-10-18T01:30:42.660Z
