# Dagster: Major incident: Reports of jobs not starting

**Summary:** Dagster reported a major API incident with jobs not starting, beginning 2023-05-03 22:58 UTC and resolved at 2023-05-03 23:29 UTC (30 min). A cluster node upgrade overlapped with the weekly release, temporarily disabling daemons controlling run queuing, alerting, schedules, and sensors; Dagster reverted a recent change and confirmed resolution. _(machine-written, sol)_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2023-05-03 22:58 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/y8923bym7ftx](https://stspg.io/y8923bym7ftx)
- [Company: Dagster](https://rewindex.com/company/dagster.md)
- Versions: before (none: first archived) → after incident\_version:141/pkhkhw49bhlt@dd9a19c2b67f
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Reports of jobs not starting
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2023-05-03 22:58 UTC
```

**5. Added: Resolved time**

```diff
+ 2023-05-03 23:29 UTC
```

**6. Added: Affected components**

```diff
+ API
```

**7. Added: Update** (investigating) · 2023-05-03 22:58 UTC

```diff
+ We have reverted a recent change and believe this should resolve the issue. We will provide an update after further investigation.
```

**8. Added: Update** (investigating) · 2023-05-03 23:12 UTC

```diff
+ The issue is confirmed as resolved, though we are continuing to investigate the issue.
```

**9. Added: Update** (resolved) · 2023-05-03 23:29 UTC

```diff
+ This incident has been resolved. An operation to upgrade the nodes of our cluster overlapped with our weekly release. Interaction between the two operations caused the Dagster daemons that control run queuing, alerting, schedules, and sensors to be temporarily unavailable.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2023-05-03 22:58 UTC | Major incident: Reports of jobs not starting (this change) | outage |

All Dagster changes: [timeline](https://rewindex.com/company/dagster/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i5752a5d4dd5e2a · Markdown: https://rewindex.com/change/i5752a5d4dd5e2a.md · JSON: https://rewindex.com/api/v1/changes/i5752a5d4dd5e2a · Generated 2026-10-18T02:54:54.951Z