# Dagster: Major incident: Some Dagster Plus Serverless Runs Failing to Start

**Summary:** Some Dagster Plus Serverless runs failed to start with an "Agent detected that run worker failed." error during a major-impact incident from 2024-05-14 18:53 UTC to 2024-05-14 20:16 UTC, lasting 1 h 22 min. Dagster rolled out additional automatic retries; its cloud provider identified a causal change and began rolling it back. Dagster confirmed the fix was live. _(machine-written, sol)_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2024-05-14 18:53 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/9j3xwjk6f50h](https://stspg.io/9j3xwjk6f50h)
- [Company: Dagster](https://rewindex.com/company/dagster.md)
- Versions: before (none: first archived) → after incident\_version:141/spfk3633vzwh@c33f35fcafa2
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Some Dagster Plus Serverless Runs Failing to Start
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2024-05-14 18:53 UTC
```

**5. Added: Resolved time**

```diff
+ 2024-05-14 20:16 UTC
```

**6. Added: Affected components**

```diff
+ API
```

**7. Added: Update** (investigating) · 2024-05-14 18:53 UTC

```diff
+ Some Dagster Plus Serverless runs are failing to start with an "Agent detected that run worker failed." error. We are working with our cloud provider to investigate the root cause of the problem as well as adding automatic retries for the underlying error that is causing the runs to fail to start.
```

**8. Added: Update** (investigating) · 2024-05-14 19:34 UTC

```diff
+ We are continuing to investigate the root cause of this issue with our cloud provider. We are rolling out a change to add additional automatic retries to runs that are affected by this issue.
```

**9. Added: Update** (identified) · 2024-05-14 19:57 UTC

```diff
+ Our cloud provider has identified the root cause of the problem and is in the process of rolling back the change that caused it. We'll continue to provide updates as we work to resolve the issue.
```

**10. Added: Update** (resolved) · 2024-05-14 20:16 UTC

```diff
+ The fix for this problem is now live.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2024-05-14 18:53 UTC | Major incident: Some Dagster Plus Serverless Runs Failing to Start (this change) | outage |

All Dagster changes: [timeline](https://rewindex.com/company/dagster/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i8cb5f22f78faf6 · Markdown: https://rewindex.com/change/i8cb5f22f78faf6.md · JSON: https://rewindex.com/api/v1/changes/i8cb5f22f78faf6 · Generated 2026-10-18T02:29:11.079Z