# Dagster: Major incident: Dagster Cloud sensors and runs failing

**Summary:** Dagster Cloud reported a major API incident from 2023-01-27 19:14 UTC to 2023-01-27 20:50 UTC, lasting 1 h 36 min. A GraphQL-layer error caused sensors and runs using the k8s\_job\_executor to fail; a fix was implemented and the incident was resolved. _(machine-written, sol)_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2023-01-27 19:14 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/630cmyvc28tp](https://stspg.io/630cmyvc28tp)
- [Company: Dagster](https://rewindex.com/company/dagster.md)
- Versions: before (none: first archived) → after incident\_version:141/775gg4pvxhv1@185397820716
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Dagster Cloud sensors and runs failing
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2023-01-27 19:14 UTC
```

**5. Added: Resolved time**

```diff
+ 2023-01-27 20:50 UTC
```

**6. Added: Affected components**

```diff
+ API
```

**7. Added: Update** (investigating) · 2023-01-27 19:14 UTC

```diff
+ We are investigating a failure at the graphql layer that is causing runs to fail.
```

**8. Added: Update** (investigating) · 2023-01-27 19:14 UTC

```diff
+ We are continuing to investigate this issue.
```

**9. Added: Update** (identified) · 2023-01-27 19:40 UTC

```diff
+ An error in the graphql layer is causing sensors and runs using the k8s_job_executor to fail
```

**10. Added: Update** (monitoring) · 2023-01-27 20:32 UTC

```diff
+ A fix has been implemented and we are monitoring the results.
```

**11. Added: Update** (resolved) · 2023-01-27 20:50 UTC

```diff
+ This incident has been resolved.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2023-01-27 19:14 UTC | Major incident: Dagster Cloud sensors and runs failing (this change) | outage |

All Dagster changes: [timeline](https://rewindex.com/company/dagster/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i32ca501733ba07 · Markdown: https://rewindex.com/change/i32ca501733ba07.md · JSON: https://rewindex.com/api/v1/changes/i32ca501733ba07 · Generated 2026-10-18T02:54:45.438Z