# Dagster: Major incident: Some asset runs failing with a "GraphQLStorageError: Error in GraphQL Response" error

**Summary:** Some Dagster asset runs failed with GraphQLStorageError errors as storage-engine timeouts increased during execution, affecting the API. The vendor rated the incident major; it ran from 2023-09-06 19:30 UTC to 2023-09-06 23:59 UTC, lasting 4 h 29 min. A fix was implemented and the incident was resolved. _(machine-written, sol)_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2023-09-06 19:30 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/gtj476t1k08m](https://stspg.io/gtj476t1k08m)
- [Company: Dagster](https://rewindex.com/company/dagster.md)
- Versions: before (none: first archived) → after incident\_version:141/2fhnny9w2q0h@cf0a4cfcdfc6
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Some asset runs failing with a "GraphQLStorageError: Error in GraphQL Response" error
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2023-09-06 19:30 UTC
```

**5. Added: Resolved time**

```diff
+ 2023-09-06 23:59 UTC
```

**6. Added: Affected components**

```diff
+ API
```

**7. Added: Update** (investigating) · 2023-09-06 19:30 UTC

```diff
+ We have observed an increase in timeouts from our storage engine during run execution, resulting in some runs failing with an error like the following in the event log: dagster_cloud_cli.core.errors.GraphQLStorageError: Error in GraphQL response: [{'message': 'Internal Server Error (Trace ID: XXX)', 'locations': [{'line': 22, 'column': 13}], 'path': ['eventLogs', 'getEventRecords']}] We are currently investigating the issue.
```

**8. Added: Update** (identified) · 2023-09-06 20:08 UTC

```diff
+ The issue has been identified and we are in the process of testing a fix.
```

**9. Added: Update** (monitoring) · 2023-09-06 22:39 UTC

```diff
+ A fix has been implemented and we are monitoring the results.
```

**10. Added: Update** (resolved) · 2023-09-06 23:59 UTC

```diff
+ This incident has been resolved.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2023-09-06 19:30 UTC | Major incident: Some asset runs failing with a "GraphQLStorageError: Error in GraphQL Response" error (this change) | outage |

All Dagster changes: [timeline](https://rewindex.com/company/dagster/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i5d4cf578b0bb69 · Markdown: https://rewindex.com/change/i5d4cf578b0bb69.md · JSON: https://rewindex.com/api/v1/changes/i5d4cf578b0bb69 · Generated 2026-10-18T03:55:40.674Z