Changes / Dagster / Dagster Cloud sensors and runs failing
Dagster: Major incident: Dagster Cloud sensors and runs failing
Summary
Dagster Cloud reported a major API incident from 2023-01-27 19:14 UTC to 2023-01-27 20:50 UTC, lasting 1 h 36 min. A GraphQL-layer error caused sensors and runs using the k8s_job_executor to fail; a fix was implemented and the incident was resolved.
Machine-written from the diff below (Sol; type: incident outage). Check the diff before relying on it.
What changed
Before: not present
After: Dagster Cloud sensors and runs failing
Before: not present
After: major
Before: not present
After: resolved
Before: not present
After: 2023-01-27 19:14 UTC
Before: not present
After: 2023-01-27 20:50 UTC
Before: not present
After: API
Before: not present
After: We are investigating a failure at the graphql layer that is causing runs to fail.
Before: not present
After: We are continuing to investigate this issue.
Before: not present
After: An error in the graphql layer is causing sensors and runs using the k8s_job_executor to fail
Before: not present
After: A fix has been implemented and we are monitoring the results.
Before: not present
After: This incident has been resolved.
First version of this incident archived by Rewindex. View the live incident (opens in new tab).
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Major incident: Dagster Cloud sensors and runs failing (this change) Dagster Cloud reported a major API incident from 2023-01-27 19:14 UTC to 2023-01-27 20:50 UTC, lasting 1 h 36 min. A GraphQL-layer error caused sensors and runs using the k8s_job_executor to fail; a fix was implemented and the incident was resolved. | Major incident |