Search

Companies / Dagster / incidents

Dagster: Some Dagster Cloud API Requests failing with an Internal Server Error

Impact: majorStatus: resolvedStarted Resolved (4.4 h)4 updatesSource: stspg.io (opens in new tab)
Summary

Some Dagster Cloud API requests and a small number of runs failed with Internal Server Error exceptions due to a storage-engine timeout. The vendor rated the incident major; it ran from 2024-04-11 17:02 UTC to 2024-04-11 21:25 UTC, lasting 4 h 23 min. A fix was implemented and the incident resolved.

Machine-written from the archived incident (Sol). Check the timeline before relying on it.

Affected components: API

Timeline of updates

  1. identified

    Starting earlier this week, a small number of runs in Dagster Cloud started failing with an Internal Server Error exception due to a timeout in our storage engine. We've identified the source of the problem and are in the process of rolling out a fix.

  2. identified

    We are continuing to work on a fix for this issue.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

Rewindex changes for this incident

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Dagster profile · Recent Dagster incidents · Markdown · JSON