Changes / Dagster / Degraded Run Timeline Performance

Dagster: Major incident: Degraded Run Timeline Performance

Summary

Dagster reported major degradation of the Dagster Cloud UI run timeline due to overfetching runs, affecting timeline performance. The incident started at 2024-08-01 19:31 UTC and lasted 1 h 48 min, resolving at 2024-08-01 21:19 UTC; a fix was implemented at 08-01 21:08 UTC.

Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.

Major incidentLabel: degradation (model (Jev), 100%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Degraded Run Timeline Performance
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2024-08-01 19:31 UTC
AddedResolved time#5
Before: not present
After: 2024-08-01 21:19 UTC
AddedAffected components#6
Before: not present
After: Dagster Cloud UI
AddedUpdateidentified#7
Before: not present
After: We've identified an issue with the run timeline UI overfetching runs. We're working on rolling out a fix.
AddedUpdatemonitoring#8
Before: not present
After: A fix has been implemented and we are monitoring the results.
AddedUpdateresolved#9
Before: not present
After: This incident has been resolved.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Degraded Run Timeline Performance (this change)
Dagster reported major degradation of the Dagster Cloud UI run timeline due to overfetching runs, affecting timeline performance. The incident started at 2024-08-01 19:31 UTC and lasted 1 h 48 min, resolving at 2024-08-01 21:19 UTC; a fix was implemented at 08-01 21:08 UTC.
Major incident

All Dagster changes → · Dagster profile · Markdown · JSON