Pipedream: Timer-based triggers not running

Impact: majorStatus: resolvedStarted 2023-11-03 21:49 UTCResolved 2023-11-03 22:00 UTC (11 min)3 updatesSource: stspg.io

Summary

Timer-based triggers, including Scheduler and scheduled app triggers, stopped around 21:30 UTC, affecting v1 workflows but not v2. Pipedream classified the outage as major, logged its start at 2023-11-03 21:49 UTC, and resolved it at 2023-11-03 22:00 UTC (computed duration: 10 min) after reverting code that introduced the bug.

Machine-written from the archived incident (Sol). Check the timeline before relying on it.

Affected components: Backend - Workflows - TimerWorkflows - TimerBackend - Event Sources - TimerEvent Sources - Timer

Timeline of updates

investigating2023-11-03 21:49 UTC
Timer-based triggers — like the Scheduler trigger, and other app-based triggers that run on a schedule — stopped running around 21:30 UTC. Our team is investigating and will post updates here.
identified2023-11-03 21:52 UTC
We've reverted the code that introduced the bug. This also only affects v1 workflow triggers, not those using v2 (the latest version of workflows).
resolved2023-11-03 22:00 UTC
This incident has been resolved.

Rewindex changes for this incident

Major incident: Timer-based triggers not running 2023-11-03 21:49 UTC

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Pipedream profile · Recent Pipedream incidents · Markdown · JSON