Changes / Prefect / Elevated errors and degraded orchestration performance

Prefect: Critical incident: Elevated errors and degraded orchestration performance

Summary

Prefect Cloud (US) experienced a critical incident affecting API requests, UI, and orchestration, with delayed flow run scheduling, automations, and event processing. It started at 2026-07-22 09:31 UTC and was resolved at 2026-07-22 09:58 UTC, lasting 26 min. Prefect reported resolving an underlying database issue; all services, including background processing, returned to normal.

Machine-written from the diff below (Sol; type: incident outage). Check the diff before relying on it.

Major incidentLabel: outage (model (Jev), 99%)Changed Detected Source: status.prefect.io

What changed

AddedTitle#1
Before: not present
After: Elevated errors and degraded orchestration performance
AddedImpact#2
Before: not present
After: critical
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2026-07-22 09:31 UTC
AddedResolved time#5
Before: not present
After: 2026-07-22 09:58 UTC
AddedUpdateinvestigating#6
Before: not present
After: We're investigating elevated errors and degraded orchestration performance affecting Prefect Cloud (US). Some API requests may return errors and flow run scheduling may be delayed. We're actively working to resolve this and will post updates as we learn more.
AddedUpdatemonitoring#7
Before: not present
After: The underlying database issue has been resolved and the system is recovering. API error rates are dropping and flow run scheduling is catching up. Some automations and event processing may remain delayed while a backlog clears.
AddedUpdateresolved#8
Before: not present
After: The issue affecting the Prefect Cloud API and UI has been fully resolved and all services are operating normally, including background processing. We apologize for the disruption.

First version of this incident archived by Rewindex. View the live incident.

History of this incident

When (UTC)ChangeKind
Critical incident: Elevated errors and degraded orchestration performance (this change)
Prefect Cloud (US) experienced a critical incident affecting API requests, UI, and orchestration, with delayed flow run scheduling, automations, and event processing. It started at 2026-07-22 09:31 UTC and was resolved at 2026-07-22 09:58 UTC, lasting 26 min. Prefect reported resolving an underlying database issue; all services, including background processing, returned to normal.
Major incident

All Prefect changes → · Prefect profile · Markdown · JSON