Search

Companies / Upstash / incidents

Upstash: Performance degradation on QStash

Impact: minorStatus: postmortemStarted Resolved (34 min)4 updatesSource: stspg.io (opens in new tab)

Affected components: EU-CENTRAL-1QStash

Timeline of updates

  1. investigating

    We are currently investigating this issue.

  2. monitoring

    A fix has been implemented and we are monitoring the results.

  3. resolved

    This incident has been resolved.

  4. postmortem

    On 09:43 UTC, QStash experienced degraded service when a high number of requests to a specific domain were throttled, resulting in timeouts during an unexpected phase of the TCP connection establishment. These requests and resulting retries triggered excessive consumption of network resources and negatively impacted all users. We have added more resources to QStash as a quick remediation and as for the resolution, we have improved the timeout mechanism to detect and fail-faster in such cases.

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Upstash profile · Recent Upstash incidents · Markdown · JSON