Companies / Pusher / incidents

Pusher: We are experiencing a major outage in our US2 cluster

Impact: criticalStatus: resolvedStarted Resolved (5.1 h)7 updatesSource: stspg.io (opens in new tab)
Summary

Pusher’s critical US2 outage affected most traffic, including Channels presence channels, REST API, Webhooks and WebSocket client API. It started at 2024-09-08 18:00 UTC and was resolved at 2024-09-08 23:06 UTC, lasting 5 h 5 min. Pusher reported deploying a fix and restoring services; no cause was specified.

Machine-written from the archived incident (Sol). Check the timeline before relying on it.

Affected components: Channels REST APIChannels WebhooksChannels presence channelsChannels WebSocket client API

Timeline of updates

  1. investigating

    We are investigating what is causing the issue to our US cluster.

  2. investigating

    We are escalating the current issue from a partial outage to a major outage. The majority of traffic in the US2 cluster is currently affected. Our team is fully engaged and working to resolve the issue.

  3. investigating

    Our team is still investigating the issue within our infrastructure that is preventing us from adding WebSocket capacity to the US2 cluster. This issue is specifically impacting our WebSocket deployments. The majority of clients are currently unable to connect using WebSocket. However fallback mechanisms (SockJS, HTTP streaming, and HTTP polling) are available for connection if they are not disabled in your configuration.

  4. monitoring

    The team has been able to identify the issue and push a fix. We are seeing a full recovery of the services. We will continue to monitor.

  5. monitoring

    A fix has been implemented, and we are monitoring the results. WebSocket connections should now be functional.

  6. monitoring

    We are continuing to monitor for any further issues.

  7. resolved

    This incident has been resolved.

Rewindex changes for this incident

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Pusher profile · Recent Pusher incidents · Markdown · JSON