Changes / Gorgias / Message processing has been restored across all affected services

Gorgias: Major incident: Message processing has been restored across all affected services

Summary

Gorgias reported a major degradation delaying incoming messages, channel routing and ecommerce events, caused by an internal messaging broker failure on us-east1-635c. The incident started at 2026-04-17 07:07 UTC and was resolved at 2026-04-17 11:15 UTC, lasting 4 h 8 min; channel queues cleared and ecommerce processing returned to nominal throughput before resolution.

Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.

Major incidentLabel: degradation (model (Jev), 97%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Message processing has been restored across all affected services
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2026-04-17 07:07 UTC
AddedResolved time#5
Before: not present
After: 2026-04-17 11:15 UTC
AddedAffected components#6
Before: not present
After: Helpdesk Clusters - us-east1-635c, Helpdesk Clusters - us-east4-65cd, us-east1-635c
AddedUpdateinvestigating#7
Before: not present
After: New messages are not processed in real time; delayed message routing for channel and ecommerce integrations We are currently investigating this issue.
AddedUpdateinvestigating#8
Before: not present
After: Since 07:02 CEST, customers on cluster us-east1-635c are experiencing delays in incoming messages and ecommerce events not appearing in real-time. This is caused by an internal messaging broker failure on the affected cluster.
AddedUpdateinvestigating#9
Before: not present
After: Our team has investigated and attempted several mitigations, however the issue is still ongoing. We are continuing to actively investigate and will provide an update as soon as we have more information. We apologize for the inconvenience.
AddedUpdatemonitoring#10
Before: not present
After: Channels integrations are fully operational — all queued messages have been processed and are up to date. E-commerce data processing is back to nominal throughput. All queued messages are being processed; full catch-up is expected within ~30 minutes. We will post a final update once e-commerce data is fully up to date. Thank you for your patience.
AddedUpdateresolved#11
Before: not present
After: This incident has been resolved.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Message processing has been restored across all affected services (this change)
Gorgias reported a major degradation delaying incoming messages, channel routing and ecommerce events, caused by an internal messaging broker failure on us-east1-635c. The incident started at 2026-04-17 07:07 UTC and was resolved at 2026-04-17 11:15 UTC, lasting 4 h 8 min; channel queues cleared and ecommerce processing returned to nominal throughput before resolution.
Major incident

All Gorgias changes → · Gorgias profile · Markdown · JSON