Companies / Wasabi / incidents

Wasabi: Degraded performance in the EU-West-2 (Paris) region

Affected components: EU-West-2 (Paris)

Timeline of updates

1. investigating2024-11-17 00:06 UTC

   We are currently investigating degraded performance in the EU-West-2 (Paris) region

2. investigating2024-11-17 00:48 UTC

   Our Operations team continues to work with the network traffic team to isolate the problem, we will update this page with more information soon

3. monitoring2024-11-17 01:21 UTC

   We have identified the issue and are making changes to address the traffic. We are continuing to monitor the system as well

4. resolved2024-11-17 02:14 UTC

   This incident is now resolved.

5. postmortem2024-12-06 11:32 UTC

   On Sunday 17 November at approximately 00:14 UTC, an incident occurred in the eu-central-2 \(Paris\) region, resulting in elevated HTTP 5XX error responses and slow response times to buckets impacting some customers. During an upgrade to the region, an error caused the service to allocate more connections than needed resulting in an overload to one of the service components. This caused an increase in errors returned to a subset of customer buckets which were served by this component. To address the situation, the Operations Team reverted the update to restore service.  By 15:11 UTC on 17 November 2024 service in the eu-central-2 region was fully restored to normal operational status.  The error was corrected and the update was  subsequently re-deployed successfully.

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Wasabi profile · Recent Wasabi incidents · Markdown · JSON