Companies / Wasabi / incidents

Wasabi: System Errors in EU-SOUTH-1 Region

Affected components: EU-South-1 (Milan)

Timeline of updates

1. investigating2025-01-10 16:30 UTC

   We are currently investigating issues in our EU-SOUTH-1 (Milan) region.

2. monitoring2025-01-10 16:51 UTC

   We have identified and corrected the issue, and our EU-SOUTH-1 (Milan) region is now back to a fully operational state. We will continue to monitor the region.

3. resolved2025-01-10 18:03 UTC

   This incident has been resolved.

4. postmortem2025-01-15 20:01 UTC

   On 10 January 2024 from 15:57 UTC to 16:45 UTC, we experienced an issue where clients received 4XX level errors while accessing the S3 buckets in the eu-south-1 \(Milan\) region.   During an internal configuration change, a software bug caused the invalidation of TLS certificates used by internal servers to establish mutual TLS handshakes with load balancers. Consequently, the load balancers could not successfully connect to the internal servers, leading to 4XX errors returned to client requests. Wasabi’s Engineering and Operations teams identified the issue and manually reconfigured the TLS certificates to restore functionality. A fix was deployed to the eu-south-1 region to address the underlying bug and to prevent this problem from happening again.

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Wasabi profile · Recent Wasabi incidents · Markdown · JSON