Companies / Wasabi / incidents
Wasabi: System Errors in US-WEST-1 Region
Wasabi reported a major incident in US-West-1 (Oregon), degrading performance and affecting customers’ S3 API calls. It started at 2024-09-25 13:51 UTC and was resolved at 2024-09-25 15:22 UTC (duration: 1 h 30 min). The postmortem attributed it to an upgrade misconfiguration that falsely marked a service ready; Operations corrected the issue.
Machine-written from the archived incident (Sol). Check the timeline before relying on it.
Affected components: US-West-1 (Oregon)
Timeline of updates
- investigating
We are currently investigating system errors occurring in our US-WEST-1 region.
- investigating
We are continuing to investigate this issue.
- identified
Our Operations Team has identified the issue and is working to correct the system errors.
- monitoring
Our Operations Team has corrected the issue, and the US-WEST-1 region is back in an operational state. We will continue to monitor the region.
- investigating
We are continuing to investigate this issue.
- resolved
This incident is now resolved. Please reach out to support@wasabi.com if you continue to see any errors related to this incident.
- postmortem
From 2024-09-25 13:49 UTC to 2024-09-25 13:54 UTC, an incident occurred in the Hillsboro region, resulting in performance degradation for customers and impacting their ability to make S3 API calls against buckets in the region. During an upgrade to the region, the Operations team encountered an issue where a misconfiguration caused a service to falsely report as ready for operation. This resulted in service readiness failures and triggered failures within the region. To address the situation, the Operations Team corrected the misconfiguration and restarted the affected service. By 13:54 UTC, the S3 service in the US-WEST-1 region was fully restored, and normal operations resumed.
Rewindex changes for this incident
- Major incident: System Errors in US-WEST-1 Region 2024-09-25 13:51 UTC
Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Wasabi profile · Recent Wasabi incidents · Markdown · JSON