# Wasabi: System Errors in US-WEST-1 Region

- Impact (vendor’s label): major
- Status: postmortem
- Started: 2024-09-25 13:51 UTC · Resolved: 2024-09-25 15:22 UTC · Duration: 1.5 h
- Updates: 7 · Affected components: US-West-1 (Oregon)
- [Vendor status page: https://stspg.io/870fzqtlfbpf](https://stspg.io/870fzqtlfbpf)
- [Company: Wasabi](https://rewindex.com/company/wasabi.md)

## Summary

Wasabi reported a major incident in US-West-1 (Oregon), degrading performance and affecting customers’ S3 API calls. It started at 2024-09-25 13:51 UTC and was resolved at 2024-09-25 15:22 UTC (duration: 1 h 30 min). The postmortem attributed it to an upgrade misconfiguration that falsely marked a service ready; Operations corrected the issue. _(machine-written, sol)_
## Timeline of updates

- **investigating** 2024-09-25 13:51 UTC: We are currently investigating system errors occurring in our US-WEST-1 region.
- **investigating** 2024-09-25 13:52 UTC: We are continuing to investigate this issue.
- **identified** 2024-09-25 13:56 UTC: Our Operations Team has identified the issue and is working to correct the system errors.
- **monitoring** 2024-09-25 14:04 UTC: Our Operations Team has corrected the issue, and the US-WEST-1 region is back in an operational state. We will continue to monitor the region.
- **investigating** 2024-09-25 15:20 UTC: We are continuing to investigate this issue.
- **resolved** 2024-09-25 15:22 UTC: This incident is now resolved. Please reach out to support@wasabi.com if you continue to see any errors related to this incident.
- **postmortem** 2024-09-27 18:04 UTC: From 2024-09-25 13:49 UTC to 2024-09-25 13:54 UTC, an incident occurred in the Hillsboro region, resulting in performance degradation for customers and impacting their ability to make S3 API calls against buckets in the region.  During an upgrade to the region, the Operations team encountered an issue where a misconfiguration caused a service to falsely report as ready for operation. This resulted in service readiness failures and triggered failures within the region. To address the situation, the Operations Team corrected the misconfiguration and restarted the affected service.  By 13:54 UTC, the S3 service in the US-WEST-1 region was fully restored, and normal operations resumed.

## Rewindex changes for this incident

- 2024-09-25 13:51 UTC: [Major incident: System Errors in US-WEST-1 Region](https://rewindex.com/change/i41eb0fe65569e3.md)


---
Canonical: https://rewindex.com/company/wasabi/incidents/rrm3bvxb6l3j · Markdown: https://rewindex.com/company/wasabi/incidents/rrm3bvxb6l3j.md · JSON: https://rewindex.com/api/v1/companies/wasabi/incidents/rrm3bvxb6l3j · Generated 2026-10-18T10:42:22.394Z