# Wasabi: Major incident: System Errors in US-WEST-1 Region

**Summary:** Wasabi reported a major incident in US-West-1 (Oregon), degrading performance and affecting customers’ S3 API calls. It started at 2024-09-25 13:51 UTC and was resolved at 2024-09-25 15:22 UTC (duration: 1 h 30 min). The postmortem attributed it to an upgrade misconfiguration that falsely marked a service ready; Operations corrected the issue. _(machine-written, sol)_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2024-09-25 13:51 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/870fzqtlfbpf](https://stspg.io/870fzqtlfbpf)
- [Company: Wasabi](https://rewindex.com/company/wasabi.md)
- Versions: before (none: first archived) → after incident\_version:88/rrm3bvxb6l3j@d9f8637dd24a
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ System Errors in US-WEST-1 Region
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ postmortem
```

**4. Added: Start time**

```diff
+ 2024-09-25 13:51 UTC
```

**5. Added: Resolved time**

```diff
+ 2024-09-25 15:22 UTC
```

**6. Added: Affected components**

```diff
+ US-West-1 (Oregon)
```

**7. Added: Update** (investigating) · 2024-09-25 13:51 UTC

```diff
+ We are currently investigating system errors occurring in our US-WEST-1 region.
```

**8. Added: Update** (investigating) · 2024-09-25 13:52 UTC

```diff
+ We are continuing to investigate this issue.
```

**9. Added: Update** (identified) · 2024-09-25 13:56 UTC

```diff
+ Our Operations Team has identified the issue and is working to correct the system errors.
```

**10. Added: Update** (monitoring) · 2024-09-25 14:04 UTC

```diff
+ Our Operations Team has corrected the issue, and the US-WEST-1 region is back in an operational state. We will continue to monitor the region.
```

**11. Added: Update** (investigating) · 2024-09-25 15:20 UTC

```diff
+ We are continuing to investigate this issue.
```

**12. Added: Update** (resolved) · 2024-09-25 15:22 UTC

```diff
+ This incident is now resolved. Please reach out to support@wasabi.com if you continue to see any errors related to this incident.
```

**13. Added: Update** (postmortem) · 2024-09-27 18:04 UTC

```diff
+ From 2024-09-25 13:49 UTC to 2024-09-25 13:54 UTC, an incident occurred in the Hillsboro region, resulting in performance degradation for customers and impacting their ability to make S3 API calls against buckets in the region.  During an upgrade to the region, the Operations team encountered an issue where a misconfiguration caused a service to falsely report as ready for operation. This resulted in service readiness failures and triggered failures within the region. To address the situation, the Operations Team corrected the misconfiguration and restarted the affected service.  By 13:54 UTC, the S3 service in the US-WEST-1 region was fully restored, and normal operations resumed.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2024-09-25 13:51 UTC | Major incident: System Errors in US-WEST-1 Region (this change) | outage |

All Wasabi changes: [timeline](https://rewindex.com/company/wasabi/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i41eb0fe65569e3 · Markdown: https://rewindex.com/change/i41eb0fe65569e3.md · JSON: https://rewindex.com/api/v1/changes/i41eb0fe65569e3 · Generated 2026-10-18T01:30:05.386Z