# Asana: Major incident: We are fully down for a subset of customers. We're investigating the issue, and are rolling back a deployment.

**Summary:** Asana reported a major outage affecting a subset of customers across API, App, Mobile and US components from 2026-09-02 18:08 UTC to 2026-09-02 18:49 UTC (41 min). A deployment rollback restored access; the postmortem attributed failed requests to insufficient cluster capacity after an automatic scaling system stopped replacing capacity removed during maintenance. _(machine-written, sol)_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2026-09-02 18:08 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/9j079t3hxmmt](https://stspg.io/9j079t3hxmmt)
- [Company: Asana](https://rewindex.com/company/asana.md)
- Versions: before (none: first archived) → after incident\_version:90/70ts4fqbblrc@c56e5821ce57
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ We are fully down for a subset of customers. We're investigating the issue, and are rolling back a deployment.
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ postmortem
```

**4. Added: Start time**

```diff
+ 2026-09-02 18:08 UTC
```

**5. Added: Resolved time**

```diff
+ 2026-09-02 18:49 UTC
```

**6. Added: Affected components**

```diff
+ API, App, Mobile, US - API, US - App, US - Mobile
```

**7. Added: Update** (investigating) · 2026-09-02 18:08 UTC

```diff
+ We are currently investigating this issue.
```

**8. Added: Update** (investigating) · 2026-09-02 18:13 UTC

```diff
+ We are continuing to investigate this issue.
```

**9. Added: Update** (investigating) · 2026-09-02 18:14 UTC

```diff
+ The rollback seems to have completely resolved errors. We're monitoring closely, but users should be able to access Asana again.
```

**10. Added: Update** (monitoring) · 2026-09-02 18:14 UTC

```diff
+ A fix has been implemented and we are monitoring the results.
```

**11. Added: Update** (resolved) · 2026-09-02 18:49 UTC

```diff
+ This incident has been resolved.
```

**12. Added: Update** (postmortem) · 2026-09-04 19:52 UTC

```diff
+ Incident: An internal system responsible for automatically scaling backend server capacity in one of our compute clusters stopped replacing capacity that had been cycled out during routine maintenance. This caused a gradual reduction in available capacity over several hours. A subsequent deployment was activated with insufficient capacity, causing all new requests for that compute cluster to fail. To mitigate the impact, we reverted to a previous release revision, which still had sufficient capacity. Impact: For approximately 30 minutes, customers whose traffic was handled by this compute cluster saw full downtime; other customers were unaffected. No customer data was lost. Moving forward: We have added additional monitoring to detect this type of capacity-scaling failure much earlier, and have added safeguards to prevent deployments from shifting traffic before sufficient healthy capacity is confirmed. _Our metric considers a weighted average of uptime experienced by users at each data center. The number of minutes of downtime shown reflects this weighted average._
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2026-09-02 18:08 UTC | Major incident: We are fully down for a subset of customers. We're investigating the issue, and are rolling back a deployment. (this change) | outage |

All Asana changes: [timeline](https://rewindex.com/company/asana/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i137fb04027a3ec · Markdown: https://rewindex.com/change/i137fb04027a3ec.md · JSON: https://rewindex.com/api/v1/changes/i137fb04027a3ec · Generated 2026-10-18T00:38:32.770Z