# Convex: Major incident: elevated latency/errors for a subset of customers

**Summary:** Convex reported major latency/errors for affected deployments starting 2025-10-30 23:43 UTC, resolved 2025-10-31 07:52 UTC after 8 h 8 min. A downstream-provider issue caused an inefficient database table format; Convex reported rewriting it and shedding load, with sporadic availability issues for a small subset of non-pro customers. _(machine-written, sol)_
- Kind: Major incident · Label: degradation (model (Jev))
- Changed: 2025-10-30 23:43 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/rdscq5w0fw83](https://stspg.io/rdscq5w0fw83)
- [Company: Convex](https://rewindex.com/company/convex.md)
- Versions: before (none: first archived) → after incident\_version:140/m3y8mksnq5vg@419cdb2c302f
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ elevated latency/errors for a subset of customers
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2025-10-30 23:43 UTC
```

**5. Added: Resolved time**

```diff
+ 2025-10-31 07:52 UTC
```

**6. Added: Affected components**

```diff
+ Free & Starter, Live Traffic - Database Services, Live Traffic - Function Runtime
```

**7. Added: Update** (identified) · 2025-10-30 23:43 UTC

```diff
+ We're investigating an issue with a database cluster leading to degraded performance and higher error rates for affected deployments.
```

**8. Added: Update** (identified) · 2025-10-30 23:44 UTC

```diff
+ We've restored affected pro deployments. Working on bringing back affected free deployments.
```

**9. Added: Update** (identified) · 2025-10-31 00:25 UTC

```diff
+ we've brought back a subset of free deployments. Continuing to remediate.
```

**10. Added: Update** (identified) · 2025-10-31 03:08 UTC

```diff
+ We're continuing to work on a fix for the issue. Expect another update in ~90 minutes.
```

**11. Added: Update** (monitoring) · 2025-10-31 04:24 UTC

```diff
+ All deployments should be restored. We are monitoring the database to ensure it remains stable.
```

**12. Added: Update** (monitoring) · 2025-10-31 05:59 UTC

```diff
+ There will be sporadic availability issues for a small subset of non-pro customers. We apologize for this impact. There was an issue with a downstream provider which resulted in a database cluster running with an inefficient table format. We're in the process of rewriting this data format but have had to shed load to provide headroom while reoptimizing the database.
```

**13. Added: Update** (monitoring) · 2025-10-31 06:00 UTC

```diff
+ We are continuing to monitor for any further issues.
```

**14. Added: Update** (resolved) · 2025-10-31 07:52 UTC

```diff
+ This incident has been resolved.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2025-10-30 23:43 UTC | Major incident: elevated latency/errors for a subset of customers (this change) | degradation |

All Convex changes: [timeline](https://rewindex.com/company/convex/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/ie118b267e465c5 · Markdown: https://rewindex.com/change/ie118b267e465c5.md · JSON: https://rewindex.com/api/v1/changes/ie118b267e465c5 · Generated 2026-10-18T03:55:52.746Z