# Omni Analytics: Major incident: Slow Queries

**Summary:** Omni Analytics reported major query degradation in EastUsa from 2024-04-08 16:55 UTC to 2024-04-08 17:05 UTC, lasting 10 min. Queries were slow or delayed because an information-schema query spike after cache expiration triggered a thundering herd, compounded by missing autoscaling logic; the incident was resolved, with autoscaling improvements planned. _(machine-written, sol)_
- Kind: Major incident · Label: degradation (model (Jev))
- Changed: 2024-04-08 16:55 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/xksfh2yjkkv4](https://stspg.io/xksfh2yjkkv4)
- [Company: Omni Analytics](https://rewindex.com/company/omni-analytics.md)
- Versions: before (none: first archived) → after incident\_version:74/xvrf44y9g26t@1c5a917ae1ff
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Slow Queries
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2024-04-08 16:55 UTC
```

**5. Added: Resolved time**

```diff
+ 2024-04-08 17:05 UTC
```

**6. Added: Affected components**

```diff
+ EastUsa
```

**7. Added: Update** (investigating) · 2024-04-08 16:55 UTC

```diff
+ Queries in the EastUsa region are slow and/or delayed.
```

**8. Added: Update** (resolved) · 2024-04-08 17:05 UTC

```diff
+ For approximately 10 minutes starting around 9:55am US/Pacific time, queries in the EastUsa region ran slower than normal.  A spike of queries against an information schema where the cache had expired triggered a thundering herd effect.  That combined with some missing logic in our auto scaling caused queues to back up.  We will be working to address the issue in the auto scaling logic in the next few days and will also work to change our caching logic to avoid any further thundering herd effects.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2024-04-08 16:55 UTC | Major incident: Slow Queries (this change) | degradation |

All Omni Analytics changes: [timeline](https://rewindex.com/company/omni-analytics/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i7c871b8b90996d · Markdown: https://rewindex.com/change/i7c871b8b90996d.md · JSON: https://rewindex.com/api/v1/changes/i7c871b8b90996d · Generated 2026-10-18T02:29:32.472Z
