# Omni Analytics: Major incident: Degraded Performance

**Summary:** Omni Analytics reported major degraded performance in EastUsa, with most queries failing to complete. The incident ran from 2024-04-09 18:44 UTC to 2024-04-10 01:04 UTC (6 h 19 min). Queries against a specific database type exhausted memory, repeatedly crashing querying until cancelled; Omni identified a fix for release that day and later marked the incident resolved. _(machine-written, sol)_
- Kind: Major incident · Label: outage (model (Jev))
- Changed: 2024-04-09 18:44 UTC · Detected: 2026-10-17 18:22 UTC
- [Source: https://stspg.io/fkb4n0x20cvt](https://stspg.io/fkb4n0x20cvt)
- [Company: Omni Analytics](https://rewindex.com/company/omni-analytics.md)
- Versions: before (none: first archived) → after incident\_version:74/tr0lnytg9sp6@90c645f2e96a
- Change 1 of 1 for this incident

## What changed

**1. Added: Title**

```diff
+ Degraded Performance
```

**2. Added: Impact**

```diff
+ major
```

**3. Added: Status**

```diff
+ resolved
```

**4. Added: Start time**

```diff
+ 2024-04-09 18:44 UTC
```

**5. Added: Resolved time**

```diff
+ 2024-04-10 01:04 UTC
```

**6. Added: Affected components**

```diff
+ EastUsa
```

**7. Added: Update** (investigating) · 2024-04-09 18:44 UTC

```diff
+ We are seeing elevated error rates.  Investigating...
```

**8. Added: Update** (investigating) · 2024-04-09 18:45 UTC

```diff
+ We are continuing to investigate this issue.
```

**9. Added: Update** (monitoring) · 2024-04-09 19:10 UTC

```diff
+ The application is currently stable and we believe we have identified the cause.
```

**10. Added: Update** (monitoring) · 2024-04-09 20:00 UTC

```diff
+ From 11:39am to 11:52am Pacific Time the majority of queries run in Omni failed to complete. Our engineers have traced the issue back to a problematic set of queries against a specific database type that overflowed the memory available to our infrastructure, causing our querying system to crash repeatedly until the queries were cancelled. We have identified a fix that will be released today.
```

**11. Added: Update** (resolved) · 2024-04-10 01:04 UTC

```diff
+ This incident has been resolved.
```

## History of this incident

| When (UTC) | Change | Label |
| --- | --- | --- |
| 2024-04-09 18:44 UTC | Major incident: Degraded Performance (this change) | outage |

All Omni Analytics changes: [timeline](https://rewindex.com/company/omni-analytics/changes.md)
_Diff excerpts are shown on normalized text: dates, counters and tokens appear as ‹date›, ‹count›, ‹tok›; noise-only edits are hidden. Rewindex shows the changed passages, not a copy of the page._


---
Canonical: https://rewindex.com/change/i16f2e0fafb0293 · Markdown: https://rewindex.com/change/i16f2e0fafb0293.md · JSON: https://rewindex.com/api/v1/changes/i16f2e0fafb0293 · Generated 2026-10-18T03:31:45.911Z