Companies / Omni Analytics / incidents
Omni Analytics: Degraded Performance
Omni Analytics reported major degraded performance in EastUsa, with most queries failing to complete. The incident ran from 2024-04-09 18:44 UTC to 2024-04-10 01:04 UTC (6 h 19 min). Queries against a specific database type exhausted memory, repeatedly crashing querying until cancelled; Omni identified a fix for release that day and later marked the incident resolved.
Machine-written from the archived incident (Sol). Check the timeline before relying on it.
Affected components: EastUsa
Timeline of updates
- investigating
We are seeing elevated error rates. Investigating...
- investigating
We are continuing to investigate this issue.
- monitoring
The application is currently stable and we believe we have identified the cause.
- monitoring
From 11:39am to 11:52am Pacific Time the majority of queries run in Omni failed to complete. Our engineers have traced the issue back to a problematic set of queries against a specific database type that overflowed the memory available to our infrastructure, causing our querying system to crash repeatedly until the queries were cancelled. We have identified a fix that will be released today.
- resolved
This incident has been resolved.
Rewindex changes for this incident
- Major incident: Degraded Performance 2024-04-09 18:44 UTC
Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Omni Analytics profile · Recent Omni Analytics incidents · Markdown · JSON