Search

Companies / Omni Analytics / incidents

Omni Analytics: Omni pages not accessible

Impact: criticalStatus: resolvedStarted Resolved (1.3 h)4 updatesSource: stspg.io (opens in new tab)
Summary

Omni Analytics pages in EastUsa were inaccessible during a critical incident from 2025-09-08 17:57 UTC to 2025-09-08 19:15 UTC, lasting 1 h 18 min. A recent code change generated unexpectedly large database queries that saturated CPU resources, causing query timeouts and connection failures; Omni reverted the change and resolved the incident.

Machine-written from the archived incident (Sol). Check the timeline before relying on it.

Affected components: EastUsa

Timeline of updates

  1. investigating

    Our monitoring picked up a spike in errors and we have begun getting reports from users. The team is investigating on highest priority

  2. identified

    We have identified the source of the issue and are in the process of rapidly reverting a change to resolve.

  3. identified

    We have completed rolling out the mitigation for this incident and are now in the monitoring phase.

  4. resolved

    We are now considering this incident resolved. A recent code change generated unexpectedly large database queries that saturated CPU resources, leading to query timeouts and subsequent connection failures. We initiated a rapid rollback once the cause was identified. Since mitigating we have reverted the change and are working to prevent similar issues in the future.

Rewindex changes for this incident

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Omni Analytics profile · Recent Omni Analytics incidents · Markdown · JSON