Search

Companies / Omni Analytics / incidents

Omni Analytics: Error loading pages in Omni - Something went wrong 500:Error

Impact: majorStatus: resolvedStarted Resolved (3.0 h)7 updatesSource: stspg.io (opens in new tab)
Summary

Omni Analytics reported a major EastUsa outage causing page-loading 500 errors and query-processing delays from 2026-02-18 15:05 UTC to 2026-02-18 18:06 UTC, lasting 3 h 1 min. An infrastructure scaling event destabilized the job-processing pipeline; a stuck transaction blocked backend work. Cycling the affected component restored service, and all backlogs cleared.

Machine-written from the archived incident (Sol). Check the timeline before relying on it.

Affected components: EastUsa

Timeline of updates

  1. investigating

    Our monitoring picked up an increase in error rates and we have begun receiving some reports. We are actively investigating and working on mitigation

  2. investigating

    We identified an unhealthy resource in our infrastructure and have applied a mitigation. We are seeing error rates decrease but we are continuing to monitor and investigate.

  3. monitoring

    Error rates have stayed down since our mitigation was implemented. We are continuing to monitor.

  4. investigating

    We are seeing increased application errors and are actively investigating.

  5. identified

    Our team has identified a stuck transaction in our job queue, which was preventing work from being dispatched to our backend workers. We have cycled the affected component and are seeing recovery. Investigation continues and we will provide another update shortly.

  6. monitoring

    Our mitigation efforts appear to be successful and we are seeing active recovery. We have identified the root cause as an infrastructure scaling event that introduced instability into our job processing pipeline. Queue depths are decreasing and we are continuing to monitor closely.

  7. resolved

    This incident has been resolved. Query processing has stabilized, all backlogs have cleared, and we are no longer seeing any errors or delays.

Rewindex changes for this incident

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Omni Analytics profile · Recent Omni Analytics incidents · Markdown · JSON