ChangesHarnessSEI 2.0 dashboards are not loading
Harness: Major incident: SEI 2.0 dashboards are not loading
Summary
Summary pending. The diff below shows exactly what changed.
Incident page: the full timeline of updates
What changed
Struck in red is what Harness removed; blue is what they added. Muted text is unchanged context.
Before: not present
After: SEI 2.0 dashboards are not loading
Before: not present
After: major
Before: not present
After: postmortem
Before: not present
After: 2026-08-06 14:30 UTC
Before: not present
After: 2026-08-06 16:01 UTC
Before: not present
After: Prod 1 - Software Engineering Insights (SEI) /AI DLC Insights, Prod 2 - Software Engineering Insights (SEI) / AI DLC Insights, Prod 3 - Software Engineering Insights (SEI) / AI DLC Insights, Prod 6 - Software Engineering Insights (SEI) /AI DLC Insights, Prod Eu 1 - Software Engineering Insights (SEI) / AI DLC Insights, Software Engineering Insights (SEI) / AI DLC Insights, Software Engineering Insights (SEI) /AI DLC Insights
Before: not present
After: We are currently investigating a Harness component that is experiencing issues. We are working to identify the cause and restore normal operations as soon as possible.
Before: not present
After: We are continuing to investigate this issue.
Before: not present
After: The issue has been identified and a fix is being implemented.
Before: not present
After: This incident has been resolved.
Before: not present
After: ## Summary
Customers on Prod1, Prod2, and Prod3 \(US\) clusters experienced failures when loading SEI 2.0 dashboards on August 6, 2026, from 7:22 AM PDT to 9:03 AM PDT. Customers calling the SEI 2.0 API also experienced similar failures.
No customer data was lost, and ingestion of all integration data continued to work uninterrupted. SEI customers using 1.0 were not impacted.
## Root Cause
The incident was caused by resource exhaustion on the nodes serving queries. This resource degradation developed in a pattern that did not cross our existing alerting thresholds early enough to provide sufficient warning or allow mitigation before customer impact occurred.
## Impact
Customers on Prod1, Prod2, and Prod3 \(US\) clusters were unable to load SEI 2.0 dashboards during the incident window.
**Duration:** August 6, 2026, 7:22 AM PDT – 9:03 AM PDT \(~1 hour 41 minutes\)
### What was not impacted?
* Data ingestion and processing
* SEI 1.0 customers
* Integrations and metadata flows
No customer data was lost.
## Remediation
Upon identifying the root cause, our team took immediate corrective action by adding capacity to restore the affected systems. Services were fully recovered, and all dashboards resumed normal operation at 9:03 AM PDT.
## Action Items
To prevent from such issues happening again, Harness is/has
Proactively added capacity updates have been applied to prevent this issue from recurring
#### Enhanced Monitoring and Alerting
Additional monitoring and alerting have been put in place to detect anomalies early, focused on a leading indicator, which in this case was thread pool exhaustion, before they can impact dashboard availability and data rendering.
#### System Patch in Progress
We are working with our vendor to apply a patch to remediate this and similar issues completely.
First version of this incident archived by Rewindex. View the live incident (opens in new tab).
History of this incident
Thursday, August 6
1 incident change
- MajorMajor incident
SEI 2.0 dashboards are not loadingthis change