# Lightstep (ServiceNow Cloud Observability): Lightstep experience major issues with web UI, query and ingest.

- Impact (vendor’s label): critical
- Status: resolved
- Started: 2023-07-11 03:21 UTC · Resolved: 2023-07-11 12:48 UTC · Duration: 9.5 h
- Updates: 8 · Affected components: Observability - Data Ingestion - Trace Statistics, US - Trace Statistics, Observability - Third-Party Notification Methods - Slack Messaging, Slack Messaging, Observability - Third-Party Notification Methods - Slack Connections, Slack Connections, Observability - Web UI - Dashboards, US - Dashboards, Observability - API, US - Observability - API, Observability - Data Ingestion - Metrics, US - Metrics, Observability - Web UI - Service Directory, US - Service Directory, Observability - Web UI - Notebooks, US - Notebooks, Observability - Third-Party Notification Methods - Slack Apps/Integrations, Slack Apps/Integrations, Observability - Third-Party Notification Methods - PagerDuty Events API, PagerDuty Events API, Observability - Data Ingestion - Trace Assembly, US - Trace Assembly, Observability - Web UI - Explorer, US - Explorer, Observability - Alerting - Metric alerting, US - Unified Alerting, Observability - Alerting - Trace alerting, US - Streams Alerting, Observability - Web UI - Change Intelligence, US - Change Intelligence
- [Vendor status page: https://stspg.io/llvym274ytj6](https://stspg.io/llvym274ytj6)
- [Company: Lightstep (ServiceNow Cloud Observability)](https://rewindex.com/company/lightstep.md)

## Timeline of updates

- **investigating** 2023-07-11 01:20 UTC: We are currently investigating this issue.
- **investigating** 2023-07-11 01:46 UTC: We are continuing to investigate this issue.
- **investigating** 2023-07-11 02:09 UTC: We are continuing to investigate this issue.
- **investigating** 2023-07-11 02:10 UTC: Ingest of all data is currently recovering. The web UI is back up.  Queries should be working.
- **investigating** 2023-07-11 03:21 UTC: Most services should be operating normal. There may still be issues with alerting. We continue to investigate.
- **investigating** 2023-07-11 04:31 UTC: We are continuing to investigate this issue. There has been a regression.
- **monitoring** 2023-07-11 05:12 UTC: A fix has been implemented and we are monitoring the results.
- **resolved** 2023-07-11 12:48 UTC: This incident has been resolved.

## Rewindex changes for this incident

- 2023-07-11 03:21 UTC: [Critical incident: Lightstep experience major issues with web UI, query and ingest.](https://rewindex.com/change/ica6b33f8b3972a.md)


---
Canonical: https://rewindex.com/company/lightstep/incidents/sp2rgdsgy0r7 · Markdown: https://rewindex.com/company/lightstep/incidents/sp2rgdsgy0r7.md · JSON: https://rewindex.com/api/v1/companies/lightstep/incidents/sp2rgdsgy0r7 · Generated 2026-10-20T00:05:12.791Z
