Rewindex

ChangesLightstep (ServiceNow Cloud Observability)Lightstep experience major issues with web UI, query and ingest.

Lightstep (ServiceNow Cloud Observability): Critical incident: Lightstep experience major issues with web UI, query and ingest.

Major incidentcritical (vendor)Changed Detected stspg.io (opens in new tab)
Summary

Summary pending. The diff below shows exactly what changed.

Incident page: the full timeline of updates

What changed

Struck in red is what Lightstep (ServiceNow Cloud Observability) removed; blue is what they added. Muted text is unchanged context.

AddedTitle#1
Before: not present
After: Lightstep experience major issues with web UI, query and ingest.
AddedImpact#2
Before: not present
After: critical
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2023-07-11 03:21 UTC
AddedResolved time#5
Before: not present
After: 2023-07-11 12:48 UTC
AddedAffected components#6
Before: not present
After: Observability - Alerting - Metric alerting, Observability - Alerting - Trace alerting, Observability - API, Observability - Data Ingestion - Metrics, Observability - Data Ingestion - Trace Assembly, Observability - Data Ingestion - Trace Statistics, Observability - Third-Party Notification Methods - PagerDuty Events API, Observability - Third-Party Notification Methods - Slack Apps/Integrations, Observability - Third-Party Notification Methods - Slack Connections, Observability - Third-Party Notification Methods - Slack Messaging, Observability - Web UI - Change Intelligence, Observability - Web UI - Dashboards, Observability - Web UI - Explorer, Observability - Web UI - Notebooks, Observability - Web UI - Service Directory, PagerDuty Events API, Slack Apps/Integrations, Slack Connections, Slack Messaging, US - Change Intelligence, US - Dashboards, US - Explorer, US - Metrics, US - Notebooks, US - Observability - API, US - Service Directory, US - Streams Alerting, US - Trace Assembly, US - Trace Statistics, US - Unified Alerting
AddedUpdateinvestigating#7
Before: not present
After: We are currently investigating this issue.
AddedUpdateinvestigating#8
Before: not present
After: We are continuing to investigate this issue.
AddedUpdateinvestigating#9
Before: not present
After: We are continuing to investigate this issue.
AddedUpdateinvestigating#10
Before: not present
After: Ingest of all data is currently recovering. The web UI is back up. Queries should be working.
AddedUpdateinvestigating#11
Before: not present
After: Most services should be operating normal. There may still be issues with alerting. We continue to investigate.
AddedUpdateinvestigating#12
Before: not present
After: We are continuing to investigate this issue. There has been a regression.
AddedUpdatemonitoring#13
Before: not present
After: A fix has been implemented and we are monitoring the results.
AddedUpdateresolved#14
Before: not present
After: This incident has been resolved.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

Tuesday, July 11, 2023

1 incident change

All Lightstep (ServiceNow Cloud Observability) changesLightstep (ServiceNow Cloud Observability) profileMarkdownJSON