Changes / LogRocket / Performance issues with primary search database
LogRocket: Major incident: Performance issues with primary search database
Summary
Summary pending. The diff below shows exactly what changed.
What changed
Before: not present
After: Performance issues with primary search database
Before: not present
After: major
Before: not present
After: resolved
Before: not present
After: 2023-01-18 15:41 UTC
Before: not present
After: 2023-01-20 14:00 UTC
Before: not present
After: Alerts, Dashboard, Issues, Metrics
Before: not present
After: We are currently investigating an issue impacting our primary search database. Searching for sessions, loading metric charts, issues and alerting are all impacted. Session data collection has not been impacted.
Before: not present
After: We have identified the issue with our database vendor and are working with them to remedy the situation.
Before: not present
After: We are continuing to work with our vendor to resolve the issue with ingesting new data.
Before: not present
After: We are continuing to work with our vendor to resolve the issue.
Before: not present
After: We are continuing to work with our vendor to remedy the situation. Session data collection continues to be unaffected, but secondary indexing that powers search and metrics continues to be delayed.
Before: not present
After: We have restored some indexing to the database but are continuing to fully resolve the situation.
Before: not present
After: We have identified the cause of the issue, applied a fix and have begun processing the backlog of events.
Before: not present
After: We have completed processing of our primary indexing backlog, session filtering and metrics will be mostly up-to-date. Our secondary processing system is currently processing and includes some metrics, issues and alerting.
Before: not present
After: We've seen no additional performance degradation after our mitigation work.
First version of this incident archived by Rewindex. View the live incident.
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Major incident: Performance issues with primary search database (this change) | Major incident |
All LogRocket changes → · LogRocket profile · Markdown · JSON