Changes / Hotjar / Some session data not being ingested

Hotjar: Critical incident: Some session data not being ingested

Summary

Hotjar reported a critical degradation in which some session data was not being ingested, affecting session capture. It started at 2024-06-03 17:24 UTC and was resolved at 2024-06-05 09:22 UTC, lasting 39 h 57 min. Engineers deployed temporary session-capture changes and restored ingestion to regular levels while working with their cloud provider; no root cause was stated.

Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.

Major incidentLabel: degradation (model (Jev), 81%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Some session data not being ingested
AddedImpact#2
Before: not present
After: critical
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2024-06-03 17:24 UTC
AddedResolved time#5
Before: not present
After: 2024-06-05 09:22 UTC
AddedUpdateinvestigating#6
Before: not present
After: We're investigating an issue with session data being ingested. Our engineers are working to fix the issue ASAP and will post updates to status.hotjar.com. Thanks for bearing with us!
AddedUpdateinvestigating#7
Before: not present
After: Our engineers are still actively investigating the problem, and working directly with our cloud provider to help us resolve it. We understand that this is impacting your use of Hotjar, so thank you for bearing with us while we work on a fix.
AddedUpdateinvestigating#8
Before: not present
After: Our engineers have deployed temporary changes to improve session capture handling while they continue to work with our cloud provider to find the root cause of this issue. Thank you for bearing with us while we work on a resolution.
AddedUpdatemonitoring#9
Before: not present
After: Our engineers have returned data ingestion to regular levels and will be monitoring the situation for several hours to ensure there is no regression. Thanks for bearing with us!
AddedUpdateresolved#10
Before: not present
After: This incident is now resolved. Our engineers have resolved the issue with session data ingestion and will continue to work with our cloud provider to ensure continued success. Thanks for bearing with us!

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Critical incident: Some session data not being ingested (this change)
Hotjar reported a critical degradation in which some session data was not being ingested, affecting session capture. It started at 2024-06-03 17:24 UTC and was resolved at 2024-06-05 09:22 UTC, lasting 39 h 57 min. Engineers deployed temporary session-capture changes and restored ingestion to regular levels while working with their cloud provider; no root cause was stated.
Major incident

All Hotjar changes → · Hotjar profile · Markdown · JSON