Changes / Close / Application UI Intermittently Inaccessible

Close: Critical incident: Application UI Intermittently Inaccessible

Summary

Summary pending. The diff below shows exactly what changed.

Major incidentLabel: outage (model (Jev), 84%)Changed Detected Source: stspg.io

What changed

AddedTitle#1
Before: not present
After: Application UI Intermittently Inaccessible
AddedImpact#2
Before: not present
After: critical
AddedStatus#3
Before: not present
After: postmortem
AddedStart time#4
Before: not present
After: 2025-06-19 04:23 UTC
AddedResolved time#5
Before: not present
After: 2025-06-19 05:10 UTC
AddedAffected components#6
Before: not present
After: Application UI
AddedUpdateinvestigating#7
Before: not present
After: Users are currently unable to load the application UI due to an issue with the serving infrastructure.
AddedUpdateinvestigating#8
Before: not present
After: We're continuing to investigate the issue.
AddedUpdatemonitoring#9
Before: not present
After: Application is loading again, we're monitoring the situation.
AddedUpdatemonitoring#10
Before: not present
After: We are continuing to monitor for any further issues.
AddedUpdateresolved#11
Before: not present
After: This incident has been resolved.
AddedUpdatepostmortem#12
Before: not present
After: Close sincerely apologizes for the interruption of our service. We take the stability of our platform very seriously. Below is an explanation of what happened and how we will prevent another such interruption from occurring. ## Impact The Close Web and Desktop applications were intermittently failing to load for from June 18th 22:32 UTC to June 19th 05:10 UTC. The issue started with only a few errors with the frequency gradually increasing until it was resolved. ## Root Cause and Resolution A misconfigured version of the application was partially deployed due to mishandling of failures of a re-run CI/CD job. The issue was resolved by deploying a freshly built version of the application. We are improving our alerting systems to detect such incidents sooner and implementing safeguards into our build process to prevent misconfigured versions from occurring in the first place. ## Timeline * June 18th 22:32 UTC - an already deployed version of the application image gets misconfigured due to an issue in our build system * as time goes on and our infrastructure cycles resources which causes more and more traffic to get served by the misconfigured version, but not often enough to trigger our alerts * June 19th 04:17 UTC - Close Engineering team realizes there’s a problem, begins an investigation and starts taking mitigation steps * June 19th 05:10 UTC - a new version of the application is deployed resolving the issue

First version of this incident archived by Rewindex. View the live incident.

History of this incident

When (UTC)ChangeKind
Critical incident: Application UI Intermittently Inaccessible (this change)Major incident

All Close changes → · Close profile · Markdown · JSON