rewindex

CompaniesCloseIncidents

Close: Application Loading Issue

No impact listedStatus: postmortemStarted Resolved (0 min)2 updatesstspg.io (opens in new tab)

Affected components: Application UIAPI

Timeline of updates

  1. resolved

    API endpoints and application areas backed by Search infrastructure - leads, contacts, opportunities list pages, and certain reporting pages were inaccessible for 20 minutes.

    This has been resolved.

  2. postmortem

    Close sincerely apologizes for the interruption of our service. We take the stability of our platform very seriously. Below is an explanation of what happened and how we will prevent another such interruption from occurring. 

    Impact

    API endpoints and application areas backed by Search infrastructure - leads, contacts, opportunities list pages, and certain reporting pages were inaccessible for 20 minutes.

    Root Cause and Resolution

    As part of an ongoing effort to increase security of Close application, we shipped a change to how authentication is handled between the application and internal search clusters. However, a certain kind of authentication exchange wasn’t handled correctly, which caused most of the requests to Search infrastructure to fail in production.

    We have reverted the change, and will be improving our testing setup to catch these issues during development, as well as deployment and monitoring systems to catch production issues earlier.

    Timeline

    • 10:20 UTC - An engineer rolls out an incorrect change in how authentication handled between application and internal search clusters.
    • 10:21 UTC - Monitoring systems alert on-call engineer
    • 10:33 UTC - The change was reverted
    • 10:40 UTC - The application functionality fully recovered

Archive proof

Rewindex commits each version of an incident it captures to a daily checkpoint, chains it to the day before, and has the checkpoint timestamped by FreeTSA and DigiCert. That proves this record existed by then and has not been changed since, by anyone, Rewindex included.

How the archive is checked, and what it cannot prove.

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab).

Cite this

Status incident (vendor impact label: none) posted by Close, started 2024-05-24 11:13 UTC, resolved after 0 min, 2 update(s).

Title
Application Loading Issue
Vendor
Close
Date
URL
https://rewindex.com/company/close/incidents/qjzb1kpn7llq

Close profileRecent Close incidentsAll outages on May 24, 2024Close in May 2024MarkdownJSON