Search

Companies / Census / incidents

Census: Sync Alerts missing as of last 2 days

Impact: majorStatus: resolvedStarted Resolved (2.6 h)3 updatesSource: stspg.io (opens in new tab)
Summary

Census reported a major Sync Engine outage from 2024-09-20 20:18 UTC to 2024-09-20 22:55 UTC (2 h 37 min). Sync Alerts had been deleted from its database, preventing email alerts for qualifying sync runs over the prior two days. Alert data was restored, and Census said alerting should work again going forward.

Machine-written from the archived incident (Sol). Check the timeline before relying on it.

Affected components: Sync Engine

Timeline of updates

  1. identified

    Sync Alerts were deleted from our database in the last 2 days. The cause has been identified, and we are working on restoring the deleted alerts.

  2. identified

    As part of this incident, any sync runs that should have triggered an alert in the last 2 days would not have resulted in an email alert. Once we restore the alert data, any sync runs that fail will trigger an alert, even though the sync may have been failing for the last 2 days. In very rare cases, we may email you at most twice about a failure as we perform the recovery process.

  3. resolved

    Sync Alert data has been restored. Sync alerting should work again for any syncs that trigger alerts moving forward.

Rewindex changes for this incident

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Census profile · Recent Census incidents · Markdown · JSON