Changes / Census / IP Address Change for Database Requests
Census: Critical incident: IP Address Change for Database Requests
Summary
Census reported a critical Sync Engine outage starting 2025-01-30 02:59 UTC: a networking misconfiguration sent database requests from unadvertised IPs, causing syncs to fail for customers whose databases rejected those IPs. Census rolled back to a previous configuration and resolved the incident at 2025-01-30 03:31 UTC; the reported duration was 31 min.
Machine-written from the diff below (Sol; type: incident outage). Check the diff before relying on it.
What changed
Before: not present
After: IP Address Change for Database Requests
Before: not present
After: critical
Before: not present
After: resolved
Before: not present
After: 2025-01-30 02:59 UTC
Before: not present
After: 2025-01-30 03:31 UTC
Before: not present
After: Sync Engine
Before: not present
After: Due to a networking misconfiguration, requests originating from Census's database access service are originating from IPs that we have not previously advertised. If your database is configured to reject requests that are not from Census' IP addresses, syncs will start failing.
We are investigating the root cause of the issue and it is our intent to restore service from the original IP addresses; we do not expect customers to need to reconfigure their databases at this time. More updates will be posted here.
Before: not present
After: We have identified the root cause and are applying a fix to the networking configuration.
Before: not present
After: We have rolled back the service to a previous configuration and we are monitoring our system to ensure database / warehouse connectivity returns to normal levels.
Before: not present
After: This incident has been resolved.
First version of this incident archived by Rewindex. View the live incident (opens in new tab).
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Critical incident: IP Address Change for Database Requests (this change) Census reported a critical Sync Engine outage starting 2025-01-30 02:59 UTC: a networking misconfiguration sent database requests from unadvertised IPs, causing syncs to fail for customers whose databases rejected those IPs. Census rolled back to a previous configuration and resolved the incident at 2025-01-30 03:31 UTC; the reported duration was 31 min. | Major incident |