Companies/DigitalOcean/Incidents

DigitalOcean: LON1 Networking

Timeline of updates

1. resolved2023-02-02 23:07 UTC

   Impact: minor; From 20:20 - 23:25, we experienced a partial outage of VPC traffic in our LON1 region. This outage was triggered by an underlying bug uncovered by the maintenance activities in https://status.digitalocean.com/incidents/pqsgdmyzyy0k (opens in new tab). Public networking was unaffected, but Load Balancers, Managed Kubernetes Clusters, Managed Databases, App Platform, Functions, and Droplet-to-Droplet traffic flowing via VPC was impacted. We sincerely apologize for the disruption triggered by the maintenance activities we performed. We've successfully run this maintenance in multiple regions without any impact, but going forward, we will ensure the bug discovered here is not present before rolling out the upgrades to the remaining regions. Affected Components: Services - Networking Regions - LON1 Status: resolved 2023-02-03 01:22 UTC - Our Engineering team has confirmed the mitigation was successful and traffic is flowing normally again. Services dependent on VPC traffic were impacted, which include Load Balancers, Managed Databases, Managed Kubernetes Clusters, App Platform, and Functions. We've also confirmed the impact from this outage was triggered by the activities in the maintenance here: https://status.digitalocean.com/incidents/13xcycr2cdy0 (opens in new tab) We're now monitoring and will post an update once we confirm this issue is fully resolved. Affected Components: Services - Networking Regions - LON1 Status: monitoring 2023-02-03 00:04 UTC - Mitigation efforts are now 100% complete and we are seeing restoration of connectivity. We're confirming with multiple Engineering teams that the mitigation was successful and will post an update soon. Affected Components: Services - Networking Regions - LON1 Status: identified 2023-02-02 23:38 UTC - Our Engineering team has identified the root cause of the issue and is now mitigating it. These efforts are approximately 35% complete. We'll continue to post updates. Affected Components: Services - Networking Regions - LON1 Status: identified 2023-02-02 23:31 UTC - Our Engineering team has confirmed impact to Load Balancers, Managed Databases, Managed Kubernetes Clusters, and App Platform. Connectivity directly to Droplets does not appear to be affected. Affected Components: Services - Networking Regions - LON1 Status: investigating 2023-02-02 23:26 UTC - Our Engineering team is currently investigating reports of connectivity issues in our LON1 region. Maintenance is ongoing as per https://status.digitalocean.com/incidents/pqsgdmyzyy0k (opens in new tab) and we are working to determine if the root cause is related to that maintenance. At this time, users may see timeouts and errors when connecting to services in LON1. We'll post an update with further information as soon as possible. Affected Components: Services - Networking Regions - LON1 Status: investigating 2023-02-02 23:07 UTC - Incident Created at: 2023-02-02 23:07 UTC Resolved at: 2023-02-03 01:22 UTC

From DigitalOcean’s published incident history: for incidents before Rewindex began polling this status page, only the final update text is available.

Impact, status and times are the vendor’s own, as last archived. View on status.digitalocean.com (opens in new tab).

DigitalOcean profileRecent DigitalOcean incidentsAll outages on February 2, 2023DigitalOcean in February 2023MarkdownJSON