Changes / Travis CI / Unreliable or intermittent network connectivity for Linux and Windows builds
Travis CI: Major incident: Unreliable or intermittent network connectivity for Linux and Windows builds
Summary
Travis CI reported a major degradation causing unreliable, intermittent or slow network connectivity for Linux and Windows builds from 2019-08-06 17:55 UTC to 2019-08-07 14:40 UTC, lasting 20 h 45 min. The vendor identified NAT gateway updates as the issue and fully reverted them, restoring normal build network performance and reliability.
Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.
Major incidentLabel: degradation (model (Jev), 100%)Changed Detected Source: stspg.io (opens in new tab)
What changed
Before: not present
After: Unreliable or intermittent network connectivity for Linux and Windows builds
Before: not present
After: major
Before: not present
After: resolved
Before: not present
After: 2019-08-06 17:55 UTC
Before: not present
After: 2019-08-07 14:40 UTC
Before: not present
After: Builds Processing - Linux and Windows Builds, Linux and Windows Builds
Before: not present
After: We are receiving reports of Linux and Windows builds where network connectivity is unreliable, intermittently working or slow. We are opening this incident to acknowledge the issue and also keep you posted on our work to solve it. Thank you for your patience.
Before: not present
After: We are continuing to investigate this issue.
Before: not present
After: We've identified an issue with the latest changes to update the NAT gateways. While this change was meant to improve maintainability, we are rolling it back due to the degraded network performance. We're expecting this provides network speed improvements within the next hour. We will provide additional updates at the top of the hour. Thank you
Before: not present
After: At this point, we've reverted half of the NAT gateway updates and a 50% of the Linux and Windows jobs currently processed have better network performance already. We'll provide another update as soon as this process is complete. Thanks for your patience.
Before: not present
After: The NAT gateway changes have been fully reverted. Network performance and reliability in your builds should be back to normal. We’ll be monitoring for a short while before closing this incident.
Before: not present
After: This incident has been resolved.
First version of this incident archived by Rewindex. View the live incident (opens in new tab).
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Major incident: Unreliable or intermittent network connectivity for Linux and Windows builds (this change) Travis CI reported a major degradation causing unreliable, intermittent or slow network connectivity for Linux and Windows builds from 2019-08-06 17:55 UTC to 2019-08-07 14:40 UTC, lasting 20 h 45 min. The vendor identified NAT gateway updates as the issue and fully reverted them, restoring normal build network performance and reliability. | Major incident |
All Travis CI changes → · Travis CI profile · Markdown · JSON