Changes / Travis CI / Internal Mac build errors

Travis CI: Major incident: Internal Mac build errors

Summary

Travis CI reported a major Mac Builds outage from 2020-03-22 16:23 UTC to 2020-03-22 17:12 UTC, lasting 49 min. A portion of Mac infrastructure prevented builds from running correctly, with affected jobs logging "An error occurred while generating the build script." Travis CI removed affected hardware from the executor pool and restored normal Mac build capacity.

Machine-written from the diff below (Sol; type: incident outage). Check the diff before relying on it.

Major incidentLabel: outage (model (Jev), 97%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Internal Mac build errors
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2020-03-22 16:23 UTC
AddedResolved time#5
Before: not present
After: 2020-03-22 17:12 UTC
AddedAffected components#6
Before: not present
After: Builds Processing - Mac Builds
AddedUpdateidentified#7
Before: not present
After: We have identified an issue with a portion of Mac infrastructure which prevents builds from running correctly. We are working on mitigating the impact of this problem. Affected jobs would indicate "An error occurred while generating the build script." in the logs.
AddedUpdatemonitoring#8
Before: not present
After: We have removed the affected hardware out of the executor pool. Requests should work as expected at this time.
AddedUpdateresolved#9
Before: not present
After: The Mac build capacity has been brought back to normal.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Internal Mac build errors (this change)
Travis CI reported a major Mac Builds outage from 2020-03-22 16:23 UTC to 2020-03-22 17:12 UTC, lasting 49 min. A portion of Mac infrastructure prevented builds from running correctly, with affected jobs logging "An error occurred while generating the build script." Travis CI removed affected hardware from the executor pool and restored normal Mac build capacity.
Major incident

All Travis CI changes → · Travis CI profile · Markdown · JSON