Changes / Travis CI / Backlog of Jobs on .ORG

Travis CI: Major incident: Backlog of Jobs on .ORG

Summary

Travis CI reported a major backlog of queued MacOS build jobs on .ORG starting at 2020-04-28 22:07 UTC, delaying build processing. A fix was implemented by 2020-04-28 22:25 UTC; the incident was resolved at 2020-04-28 22:57 UTC after 49 min.

Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.

Major incidentLabel: degradation (model (Jev), 95%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: Backlog of Jobs on .ORG
AddedImpact#2
Before: not present
After: major
AddedStatus#3
Before: not present
After: resolved
AddedStart time#4
Before: not present
After: 2020-04-28 22:07 UTC
AddedResolved time#5
Before: not present
After: 2020-04-28 22:57 UTC
AddedAffected components#6
Before: not present
After: Builds Processing - Mac Builds
AddedUpdateidentified#7
Before: not present
After: We are currently investigating a large number of queued jobs on our .ORG infrastructure for MacOS builds
AddedUpdatemonitoring#8
Before: not present
After: A fix has been implemented and we are monitoring the results.
AddedUpdateresolved#9
Before: not present
After: This incident has been resolved.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Major incident: Backlog of Jobs on .ORG (this change)
Travis CI reported a major backlog of queued MacOS build jobs on .ORG starting at 2020-04-28 22:07 UTC, delaying build processing. A fix was implemented by 2020-04-28 22:25 UTC; the incident was resolved at 2020-04-28 22:57 UTC after 49 min.
Major incident

All Travis CI changes → · Travis CI profile · Markdown · JSON