rewindex

CompaniesCircleCIIncidents

CircleCI: Increased Docker gen2 wait times

MinorStatus: resolvededitedStarted Resolved (1.4 h)6 updatesstspg.io (opens in new tab)

Affected components: Docker Jobs

Timeline of updates

  1. identified

    Some users might see increased wait times for gen2 Docker jobs due to capacity issues.

  2. identified

    We are adding additional capacity to help mitigate the issue. Note: We are still seeing delays up to 20 minutes on 2xlarge.

  3. identified

    Wait times for 2xlarge docker jobs are recovering. We will continue to update as capacity comes online.

  4. identified

    Wait times for 2xlarge docker jobs are now under 60 seconds.

    Wait times for other resource sizes were not impacted by this incident and remain under 10 seconds.

  5. monitoring

    We have seen a full recovery of wait times for docker jobs.

  6. resolved

    Wait times for gen2 Docker jobs have recovered and jobs are running within normal wait times.

Changes Rewindex caught on this incident

Archive proof

Rewindex commits each version of an incident it captures to a daily checkpoint, chains it to the day before, and has the checkpoint timestamped by FreeTSA and DigiCert.

How the archive is checked, and what it cannot prove.

Rewindex captured this after the last checkpoint; the next run () commits it.

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab).

CircleCI profileRecent CircleCI incidentsMarkdownJSON