Changes / Bitrise / Long waiting times on M4 Pro machine (queue) builds
Bitrise: Major incident: Long waiting times on M4 Pro machine (queue) builds
Summary
Bitrise reported a major Builds (CI) degradation affecting M4 Pro build queues from 2025-11-18 17:20 UTC to 2025-11-18 20:38 UTC, lasting 3 h 18 min. Bitrise attributed longer build-start waits to increased build volume following an earlier Cloudflare outage; execution remained normal. The incident was resolved with waits around 30 seconds across most queues.
Machine-written from the diff below (Sol; type: incident degradation). Check the diff before relying on it.
What changed
Before: not present
After: Long waiting times on M4 Pro machine (queue) builds
Before: not present
After: major
Before: not present
After: resolved
Before: not present
After: 2025-11-18 17:20 UTC
Before: not present
After: 2025-11-18 20:38 UTC
Before: not present
After: ⚙️ Builds (CI)
Before: not present
After: <b>We identified the root cause of elevated build queues on M4 Pro. Some users may experience longer-than-usual wait times for builds to start, as queued jobs take longer to be picked up due to the Cloudflare outage experienced earlier today, which has resulted in a larger number of builds being run at this time.</b>
<b>Services:</b>
Build start times and queue wait times; build execution itself remains normal once a worker is allocated.
<b>Scope:</b>
M4 Pro Machines
<b>Severity:</b>
SEV-2
<b>What we’re doing?</b>
Our Engineering teams identified the root cause and are now actively working on mitigations to restore stability across all affected services. We will perform validated mitigations as soon as they are determined safe. We will be adding more M4 Pro capacity by next week.
<b>When will the next update be available?</b>
You can expect a status update approximately <b>1 hour</b> from now.
Before: not present
After: We’re continuing to address the elevated build queue times, but wait times have now dropped to approximately 6-7 minutes across most queues. Our engineering team is monitoring the queues closely and is working on full remediation.
We’ll keep you posted with further updates. Thank you for your patience.
Before: not present
After: Wait times have now dropped to approximately 30 seconds across most queues. This incident has been resolved.
First version of this incident archived by Rewindex. View the live incident.
History of this incident
| When (UTC) | Change | Kind |
|---|---|---|
| Major incident: Long waiting times on M4 Pro machine (queue) builds (this change) Bitrise reported a major Builds (CI) degradation affecting M4 Pro build queues from 2025-11-18 17:20 UTC to 2025-11-18 20:38 UTC, lasting 3 h 18 min. Bitrise attributed longer build-start waits to increased build volume following an earlier Cloudflare outage; execution remained normal. The incident was resolved with waits around 30 seconds across most queues. | Major incident |