Search

Companies / GitLab / incidents

GitLab: CI pipelines not starting on merge requests.

Impact: majorStatus: resolvedStarted Resolved (3.3 h)6 updatesSource: status.gitlab.com (opens in new tab)

Affected components: CI/CDWebsite

Timeline of updates

  1. investigating

    We are currently investigating an issue affecting CI pipelines not starting on merge requests. Our team is actively investigating the root cause.

  2. identified

    We have identified that the sidekiq workers processing the jobs are getting deferred. The team is working on identifying the remediation steps.

  3. identified

    No material updates to report. We are continuing to investigate the current issue and engineers are working to determine remediation steps.

  4. identified

    Our engineers are still investigating the issue but jobs are starting to be processed with a delay. More details can be found here: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22412

  5. monitoring

    Queues and runner backlog are trending back towards normal, while systems continue to work through the remaining backlog. Engineers are continuing to monitor this.

  6. resolved

    Incident has now been mitigated and runner backlogs are now back to normal. CI pipelines are now resuming. Engineers will continue to monitor this recovery.

Rewindex changes for this incident

Impact, status and times are the vendor’s own, as last archived. View on status.gitlab.com (opens in new tab). GitLab profile · Recent GitLab incidents · Markdown · JSON