Companies / GitLab / incidents

GitLab: CI/CD Job processing delay

Impact: minorStatus: resolvedStarted Resolved (28 h)6 updatesSource: status.gitlab.com (opens in new tab)

Affected components: Background Processing

Timeline of updates

  1. investigating

    Our team is investigating potential delays with background job processing. This could impact CI/CD job processing.

  2. investigating

    No material updates at this time. Our team is still investigating this issue.

  3. identified

    Our team has identified the issue as PgBouncer saturation and are looking at mitigation efforts. Users may see small delays in background processing. More information in: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21498

  4. monitoring

    We're seeing stabilization and recovery but are still monitoring and discussing next steps. More info in: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21498

  5. monitoring

    Background processing has recovered and CI wait times are back to normal. Our team is continuing to monitor for stability.

  6. resolved

    Our team has been monitoring for stability and have taken additional steps to help reduce database saturation. This incident is now resolved. More details in: https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/21498

Impact, status and times are the vendor’s own, as last archived. View on status.gitlab.com (opens in new tab). GitLab profile · Recent GitLab incidents · Markdown · JSON