Search

Companies / Fly.io / incidents

Fly.io: Increased app-not-found errors

Impact: minorStatus: resolvedStarted Resolved (4.3 h)6 updatesSource: status.flyio.net (opens in new tab)

Affected components: Machines API

Timeline of updates

  1. investigating

    We are currently investigating app-not-found errors returned by Machines API calls made shortly after creating new applications.

  2. identified

    We have identified the issue as failed insertions in a subset of Corrosion batches. These failures trigger retries, which can cause timeouts for other batches.

  3. identified

    We’ve applied a mitigation to reduce the impact from Corrosion batch insertion retries and are continuing to monitor while affected nodes catch up.

  4. identified

    We’ve deployed an additional mitigation to further reduce Corrosion retry pressure and are seeing improvement; we’re continuing to monitor while remaining affected nodes catch up.

  5. monitoring

    A fix has been implemented and we are monitoring the results

  6. resolved

    This incident has been resolved.

Impact, status and times are the vendor’s own, as last archived. View on status.flyio.net (opens in new tab). Fly.io profile · Recent Fly.io incidents · Markdown · JSON