Search

Companies / Honeycomb / incidents

Honeycomb: activity log for US instance is delayed

Impact: minorStatus: resolvedStarted Resolved (3 d)7 updatesSource: stspg.io (opens in new tab)

Affected components: ui.honeycomb.io - US1 Activity Log

Timeline of updates

  1. identified

    Activity log delay is rising, and is more than an hour behind due to a MySQL replica failover. Estimated recovery by 04:00 PDT.

  2. monitoring

    Backfilling of the past 2h30m of data is now in progress and should complete shortly.

  3. monitoring

    We believe that the activity log should now be caught up.

  4. monitoring

    We are continuing to monitor for any further issues.

  5. monitoring

    All activity log streams are now caught up, except for the query runs table, which should have all data since the start of the incident backfilled by 1600 PDT.

  6. monitoring

    Activity Log recovered at 07:00 UTC-07:00 today (about 6.5h ago).  All streams are caught up.

  7. resolved

    This incident has been resolved.

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Honeycomb profile · Recent Honeycomb incidents · Markdown · JSON