rewindex

CompaniesLangfuseIncidents

Langfuse: Slow trace data retirival across API and UI in EU

MinorStatus: resolvededitedStarted Resolved (2.4 h)5 updatesstatus.langfuse.com (opens in new tab)

Affected components: Public APIPublic APILLM-as-a-judgeLLM-as-a-judgeUI

Timeline of updates

  1. investigating

    Slow traces data serving across API and UI

  2. identified

    Slow clickhouse read replicas affecting performance across the service. Draining and replacing them.

  3. resolved

    All replicas look healthy again

  4. monitoring

    Looks like some timeout are still occurring. Monitoring.

  5. resolved

    should be finally resolved

Changes Rewindex caught on this incident

Archive proof

Rewindex commits each version of an incident it captures to a daily checkpoint, chains it to the day before, and has the checkpoint timestamped by FreeTSA and DigiCert.

How the archive is checked, and what it cannot prove.

Rewindex captured this after the last checkpoint; the next run () commits it.

Impact, status and times are the vendor’s own, as last archived. View on status.langfuse.com (opens in new tab).

Langfuse profileRecent Langfuse incidentsMarkdownJSON