Companies / Mezmo / changes

Mezmo change history

25Major incident
When (UTC)ChangeKind
Major incident: Search performance issues
Mezmo reported major Search and Livetail performance issues in Log Analysis from 2025-09-15 20:18 UTC to 2025-09-15 21:16 UTC, lasting 58 min. Data continued to be ingested, indexed, and retained, but displayed slowly in live tail; Mezmo confirmed Search performance was back to normal at resolution.
Major incident
Critical incident: Issue with Search
Mezmo reported a critical search outage preventing events from displaying in live tail, starting 2025-09-08 19:55 UTC and resolved at 2025-09-08 21:53 UTC, lasting 1 h 57 min. Impacts were mitigated by 21:24 UTC; Mezmo made a backend change it believes should mitigate recurrence, while the underlying cause remained unspecified.
Major incident
Major incident: Unable to view the logs
Mezmo reported a major outage preventing customers from viewing logs in Log Analysis - Search, Log Analysis - Web App, Search, and Web App. It started at 2025-03-18 13:33 UTC and was resolved at 2025-03-18 14:29 UTC, lasting 56 min; Mezmo implemented a fix and reported processing lag before recent logs became available.
Major incident
Critical incident: Pipeline Web UI is Unresponsive
Mezmo’s critical Pipeline Web UI outage started 2024-10-26 01:00 UTC and resolved 2024-10-26 20:23 UTC (19 h 23 min). Pages failed to load, then loaded slowly with metrics sometimes unavailable; ingress and egress were unaffected. The postmortem limited customer impact to the first four hours; no cause or specific fix was stated.
Major incident
Major incident: Web UI is unresponsive and ingestion of log lines halted
Mezmo reported a major outage from 2023-08-29 21:01 UTC to 2023-08-30 00:17 UTC, lasting 3 h 16 min. Its Kong Gateway stopped functioning, preventing Web UI access and log ingestion through the agent or API; syslog ingestion was unaffected. The incident was resolved, but no fix was specified.
Major incident
Critical incident: The Web UI is not accessible
Mezmo reported a critical Web App outage: the Web UI was inaccessible and returned “failure to get a peer from the ring-balancer.” The incident record started at 2023-05-01 20:18 UTC and was resolved at 2023-05-01 20:27 UTC, lasting 9 min; the postmortem lists a different outage window.
Major incident
Major incident: Searches are running slowly
Mezmo reported major Search degradation starting 2023-02-10 18:11 UTC, resolved at 2023-02-10 18:14 UTC (computed duration: 2 min). Searches were slow or returned no results; no data was lost and ingestion continued. The postmortem lists an earlier start of 16:45 UTC; normal search speeds were restored.
Major incident
Major incident: Intermittent delays loading Web UI and running searches
Mezmo reported a major degradation affecting Livetail, Search and Web App from 2023-02-06 20:48 UTC to 2023-02-07 02:07 UTC, lasting 5 h 18 min. Searches were slow or returned no results, and the Web UI was intermittently unresponsive; all search data access was restored. No data was lost, and ingestion was not halted.
Major incident
Major incident: Some customers' logs are not currently being processed
Mezmo reported a major log-ingestion degradation starting 2022-06-30 21:36 UTC, resolved at 2022-06-30 22:11 UTC (35 min). A downstream parser discarded some customers’ accepted logs, which were not retained; newly submitted logs were processing and being retained at resolution.
Major incident
Critical incident: Log lines not ingested
Mezmo reported a critical log-ingestion outage across all sources from 2022-06-02 21:44 UTC to 2022-06-02 22:05 UTC (21 min). Newly submitted logs were never ingested, making them unavailable for Alerting, Searching, Live Tail, Graphing, Timelines, and Archiving. Ingestion resumed and all services were fully operational.
Major incident
Critical incident: Alerts not triggering
Mezmo’s critical Alerting outage ran from 2022-04-05 18:23 UTC to 2022-04-05 18:32 UTC (9 min); alerts failed for all accounts before service resumed. The postmortem mentions a parser service restart and says most alerts with trigger dates more than 15 minutes in the past were discarded.
Major incident
Major incident: Ingestion of new logs — for Syslog only - Partial Outage
Mezmo reported major, Syslog-only log ingestion failures from 2022-02-24 22:45 UTC to resolution at 2022-02-24 23:43 UTC (57 min computed). New logs intermittently failed to ingest. The postmortem gives an earlier start—Thursday, February 18, 2022, at 00:10 UTC—and mentions the newly introduced Syslog Forwarder service.
Major incident
Major incident: Ingestion of new logs — for Syslog only - is intermittently failing
Mezmo reported a major degradation: new-log ingestion through its Syslog endpoint intermittently failed from 2022-02-18 01:41 UTC to 2022-02-18 02:15 UTC (33 min). The incident was resolved; the postmortem attributed the failures to a code change in Syslog Forwarder, which handles Syslog ingestion.
Major incident
Major incident: Some logs submitted over syslog using custom ports are not being correctly formatted and are not available for Alerting, Searching, Timelines, Graphs, and Live Tail.
Mezmo reported a major Log Ingestion (Syslog) outage affecting some custom-port logs, making them unavailable for Alerting, Searching, Timelines, Graphs, and Live Tail; logs not using custom ports worked normally. It started at 2022-02-16 19:58 UTC and resolved at 2022-02-16 21:56 UTC (1 h 57 min). A fix was implemented.
Major incident
Critical incident: Ingestion, Searching, Live Tail, Alerting, Graphing, and Timelines Delays
Mezmo reported a critical outage: ingestion halted, delaying Searching, Live Tail, Alerting, Graphing, and Timelines; some alerts never triggered. The incident ran from 2022-01-26 16:10 UTC to 2022-01-26 17:15 UTC, lasting 1 h 5 min. A fix restored ingestion and all services by 16:58 UTC.
Major incident
Major incident: Emails Are Not Being Sent
Mezmo reported a major outage affecting US email alerts and delaying email notifications from 2021-10-28 18:13 UTC to 2021-10-28 23:22 UTC (5 h 9 min). Mezmo attributed it to an incident at email provider Sparkpost; Slack and webhook notifications were unaffected. Email alerting was restored.
Major incident
Major incident: Some customers are not able to login to our UI
Mezmo reported a major Web App outage preventing some customers from logging in or loading pages from 2021-10-07 17:52 UTC to 2021-10-07 18:46 UTC (53 min). Log ingestion was unaffected; the postmortem attributed the disruption to a major network routing outage at Telia in Europe. All services were operational at resolution.
Major incident
Major incident: Email Alerts Are Not Being Sent
Mezmo reported a major email-alerting outage starting 2021-10-06 21:29 UTC, lasting 1 h 5 min and resolving at 2021-10-06 22:35 UTC; Slack and webhook alerts remained functional. The postmortem attributed partial email-notification disruption to exceeding its email provider’s daily limit of 250,000 messages; email alerting was restored.
Major incident
Major incident: Search and Live Tail Intermittent Failures
Mezmo reported a major incident affecting Web UI searches and Live Tail from 2021-08-19 13:56 UTC to 2021-08-19 20:48 UTC, lasting 6 h 52 min. Intermittent failures affected some customers; about 12% also experienced delays before newly submitted logs were available for searching, graphing, and timelines. Mezmo took remedial action and reported all services fully operational.
Major incident
Major incident: Search performance degraded.
Mezmo’s major incident delayed all customers’ logs in the WebUI, Alerting, Live Tail and archive uploads. The postmortem lists the start as April 28, 2021 at 12:37 UTC; resolution was 2021-05-03 00:54 UTC (computed duration: 2 days 12 h). All services were reported fully operational, with archives uploading to their destinations.
Major incident
Major incident: Web UI is temporarily unavailable
Mezmo reported a major Web UI outage affecting Livetail, Search, and Web App; log searches could return errors. It started at 2021-04-23 06:17 UTC and was resolved at 2021-04-23 06:45 UTC, lasting 27 min. Mezmo reported restoring log access and confirmed the Web UI was fully operational.
Major incident
Major incident: LogDNA Web UI is unresponsive
Mezmo reported a major incident affecting LogDNA’s Web App, Livetail and Search: pages were not loading consistently. It started at 2021-04-20 09:04 UTC and was resolved at 2021-04-20 11:54 UTC, lasting 2 h 50 min. Engineers applied a fix, and logs were accessible in the web app upon resolution.
Major incident
Major incident: Logs are not searchable in web app
Mezmo reported a major outage affecting Search, Livetail and the Web App: users could not search logs or use Live Tail in the Web UI. The incident ran from 2021-03-04 08:00 UTC to 2021-03-04 08:21 UTC (21 min); a fix was implemented at 2021-03-04 08:12 UTC.
Major incident
Critical incident: Web UI unavailable and ingestion has stopped
Mezmo reported a critical outage affecting the Web UI and log ingestion, starting at 2021-01-14 20:05 UTC and resolved at 2021-01-14 20:27 UTC (computed duration: 21 min). All services were restored; the postmortem separately reports 45 minutes of disruption and says ingestion client agent logs were automatically resent and successfully ingested.
Major incident
Major incident: Webapp Unavailable
Mezmo reported a major Web App outage affecting https://app.logdna.com from 2020-12-16 22:54 UTC to 2020-12-16 23:02 UTC, lasting 8 min. The vendor identified and resolved the issue but did not specify a cause or fix.
Major incident