Changes / PandaDoc / API Outage

PandaDoc: Critical incident: API Outage

Summary

PandaDoc’s critical API outage started at 2023-09-26 18:29 UTC and lasted 58 min, resolving at 2023-09-26 19:27 UTC. A fix was implemented at 18:59 UTC; the postmortem said some users’ API keys were temporarily deactivated, requiring new ones, and stated PandaDoc was not breached or hacked.

Machine-written from the diff below (Sol; type: incident outage). Check the diff before relying on it.

Major incidentLabel: outage (model (Jev), 86%)Changed Detected Source: stspg.io (opens in new tab)

What changed

AddedTitle#1
Before: not present
After: API Outage
AddedImpact#2
Before: not present
After: critical
AddedStatus#3
Before: not present
After: postmortem
AddedStart time#4
Before: not present
After: 2023-09-26 18:29 UTC
AddedResolved time#5
Before: not present
After: 2023-09-26 19:27 UTC
AddedAffected components#6
Before: not present
After: API
AddedUpdateinvestigating#7
Before: not present
After: We are currently investigating issues regarding our API. We will be updating you immediately when we have an update.
AddedUpdatemonitoring#8
Before: not present
After: A fix has been implemented and we are monitoring the results.
AddedUpdateresolved#9
Before: not present
After: This incident has been resolved.
AddedUpdatepostmortem#10
Before: not present
After: It has come to our attention that some PandaDoc API users experienced temporary deactivation of their API keys recently, causing a need to generate new ones. We are pleased to inform you that our investigation into the matter is complete and we have addressed the issue.  ‌ To be clear, PandaDoc was not part of a data breach and was not hacked. PandaDoc’s Sandbox API was deactivated for trialists to improve our security measures, and unfortunately this change temporarily affected paying customers.  ‌ If you have been using our API and were affected by this, we extend our sincere apologies for any disruption it caused or impact on your experience using PandaDoc. ‌ Thank you again for using PandaDoc, and please don’t hesitate to reply to this email if you have any questions.

First version of this incident archived by Rewindex. View the live incident (opens in new tab).

History of this incident

When (UTC)ChangeKind
Critical incident: API Outage (this change)
PandaDoc’s critical API outage started at 2023-09-26 18:29 UTC and lasted 58 min, resolving at 2023-09-26 19:27 UTC. A fix was implemented at 18:59 UTC; the postmortem said some users’ API keys were temporarily deactivated, requiring new ones, and stated PandaDoc was not breached or hacked.
Major incident

All PandaDoc changes → · PandaDoc profile · Markdown · JSON