Opsgenie: Reported issues with OEC functionality

Impact: majorStatus: resolvedStarted 2024-09-24 19:55 UTCResolved 2024-09-24 20:54 UTC (59 min)5 updatesSource: stspg.io

Summary

Opsgenie reported a major OEC outage affecting Jira ticket creation and EU/US Outgoing Integration Flow, starting 2024-09-24 19:55 UTC and resolved at 2024-09-24 20:54 UTC (59 min). A routing configuration change sent OEC requests to the wrong service; Opsgenie reverted it and verified endpoints were back online.

Machine-written from the archived incident (Sol). Check the timeline before relying on it.

Affected components: Outgoing Integration FlowUS - Outgoing Integration FlowEU - Outgoing Integration FlowOutgoing Integration Flow

Timeline of updates

investigating2024-09-24 19:55 UTC
We've been notified that a number of OEC clients have been failing to create Jira tickets. We're currently investigating the issue.
investigating2024-09-24 19:56 UTC
We are continuing to investigate this issue.
identified2024-09-24 20:22 UTC
We've identified a recent change that has broken some endpoint routing configurations and caused OEC endpoint requests to be directed to wrong service. We're reverting that change on production at the moment.
monitoring2024-09-24 20:49 UTC
We reverted the faulty routing configuration change and started getting traffic on OEC endpoints
resolved2024-09-24 20:54 UTC
We've verified that OEC endpoints are back online.

Rewindex changes for this incident

Major incident: Reported issues with OEC functionality 2024-09-24 19:55 UTC

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Opsgenie profile · Recent Opsgenie incidents · Markdown · JSON