Search

Companies / Mezmo / incidents

Mezmo: User sessions are timing out and customers are required to login again

Impact: minorStatus: postmortemStarted Resolved (2.8 h)5 updatesSource: stspg.io (opens in new tab)

Affected components: Web App

Timeline of updates

  1. investigating

    User sessions to our Web UI are timing out and customers using the UI have to log in every 1-2 minutes. We are investigating why this is happening, but the rest of the service is fully functional. No other components are affected.

  2. identified

    The issue has been identified, and a fix is being implemented.

  3. monitoring

    The fix was implemented and we are now monitoring the user login sessions.

  4. resolved

    This incident has been resolved.

  5. postmortem

    **Dates:** Start Time: Monday, June 19, 2023, at 10:31 UTC End Time: Monday, June 19, 2023, at 12:35 UTC Duration: 124 minutes **What happened:** Users were being logged out of our WebUI frequently – within 1-2 minutes of logging in. Users could successfully login again, but the new session would also expire quickly. **Why it happened:** The cache of logged in users held in our Redis database was being cleared every 1-2 minutes. This caused all user sessions to expire and new logins to be required. We have yet to ascertain why the cache was being periodically cleared at frequent intervals. **How we fixed it:** We restarted the pods running the Redis database and the cache behavior returned to normal. **What we are doing to prevent it from happening again:** We will investigate further to learn why the Redis cache was being frequently cleared.

Impact, status and times are the vendor’s own, as last archived. View on stspg.io (opens in new tab). Mezmo profile · Recent Mezmo incidents · Markdown · JSON