Bizzabo Service Disruption
Incident Report for Bizzabo
Postmortem

On January 16th at 12:10 pm, we received reports from our automated monitoring tools that the Bizzabo platform was inaccessible. Our R&D team began the investigation and realized the system was not responding despite the traffic was not higher than usual and there were no issues with the application layer.

Our engineering team continued investigating and identified an issue with the infrastructure layer. At 12:44 pm the issue was narrowed down to a specific infrastructure component. We began working on a fix and a new configuration was implemented at 12:55 pm. This resolved the issue and brought full functionality back to the platform.

We performed a root cause analysis and identified a process at the infrastructure layer that consumed all available memory leading to a crash of a key component. We already implemented preventive measures to ensure that this doesn’t happen again in the future by creating new monitoring for this resource.

Posted Jan 23, 2020 - 10:23 EST

Resolved
We're pleased to report that we have the all clear, and all functionality is now restored. Thanks so much for bearing with us in the meantime.
Posted Jan 16, 2020 - 13:07 EST
Monitoring
Our team has rolled out a fix to the issue and the service has been restored. We are continuing to monitor the system. If you are still having troubles, please contact us at support@bizzabo.com.
Posted Jan 16, 2020 - 12:56 EST
Identified
Our team is still working to identify the root cause of the service disruption, but we don’t have additional information just yet. We’ll be back within 10 minutes with another update. Sorry for the interruption.
Posted Jan 16, 2020 - 12:45 EST
Update
Our team has identified the root cause of the issue and is implementing a resolution. We expect the fix to be rolled out shortly.

We will provide an update within 10 minutes.
Posted Jan 16, 2020 - 12:44 EST
Update
Our team is still working to identify the root cause of the service disruption, but we don’t have additional information just yet. We’ll be back within 10 minutes with another update. Sorry for the interruption.
Posted Jan 16, 2020 - 12:31 EST
Investigating
We are receiving reports of a service disruption and Bizzabo services may not be accessible.
Our R&D team is actively investigating the issue. Thank you for your patience and sorry for the disruption.

We will send an additional update within 10 minutes.
Posted Jan 16, 2020 - 12:20 EST
This incident affected: Organizer Dashboard, Events Websites, and API.