Survey notifications via Segment

Incident Report for Hotjar

Postmortem

What happened?
From 13:25 to 13:37 UTC on December 8th, notifications of new Survey events were not sent to Segment via our integration.

Why did this issue occur?
A new deployment caused an unexpected issue with this integration, which was immediately detected. The changes were rolled back and the issue was resolved. No data was lost from Surveys, this incident only impacted notifications sent to Segment.

What will we do to prevent this from happening in the future?
This issue was immediately detected and the changes rolled back. We will continue to our current monitoring practices and make improvements when possible.

Posted Dec 21, 2021 - 12:46 UTC

Resolved

This issue has been resolved.
Posted Dec 08, 2021 - 14:08 UTC

Monitoring

Our engineers have identified the issue and rolled back changes and are monitoring the situation to make sure that no further issues arise. All notification events should be sending to Segment as normal again.
Posted Dec 08, 2021 - 13:50 UTC

Identified

Our engineers identified an issue when passing Survey event notifications to Segment, and are in the process of resolving the issue.
Posted Dec 08, 2021 - 13:46 UTC