During a period beginning at 21:44 UTC on Monday, January 9th, and ending at 13:16 UTC on Tuesday, January 10th, PagerDuty experienced an incident that prevented customers in the EU Service Region from authorizing new Microsoft Teams and Slack integrations. Integrations that were authorized prior to this incident were not affected, as well as new authorizations from other integrations such as Jira, Live Call Routing, Zendesk, and ServiceNow.
After receiving customer reports of not being able to authorise the Microsoft Teams and Slack integration, we initiated our major incident response at 12:01 UTC Tuesday, January 10th. During our investigation, our engineers found that a code change to build redirect URLs intended for our non-production environments inadvertently affected new authorizations for Microsoft Teams and Slack integrations in our EU production environment. As soon as this was identified, around 12:50 UTC Tuesday, January 10th, the code change was reverted and completed at 13:16 UTC Tuesday, January 10th. Both the Microsoft Teams and Slack authentications have been operating normally since the fix, and the incident was closed at 13:22 UTC Tuesday, January 10th.
Our engineers are adding extra measures in testing and monitoring our login and integration workflows. We apologise for any inconvenience this caused. For any questions, comments, or concerns, please contact us at support@pagerduty.com.