Summary

On November 22, 2022, from approximately 13:12 UTC to 13:17 UTC, most requests to PagerDuty’s REST API in the US service region returned 502 “Bad Gateway” responses and webhooks from some integrations may have been delayed. The website, mobile application, events API, and notifications were unaffected.

What Happened

During the investigation and remediation of a minor issue with retrieving log entries, a change was made that prevented our REST API from handling requests and caused delays for webhooks from some integrations. Responders quickly identified the misconfiguration and promptly restored functionality. Functionality was fully restored by 13:17 UTC.

What are we doing about this?

We have identified places where certain kinds of configuration changes are confusing and difficult to validate. We are adding documentation around those configuration changes and investigating ways of making them safer to perform. For any questions, comments, or concerns, please contact us at support@pagerduty.com.