Increased latency on read and analytics endpoints

Incident Report for Orb

Resolved

After ongoing monitoring, this issue is now fully resolved. Endpoints have been recovered for the last several hours; the last period of errors occurred before 05/16/25 08:30 UTC.
Posted May 16, 2025 - 14:54 UTC

Monitoring

We've identified a failure mode tied to a degenerate workload that degrades query performance for one of our usage datastores. A temporary resolution has been put in place to ensure system stability, our oncall team will continue to monitor the error rates for the API and adjust workloads as needed to ensure API availability.
Posted May 16, 2025 - 09:42 UTC

Investigating

We are experiencing periods of elevated API response times specifically on read and analytics requests. Our oncall team is currently investigating. Event ingestion, invoice finalization, and write requests are unaffected.
Posted May 16, 2025 - 08:51 UTC
This incident affected: API (Reads, Analytics).
← Current Status Powered by Atlassian Statuspage