Degraded Storefront API Performance
Incident Report for Nacelle
Between 6:26 PM ET and 7:21 PM ET, Nacelle experienced a spike of new requests that required Nacelle’s DevOps team to scale additional Kubernetes pods. While these new pods were scaling up, the API experienced degraded performance (e.g., long latencies). The root cause of the issue was how Nacelle's custom schema fetching works across new additions to our GraphQL interface. To ensure stability over Black Friday / Cyber Monday, the Nacelle team has removed features still in development from the Storefront API schema service.
Posted Nov 11, 2023 - 23:30 UTC