Increased error rate in the Control Panel
Incident
Report for BigCommerce
Resolved
This incident has been resolved.
Monitoring
The fix has been deployed across the infrastructure. All metrics have returned to expected levels. We will continue to monitor closely for further recurrence. We apologize for the length of this incident. In order to fix the issue, it was required to move slowly to not make it worse.
Update
Error rates and response times for Control Panel requests continue to improve. We expect that we will return to normal in approximately an hour or sooner.
Update
Error rates are decreasing for Control Panel requests as the fix moves through our infrastructure. We believe this incident will be resolved soon.
Update
The fix is continuing to roll out across our infrastructure.
Update
A fix is still being implemented in the background but it takes some time to run. We will update in 30 minutes if the issue is not resolved by then.
Update
A fix was attempted which made things worse and has been reverted.
Identified
Engineers have isolated the cause of the issue and are implementing a fix.
Update
We are continuing to investigate this issue affecting a small sub-set of stores.
Investigating
BigCommerce engineers are investigating an increase in error rate related to requests to the Control Panel.
This incident affected: Control Panel.