Overaggressive Google Bot causing degraded performance in single datacenter

Incident Report for BigCommerce

Resolved

We have removed the blocks and our rate limiting of the Adbots seems to be working.
Posted Jun 04, 2015 - 14:11 CDT

Update

We will be unblocking the aggressive Googlebots in approximately one hour, when we have tested and implemented a less restrictive filter that will allow Adbots to scan but not cause issues on our platform.
Posted Jun 04, 2015 - 13:01 CDT

Monitoring

Adbot has been temporarily blocked until we can add more effective rate limiting. We will be monitoring their traffic for further issues.
Posted Jun 04, 2015 - 12:42 CDT

Identified

Bigcommerce engineers are taking action against Google Adbots that are aggressively scanning our platform. They should be blocked soon.
Posted Jun 04, 2015 - 12:29 CDT
This incident affected: API & Webhooks, Control Panel, and Storefront.