Restaurantsupply.com realized that their website was not performing optimally. Hosted on a Magento 2 Enterprise clustered environment which was properly sized, the site’s speed was not in alignment with industry standards. Latency in their customer navigation experience was contributing to lowered conversion rates. With a website hosting more than 150,000 SKUs within a fiercely competitive marketplace, they knew that they needed to take action.
The JetRails engineers initiated an investigation looking for causes to the sites slower speed. They uncovered a significant influx of malicious bots jumping from page to page. Bot behavior is specific and follows a systematic navigation pattern unlike normal site visitors who follow a more scattered “surfing” navigation pattern.
These bots had a primary objective – they were collecting cost intelligence as a means to gain an advantage and undercut pricing. This is a common malicious tactic which generates a large volume of traffic against a target. This influx of bot traffic was causing load to the site and thereby hindering speed. We analyzed the access logs and uncovered that the bots were gaining direct entry into the server through port 80 and 443, generally a gateway for web communications.