Skip to main content
Version: v7

KB: 1012

Pre-Emptive bot protection of applications that are configured behind Haltdos WAF​

Problem Statement​

The client requires that bad bots are mitigated while good bot crawlers are also allowed, as good bot crawlers are an important factor for the SEO ranking of web applications on SERP.

Solution​

Steps to Solve:-

  1. The above requirement can be achieved by enabling and deploying the bot protection feature of Haltdos WAF.

  2. Go to Apps > WAF > Listener > Profile > Bot Protection

kb:1012

We have built-in signatures that can identify bot reputation and can choose to either allow or drop the crawling bots. We also can whitelist certain bots like Google bot crawlers, Bing bot crawlers for the purpose of ranking on the Search Engine Result Page (SERP). Bad and Suspicious crawlers can be dropped or rate limited respectively. Along with that users can also fine-tune bot request rates and track the duration of bots.