blocking robot named bot* in htaccess
by rajesh[ Edit ] 2012-12-07 10:05:23
To block the bot named bot* in htaccess, you can use the below code
SetEnvIfNoCase User-Agent ^bot\*$ bad_bot
deny from env=bad_bot
The above lines will stop serving to searchengine or bot named exactly as bot*
We use bot\* to escape string else anything that start with bot would be blocked.
Dont try to block bot* becuase you see request from awstats. it only indicated that awstats was not able to identify the bot. Awstats puts bing, opera, many other bots under bot*