׀  Submit  ׀  About  ׀  Contact  ׀
 
Bots By Type
Advertising
Bad Bots
Crawlers
Scrapers
   
Bots By User-Agent
A B C D E F
G H I J K L
M N O P Q R
S T U V W X
Y Z 0 1 2 3
4 5 6 7 8 9
   
Newest Bot Added
   
   
 
 
 
 

 Scrapers

The bots listed below are those that we could identify as visiting websites with the intention of downloading and saving content for uses such as offline browsing of the website.  These bots generally provide no real value for the website owner and the rate at which they download pages combined with the huge amount of pages and files they download just adds extra stress to the server and eats up bandwidth.  Some of the bots that are listed in the Bad Bots section may be scrapers.