| |
Spider |
Hits |
| 1 |
Googlebot |
12,695 |
| 2 |
Scooter |
3,096 |
| 3 |
InternetSeer |
1,296 |
| 4 |
Fast-Webcrawler |
1,220 |
| 5 |
Inktomi Slurp |
869 |
| 6 |
ia_archiver |
858 |
| 7 |
MicrosoftPrototypeCrawler (How's my crawling? mailto:newbiecrawler@hotmail.com) |
298 |
| 8 |
dloader(NaverRobot)/1.0 |
268 |
| 9 |
TurnitinBot/1.5 http://www.turnitin.com/robot/crawlerinfo.html |
233 |
| 10 |
MSIE Crawler |
227 |
| 11 |
SearchSpider/1.2.10 |
120 |
| 12 |
Szukacz/1.5 (robot; www.szukacz.pl/jakdzialarobot.html; info@szukacz.pl) |
106 |
| 13 |
SearchHippo Robot |
101 |
| 14 |
Lycos |
38 |
| 15 |
http://www.almaden.ibm.com/cs/crawler [wf84] |
33 |
| 16 |
dloader(NaverRobot)/1.5 |
30 |
| 17 |
Baiduspider ( http://www.baidu.com/search/spider.htm) |
29 |
| 18 |
NationalDirectory-WebSpider/1.3 |
24 |
| 19 |
http://www.almaden.ibm.com/cs/crawler [c01] |
18 |
| 20 |
Openfind Robot |
17 |
| 21 |
Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; 3Com U.S. Robotics Connections) |
13 |
| 22 |
OWR_Crawler 0.1 |
13 |
| 23 |
search.ch V1.4.2 (spiderman@search.ch; http://www.search.ch) |
11 |
| 24 |
Mozilla/5.0 (compatible; Vagabondo/2.1; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/) |
11 |
| 25 |
NetResearchServer/2.8(loopimprovements.com/robot.html) |
10 |
| 26 |
Mozilla/4.0 (compatible; MSIE 5.01; Windows 95; 3COM U.S. Robotics; YComp 5.0.2.4) |
7 |
| 27 |
Gaisbot/3.0 (robot@gais.cs.ccu.edu.tw; http://gais.cs.ccu.edu.tw/robot.php) |
5 |
| 28 |
Perl LWP |
5 |
| 29 |
Xenu's Link Sleuth |
5 |
| 30 |
Mozilla/3.0 (INGRID/3.0 MT; webcrawler@NOSPAMexperimental.net; http://aanmelden.ilse.nl/?aanmeld_mode=webhints) |
3 |
| 31 |
TurnitinBot/1.5 (http://www.turnitin.com/robot/crawlerinfo.html) |
3 |
| 32 |
nuSearch Spider (compatible; MSIE 4.01; Windows NT) |
3 |
| 33 |
ASpider (Associative Spider) |
3 |
| 34 |
semanticdiscovery/0.2(http://www.semanticdiscovery.com/sd/robot.html) |
2 |
| 35 |
Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 4.0 Robot) Microsoft |
2 |
| 36 |
boitho.com-robot/1.0 |
2 |
| 37 |
Test spider |
2 |
| 38 |
Search4free Robot |
2 |
| 39 |
Mozilla/4.0 (compatible; MSIE 5.0; NetNose-Crawler 2.0; A New Search Experience: http://www.netnose.com) |
2 |
| 40 |
WebZIP/5.0 (http://www.spidersoft.com) |
2 |
| 41 |
MyCategoryCrawler |
1 |
| 42 |
Robot/www.pj-search.com |
1 |
| 43 |
Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; /; http://www.galaxy.com/info/crawler.html) |
1 |
| 44 |
Xaldon WebSpider 2.7.b6 |
1 |