Robots |
1 | 16015 | 93.26 | waybackarchive.org/1.0 |
2 | 428 | 2.49 | MJ12bot/v1.4.5 |
3 | 119 | 0.69 | Googlebot/2.1 |
4 | 111 | 0.65 | Linux x86_64 |
5 | 102 | 0.59 | linkdexbot/2.0 |
6 | 99 | 0.58 | YandexBot/3.0 |
7 | 85 | 0.49 | DotBot/1.1 |
8 | 50 | 0.29 | Exabot/3.0 |
9 | 35 | 0.20 | compatible Mozilla/5.0 |
10 | 32 | 0.19 | bingbot/2.0 |
11 | 18 | 0.10 | Exabot/3.0 (BiggerBetter) |
12 | 18 | 0.10 | AhrefsBot/5.0 |
13 | 11 | 0.06 | MJ12bot/v1.4.4 |
14 | 8 | 0.05 | archive.org_bot |
15 | 6 | 0.03 | Sogou web spider/4.0(+http://www.sogou.c... |
16 | 6 | 0.03 | BLEXBot/1.0 |
17 | 4 | 0.02 | LSSRocketCrawler/1.0 LightspeedSystems |
18 | 4 | 0.02 | Baiduspider/2.0 |
19 | 4 | 0.02 | BacklinkCrawler (http://www.backlinktest... |
20 | 4 | 0.02 | spbot/4.1.0 |
21 | 3 | 0.02 | nutch-1.4/Nutch-1.4 |
22 | 2 | 0.01 | psbot/0.1 (+http://www.picsearch.com/bot... |
23 | 2 | 0.01 | netEstate NE Crawler (+http://www.websit... |
24 | 2 | 0.01 | Nutch12/Nutch-1.2 |
25 | 2 | 0.01 | SISTRIX Crawler |
26 | 2 | 0.01 | meanpathbot/1.0 |
27 | 1 | 0.01 | TurnitinBot/3.0 (http://www.turnitin.com... |