Robots |
1 | 354 | 15.62 | SeznamBot/3.2 |
2 | 317 | 13.98 | MJ12bot/v1.4.7 |
3 | 290 | 12.79 | YandexBot/3.0 |
4 | 189 | 8.34 | bingbot/2.0 |
5 | 178 | 7.85 | Googlebot/2.1 |
6 | 171 | 7.54 | compatible Mozilla/5.0 |
7 | 152 | 6.70 | DotBot/1.1 |
8 | 129 | 5.69 | AhrefsBot/5.2 |
9 | 106 | 4.68 | Linux x86_64 |
10 | 86 | 3.79 | Sogou web spider/4.0(+http://www.sogou.c... |
11 | 74 | 3.26 | MJ12bot/v1.4.8 |
12 | 45 | 1.99 | SemrushBot/1.2~bl |
13 | 29 | 1.28 | MSIE 9.0 |
14 | 22 | 0.97 | coccocbot-image/1.0 |
15 | 15 | 0.66 | SEOkicks-Robot |
16 | 14 | 0.62 | Findxbot/1.0 |
17 | 12 | 0.53 | - |
18 | 12 | 0.53 | Firefox/2.0.0.6 |
19 | 10 | 0.44 | linkdexbot/2.0 |
20 | 7 | 0.31 | Yahoo! Slurp |
21 | 5 | 0.22 | studyres_com download bot, see http://st... |
22 | 5 | 0.22 | SiteExplorer/1.1b |
23 | 5 | 0.22 | Cliqzbot/2.0 |
24 | 4 | 0.18 | coccocbot-web/1.0 |
25 | 3 | 0.13 | spbot/5.0.3 |
26 | 3 | 0.13 | Exabot/3.0 |
27 | 3 | 0.13 | aiHitBot/2.9 |
28 | 3 | 0.13 | Barkrowler 0.1.6 |
29 | 3 | 0.13 | nutch-1.4/Nutch-1.4 |
30 | 3 | 0.13 | voltron |
31 | 3 | 0.13 | CCBot/2.0 (http://commoncrawl.org/faq/) |
32 | 3 | 0.13 | Dispatch/0.11.3 |
33 | 2 | 0.09 | Python-urllib/2.7 |
34 | 2 | 0.09 | MSIE 5.01 |
35 | 2 | 0.09 | archive.org_bot |
36 | 1 | 0.04 | ia_archiver |
37 | 1 | 0.04 | oBot/2.3.1 |
38 | 1 | 0.04 | SafeDNSBot (https://www.safedns.com/sear... |
39 | 1 | 0.04 | Scrapy/1.4.0 (+http://scrapy.org) |
40 | 1 | 0.04 | Go-http-client/1.1 |
41 | 1 | 0.04 | SurdotlyBot/1.0 |