| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 1,409+83 | 23.35 MB | 31 Jan 2016 - 23:59 |
| Yahoo Slurp | 284+97 | 6.25 MB | 31 Jan 2016 - 23:58 |
| SpiderBot | 30+21 | 189.12 KB | 31 Jan 2016 - 23:36 |
| Unknown robot (identified by 'bot*') | 1,619+710 | 46.24 MB | 31 Jan 2016 - 23:17 |
| BaiDuSpider | 207 | 4.17 MB | 31 Jan 2016 - 21:24 |
| Unknown robot (identified by hit on 'robots.txt') | 0+177 | 136.94 KB | 31 Jan 2016 - 21:23 |
| Unknown robot (identified by 'spider') | 7+4 | 43.38 KB | 31 Jan 2016 - 21:21 |
| MJ12bot | 1,217+324 | 9.79 MB | 31 Jan 2016 - 20:25 |
| Unknown robot (identified by empty user agent string) | 230+3 | 3.76 MB | 31 Jan 2016 - 20:11 |
| Unknown robot (identified by 'checker') | 4 | 37.55 KB | 31 Jan 2016 - 19:00 |
| Unknown robot (identified by '*bot') | 53+28 | 1.81 MB | 31 Jan 2016 - 18:05 |
| SeznamBot | 13+106 | 376.67 KB | 31 Jan 2016 - 17:39 |
| Yandex bot | 115+26 | 13.04 MB | 31 Jan 2016 - 16:27 |
| FavIconizer | 67 | 386.02 KB | 31 Jan 2016 - 15:48 |
| Unknown robot (identified by 'robot') | 112+15 | 1.22 MB | 31 Jan 2016 - 09:53 |
| Python-urllib | 34+1 | 525.60 KB | 31 Jan 2016 - 03:45 |
| UniversalFeedParser | 14 | 20.94 KB | 31 Jan 2016 - 02:17 |
| Exabot | 37+25 | 1.50 MB | 31 Jan 2016 - 00:34 |
| MojeekBot | 1+4 | 8.58 KB | 30 Jan 2016 - 01:07 |
| psbot | 1+1 | 6.99 KB | 30 Jan 2016 - 00:03 |
| MSIECrawler | 7 | 116.51 KB | 29 Jan 2016 - 20:26 |
| Unknown robot (identified by 'crawl') | 53+12 | 2.01 MB | 29 Jan 2016 - 20:16 |
| Nutch | 8+7 | 53.25 KB | 29 Jan 2016 - 09:03 |
| Unknown robot (identified by 'discovery') | 1 | 18.28 KB | 28 Jan 2016 - 10:40 |
| Web Core / Roots | 0+2 | 1.38 KB | 27 Jan 2016 - 07:28 |
| arks | 70 | 4.72 MB | 27 Jan 2016 - 02:55 |
| Phantom | 215 | 8.77 MB | 25 Jan 2016 - 20:44 |
| FaceBook bot | 92 | 6.58 MB | 25 Jan 2016 - 10:55 |
| Sogou Spider | 25+26 | 172.22 KB | 25 Jan 2016 - 03:13 |
| WordPress | 4 | 23.25 KB | 25 Jan 2016 - 00:41 |
| TITAN | 42 | 1.74 MB | 23 Jan 2016 - 17:12 |
| SurveyBot | 4+2 | 21.82 KB | 21 Jan 2016 - 03:54 |
| Y!J Yahoo Japan | 40+11 | 215.49 KB | 20 Jan 2016 - 09:35 |
| Sift | 4 | 72.92 KB | 19 Jan 2016 - 19:23 |
| Perl tool | 3 | 54.19 KB | 17 Jan 2016 - 17:50 |
| Alexa (IA Archiver) | 1+5 | 23.86 KB | 16 Jan 2016 - 08:36 |
| CFNetwork | 2 | 6.45 KB | 14 Jan 2016 - 14:39 |
| archive.org bot | 50+17 | 2.20 MB | 13 Jan 2016 - 18:12 |
| Java (Often spam bot) | 213 | 3.92 MB | 12 Jan 2016 - 02:23 |
| Netcraft | 2 | 32.33 KB | 11 Jan 2016 - 21:49 |
| MSNBot-media | 1+1 | 23.38 KB | 09 Jan 2016 - 12:00 |
| Heritrix | 1 | 18.01 KB | 07 Jan 2016 - 08:44 |