Excluding Robots
Sabine Henneberger <shenneberger-XEdX6UqiF/[email protected]>
| Newsgroups | gmane.comp.web.analog.general |
|---|---|
| Organization | Humboldt Universität |
| Message-ID | <[email protected]> |
Hallo, how can I exclude hosts which request the file robots.txt? Other programs for Logfile Analysis do it automatically, because they count every host with such a request as a robot. How do the users of Analog exclude robots, if there is no actual list at http://www.wadsack.com/robot-list.html? Best Regards, Sabine -- Sabine Henneberger Humboldt-Universität Berlin Computer- und Medienservice Arbeitsgruppe Elektronisches Publizieren Tel. 030 2093 7075 Humboldt University Berlin, Germany Computer and Media Service Electronic Publishing Group phone: +49+30+2093-7075 +------------------------------------------------------------------------ | TO UNSUBSCRIBE from this list: | http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +------------------------------------------------------------------------