Re: Problem with page counts

Aengus <[email protected]> Sat, 21 Feb 2009 13:44:32 -0500
Newsgroups gmane.comp.web.analog.general
Message-ID <[email protected]>
On 2/21/2009 1:27 PM, Iain Hunneybell wrote:
>
> As for page counts, my best rationalisation is that the high overnight count
> is spiders and so analog is correctly showing page requests that aren't
> being recorded by the page view 'bug'. Then over day proxies are causing the
> page bug to record higher page views than seen by the servers. It's the best
> rationalisation I've come up with so far!

You should be able to test that by using FROM and TO  and doing a log 
analysis for an hour in the middle of the night, and looking at the Full 
Browser report. Most well behaved spiders identify themselves.

You can also do a Full Browser report on requests for /robots.txt and 
then use that to create a list of BROWEXCLUDE commands so that you can 
see if the human-driven traffic patterns make more sense.

Aengus
+------------------------------------------------------------------------
|  TO UNSUBSCRIBE from this list:
|    http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+------------------------------------------------------------------------