Re: General questions, analog, summary, large log sets, incremental

>> Every Apache server we have logs all hits to one log, which is rolled
>> nightly.  Summary used built in ftp to pull down only the new log
>> files.  Is there a provision to get logs from remote machines, or  
>> will
>> I need to look at something like rsync to make this happen?
>
> Analog just analyzes the logfiles, it doesn't do any logfile  
> "management", so you'd have to handle that yourself.


What would be the best way to manage this then. Consider a system  
where there acre apache access_logs from 10 machines.  There is an  
11th machine that will do analog.  I have a log rolling on 24 hours,  
which means, I could rsync the remote logs directories of the 10  
machines and keep all 24 hour log files up to date.  However, the like  
log, access_log, that is in progress, needs to come over just before  
analog runs.  This, with incremental, gives the client, what appears  
to be near real time stats.

I could run rsync every 4 minutes, and have analog run very 5, but  
this is a poor method, as times get out of sync, some logs are larger  
than others etc.  I am going to assume analog is triggered by  
scheduler? If that is the case, could I simply write a simple script...

1) rsync the log files
2) when above reports success, run analog

I believe, that Summary, is more or less doing just that, it just uses  
ftp for the transport, and MDTM to determine the need to download an  
ftp log again.

I understand analog is one of the most popular, though if it is not a  
good suit for a large shared hosting environment, please let me know.   
I have seen where logs are dropped into the virtual hosts client  
directory, and analog is set as an option to point to just that users  
files.  I however, prefer to parse out my entire facilities worth o f  
logs.

Thanks for the replies and help, most appreciated.
-- 
Scott * If you contact me off list replace talklists@ with scott@ *


+------------------------------------------------------------------------
|  TO UNSUBSCRIBE from this list:
|    http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+------------------------------------------------------------------------