Re: [viewvc-users] viewvc performance?

On 04/15/2011 01:43 PM, Dan Stromberg wrote:
> robots.txt'ing my two large files (or rather, the two directories containing
> them) doesn't appear to have helped - I'm still getting viewvc processes
> that're well over half a gigabyte of resident set.
> 
> Is it possible viewvc wants to inhale an entire file at a time, rather than
> iterating over some modest block size as it reads from disk?

Keep in mind that robots.txt is non-binding -- it's merely a recommendation
of how well-behaving crawlers should act, sans any enforcement.  But I
should think that your server logs would reveal whether or not your
robots.txt rules are being honored.

I wonder, though -- did you happen to notice issue #477 [1] when it passed
through this way recently?  Do you have any really large log messages which
also might have lots of markup-able stuff in them (URLs, email address, or
revision numbers)?

As far as reading the whole file into memory goes, ViewVC tries to avoid
that, but I think both the markup and annotate views might end up doing so
in various cases.  Exactly how big are these "big files" you've mentioned?

-- C-Mike

[1] http://viewvc.tigris.org/issues/show_bug.cgi?id=477

-- 
C. Michael Pilato <[email protected]>
CollabNet   <>   www.collab.net   <>   Distributed Development On Demand

------------------------------------------------------
http://viewvc.tigris.org/ds/viewMessage.do?dsForumId=4255&dsMessageId=2720175

To unsubscribe from this discussion, e-mail: [[email protected]].

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)

iEYEARECAAYFAk2oiNAACgkQokEGqRcG/W42DwCfdKbCCxv4YbcDYHnvJYabphmR
KvQAn2comvwbrMuY9Akc1jZyoRrE+VZg
=ms38
-----END PGP SIGNATURE-----