Re: [viewvc-users] viewvc performance?

On 02/28/2011 01:58 PM, Dan Stromberg wrote:
> 
> I keep getting googlebot hitting my viewvc so long and hard, that it makes
> my server almost unusable for anything else.
> 
> Is there more than one way of configuring viewvc with respect to
> performance?   Perhaps one that would be faster?

The problem with web spiders such as the Googlebot is that they aren't
really designed to touch only the fast parts of your site, so *any*
performance shortcoming in ViewVC that's reachable via link navigation from
some other page on the 'Net can cause problems here.  For the most part,
ViewVC's performance is tied to the size of the dataset it is asked to serve
up.  Have a really deep repository history?  It's going to take a way to
display it.  Got massive files under version control?  It's going to take a
while to display them.  In other words, while ViewVC's own performance could
certainly stand improvement, there exists some floor that's bound to the
data set behind the operations we ask of it.

For Subversion repositories, one thing that's particularly expensive is the
display of a directory's revision logs.  You might toy with the log_pagesize
configuration option.  If that doesn't help, I've seen folks tweak the
lib/viewvc.py:view_log() function so that it raises an Exception when asked
to display the logs for a Subversion directory.  It's not pretty, but...
(ViewVC doesn't yet have a configuration option for disabling only directory
logs -- you can turn off all log views though, if you wish, via the
'allowed_views' configuration option.)

As an aside, have you considered providing a robots.txt file that instructs
bots to *not* crawl your ViewVC instance?  It doesn't offer enforcement, but
certainly would help at least with the well-behaved bots.

-- 
C. Michael Pilato <[email protected]>
CollabNet   <>   www.collab.net   <>   Distributed Development On Demand

------------------------------------------------------
http://viewvc.tigris.org/ds/viewMessage.do?dsForumId=4255&dsMessageId=2708418

To unsubscribe from this discussion, e-mail: [[email protected]].

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)

iEYEARECAAYFAk1r+/4ACgkQokEGqRcG/W45AgCgwiTKyHxEH/29btR4PAVWJMWm
ANAAnRdgN1woUORTYoIZq3k/5zSwDA+m
=LIdS
-----END PGP SIGNATURE-----