Re: implement maxbytes

Dan Jacobson <[email protected]> writes:

> Here's the problem, I request
> http://blog.linux.org.tw/~damon/archives/000457.html
> which turns out to be 1208353 bytes of spam.
> 
> I can't be there to personally review every web page while it is
> downloading to hit the browsers stop key.  A browser might have never
> been involved even.
> 
> I want to say for URLs matching *blog*, cut off the page after say
> 200000 bytes, or even earlier if the headers WWWOFFLE sees say the
> size is big.
> 
> Certainly WWWOFFLE is the right place for adding such limiting
> functionality. Where else would be more appropriate in the web chain
> on the users end for it to be added? Somebody please add it.

We have discussed this before and it is on my list of things that I
might add one day.

At the moment nobody else seems particularly bothered about the
maximum size of files.  Perhaps they are just more careful about where
they go browsing, perhaps they do sit and monitor WWWOFFLE, or perhaps
they just accept it as a hazard of internet usage.

Even if you matched on *blog* there will be other pages that are
longer than you want to see.  You cannot hope to rely on pattern
matching for limits like this.  Overly long pages can appear from
anywhere, sometimes you want them (source file downloads, PDF files
you can't live without etc), sometimes you don't.

-- 
Andrew.
----------------------------------------------------------------------
Andrew M. Bishop                             amb-Uxr6IM1mbv2TY6FTCsQk+9Bc4/[email protected]
                                      http://www.gedanken.demon.co.uk/

WWWOFFLE users page:
        http://www.gedanken.demon.co.uk/wwwoffle/version-2.9/user.html