Re: 3.0.20 regression testing

On 2013-01-04, at 1:40 AM, Lee wrote:

> On 1/3/13, Ian Silvester <[email protected]> wrote:
> 
>> ... Lee if it's not too much of a pain please run the test set on Windows
> 
> If you search the mail archives you should be able to find where I
> post the results before uploading a new version of privoxy to SF :)

Ach, my apologies Lee!

> The problem I have with the regression test isn't that it's a pain to
> run but that it's a pain to get my changes to not break the various
> tests.  For example:
> 
> /source/privoxy/current/tools/privoxy-regression-test.pl  --forks 10
> --shuffle-tests --privoxy-address 127.0.0.1:8118
> 
> eventually prints out 10 lines of
> Executed 719 regression tests. Skipped 46. 687 successes, 32 failures.
> 
> One of those failures was
> Failure for test 464/266/0/266. Sticky Actions: '-block' and URL:
> 'http://apps.facebook.com/onthefarm/track.php?
> 
> Oh noes! my user.action has
> {+block{Facebook} }
> .facebook.com
> 
> 32 failures isn't anywhere near as bad as it once was, but I'm getting
> close to the point of having to turn off tests to get the failure
> count down any more.

Could you not put your user.action (and any other mods) to one side and test a 'vanilla' install? This'd be a way to avoid the failures and get a good baseline test of a new release?

Ian



> 
> Regards,
> Lee


------------------------------------------------------------------------------
Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and
much more. Get web development skills now with LearnDevNow -
350+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
SALE $99.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122812