Re: 3.0.20 regression testing

On 1/3/13, Fabian Keil <[email protected]> wrote:
>
> Using only the official files:
>
> actionsfile match-all.action
> actionsfile default.action
> actionsfile regression-tests.action
>
> I get:
>
> fk@r500 ~/git/privoxy $privoxy-regression-test.pl --max-level 109
> --show-skipped-tests
> 2013-01-03 20:26:44: Asking Privoxy for the number of action files available
> ...
> 2013-01-03 20:26:44: Gathering regression tests from 3 action file(s)
> delivered by Privoxy.
> 2013-01-03 20:26:44: Executing regression tests ...
> 2013-01-03 20:26:54: Skipping test 467: depends on
> 'FEATURE_CONNECTION_KEEP_ALIVE' being set to 'No'.
> 2013-01-03 20:26:54: Skipping test 468: depends on
> 'FEATURE_CONNECTION_KEEP_ALIVE' being set to 'No'.
> 2013-01-03 20:26:54: Skipping test 470: depends on config line matching:
> 'connection-sharing\s+1'.
> 2013-01-03 20:26:54: Skipping test 471: depends on config line matching:
> 'connection-sharing\s+1'.
> 2013-01-03 20:26:54: Skipping test 475: depends on
> 'FEATURE_CONNECTION_KEEP_ALIVE' being set to 'No'.
> 2013-01-03 20:26:54: Skipping test 484: depends on
> 'FEATURE_GRACEFUL_TERMINATION' being set to 'Yes'.
> 2013-01-03 20:26:54: Skipping test 509: depends on 'FEATURE_TOGGLE' being
> set to 'No'.
> 2013-01-03 20:26:57: Executed 658 regression tests. Skipped 7. 658
> successes, 0 failures.

13 seconds!!!  I wish.  Cygwin is *slow*

$ /source/privoxy/current/tools/privoxy-regression-test.pl --max-level
109 --show-skipped-tests --privoxy-address 127.0.0.1:8118
2013-01-04 02:08:21: Asking Privoxy for the number of action files available ...
2013-01-04 02:08:21: Gathering regression tests from 3 action file(s)
delivered by Privoxy.
2013-01-04 02:08:22: Executing regression tests ...
2013-01-04 02:08:56: Skipping test 388: depends on 'FEATURE_PTHREAD'
being set to 'Yes'.
2013-01-04 02:08:56: Skipping test 389: depends on 'FEATURE_PTHREAD'
being set to 'Yes'.
2013-01-04 02:08:56: Skipping test 390: depends on 'FEATURE_PTHREAD'
being set to 'Yes'.
2013-01-04 02:08:56: Skipping test 391: depends on 'FEATURE_PTHREAD'
being set to 'Yes'.
2013-01-04 02:08:56: Skipping test 392: depends on 'FEATURE_PTHREAD'
being set to 'Yes'.
2013-01-04 02:08:57: Skipping test 398: depends on 'FEATURE_PTHREAD'
being set to 'Yes'.
2013-01-04 02:08:57: Skipping test 399: depends on 'FEATURE_PTHREAD'
being set to 'Yes'.
2013-01-04 02:08:57: Skipping test 400: depends on 'FEATURE_PTHREAD'
being set to 'Yes'.
2013-01-04 02:08:57: Skipping test 401: depends on 'FEATURE_PTHREAD'
being set to 'Yes'.
2013-01-04 02:08:57: Skipping test 402: depends on 'FEATURE_PTHREAD'
being set to 'Yes'.
2013-01-04 02:09:02: Skipping test 467: depends on
'FEATURE_CONNECTION_KEEP_ALIVE' being set to 'No'.
2013-01-04 02:09:02: Skipping test 468: depends on
'FEATURE_CONNECTION_KEEP_ALIVE' being set to 'No'.
2013-01-04 02:09:02: Skipping test 470: depends on config line
matching: 'connection-sharing\s+1'.
2013-01-04 02:09:02: Skipping test 471: depends on config line
matching: 'connection-sharing\s+1'.
2013-01-04 02:09:02: Skipping test 475: depends on
'FEATURE_CONNECTION_KEEP_ALIVE' being set to 'No'.
2013-01-04 02:09:03: Skipping test 484: depends on
'FEATURE_GRACEFUL_TERMINATION' being set to 'Yes'.
2013-01-04 02:09:05: Skipping test 509: depends on 'FEATURE_TOGGLE'
being set to 'No'.
2013-01-04 02:09:08: Skipping test 539: depends on config line
matching: 'enable-edit-actions\s+1'.
2013-01-04 02:09:20: Executed 647 regression tests. Skipped 18. 647
successes, 0 failures.


> And with my standard configuration:
>
<.. snip ..>
>
> The two test failures here are the result of me intentionally overriding
> sections in default.action in my own files without being able to explain
> this to privoxy-regression-test.pl as described above.
>
> I usually silence them by setting the ignore flag,

hrmm... maybe more documentation would help :)

I took a quick look, but didn't see anything for an ignore flag.  Is
all your documentation inside of privoxy-regression-test.pl or is
there somewhere else I should be looking?

Thanks,
Lee

------------------------------------------------------------------------------
Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and
much more. Get web development skills now with LearnDevNow -
350+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
SALE $99.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122812