3.0.20 regression testing
Ian Silvester <[email protected]>
| Newsgroups | gmane.comp.web.privoxy.devel |
|---|---|
| Message-ID | <[email protected]> |
Following Fabian's prompting I've explored using privoxy-regression-test.pl and thought I should start a thread where we discuss results. First of all, Fabian you're a star for having written this thing - I feel very strongly that good testing is a prerequisite of a new release and this tool gives us confidence as to whether the new release at least does not break any existing filtering, and does so with great ease! Lee if it's not too much of a pain please run the test set on Windows (no doubt Fabian you do so on BSD!). So then, I ran the standard test set on OS X using the following command line (the privoxy address is necessary since the OS X command line does not respect the System Preference proxy config and hence p.p is not routeable): /privoxy-regression-test.pl --privoxy-address 127.0.0.1:8118 --show-skipped-tests --max-level 109 The results were pretty good - only one failure: 2013-01-03 11:55:58: Asking Privoxy for the number of action files available ... 2013-01-03 11:55:58: Gathering regression tests from 3 action file(s) delivered by Privoxy. 2013-01-03 11:55:58: Executing regression tests ... 2013-01-03 11:55:59: Failure for test 72/72/0/72. Supposedly-blocked URL: 'http://www91.intel.com/b/ss/intelcorp,intelcorpdc/...ONDataProvider.aspx%3FDownloadType%3DDrivers&ot=A&AQE=1' 2013-01-03 11:56:02: Skipping test 345: Ignore flag is set. 2013-01-03 11:56:02: Skipping test 346: Ignore flag is set. 2013-01-03 11:56:02: Skipping test 347: Ignore flag is set. 2013-01-03 11:56:02: Skipping test 348: Ignore flag is set. 2013-01-03 11:56:02: Skipping test 349: Ignore flag is set. 2013-01-03 11:56:02: Executed 345 regression tests. Skipped 5. 344 successes, 1 failures. The thing is, this being the first time I've run the test I don't know if this is a regression that 3.0.20 introduced (maybe due to the new /download unblocker from actionsfile feedback #3498129?). I guess I'll downgrade to 3.0.19 and retest. Looking forward to others' results! Ian ------------------------------------------------------------------------------ Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnmore_122712