Testsuite changes this week

I'm going to try to do ~weekly test runs and post deltas, in hopes this
helps us spot test regressions more swiftly.


== Current Results Summary ==

                   cairo    git      git
                   1.12     03/17    03/29
 -----------------------------------------
 Tests run:        22751    24838    24838
 Passed:           15809    15884    16725
 Passed (%):	     69%      64%      67%
 Failed:            4198     5383     5529
 Failed (%):	     18%      22%      22%
 Expected Failed:    405      330      332
 Error:                1        1        1
 Crashed:            227     1017       28
 Untested:          2111     2223     2223
 Total:            22751    24838    24838

Overall things are looking much better this week, due to Uli's last
couple commits which fixed crashes caused by a couple recent commits.

In absolute terms, there are more passing tests than before, but in
relative terms the failure ratio is 4% higher.  If about 1000 failing
tests were fixed, cairo's pass and failure ratios would be back to where
are for the stable branch.


== Changes since last week (03-17 to 03/29) ==

    426 CRASHED -> FAIL
    561 CRASHED -> PASS
      2 CRASHED -> XFAIL
    282 FAIL -> PASS
      2 PASS -> FAIL

        http://www.bryceharrington.org/Cairo/cairo_test_changes_201403017_to_20140329.txt


== Changes since last release (v. 1.12 to 03/29) ==

    185 CRASHED -> FAIL
     16 CRASHED -> PASS
      2 FAIL -> CRASHED
    197 FAIL -> PASS
      1 FAIL -> UNTESTED
     11 FAIL -> XFAIL
    703 PASS -> FAIL
     11 PASS -> UNTESTED
      3 XFAIL -> FAIL
     84 XFAIL -> PASS
      1 XFAIL -> UNTESTED

        http://www.bryceharrington.org/Cairo/cairo_test_changes_version_1_12_to_20140329.txt
-- 
cairo mailing list
[email protected]
http://lists.cairographics.org/mailman/listinfo/cairo