Re: GCJ Mauve testing

2008/9/27 Andrew John Hughes <[email protected]>:
> I've just run Mauve against both the 4.3 tree and our
> Classpath 0.98 merge tree (effectively equivalent to Classpath
> CVS + GCJ-specific changes).  Overall:
>
> 4.3:
> 281 of 3177 tests failed.  123926 total calls to harness.check() failed.
>
> 4.4:
> 239 of 3177 tests failed.  143832 total calls to harness.check() failed.
>
> There will be some new tests that compile with 4.4 but not 4.3 (e.g.
> java.util.Scanner tests).
>
> Additional FAILs are as follows:
>
> +FAIL: gnu.java.security.util.TestOfIntegerUtil
> +FAIL: java.sql.Date.DateTest
> +FAIL: java.lang.Character.Blocks15
> +FAIL: java.lang.InheritableThreadLocal.simple
> +FAIL: java.text.SimpleDateFormat.parse
> +FAIL: java.util.Calendar.ampm
> +FAIL: java.util.Scanner.LotsOfPMInts
> +FAIL: java.util.Scanner.Inputs
> +FAIL: javax.swing.text.DefaultStyledDocument.ElementBuffer.insert
> +FAIL: javax.swing.table.JTableHeader.AccessibleJTableHeader.AccessibleJTableHeaderEntry.getForeground
>
> The two Scanner tests we can discount as regressions as they simply won't
> have run with 4.3.
>
> The remaining failures:
>
> FAIL: gnu.java.security.util.TestOfIntegerUtil
>  line 71: IntegerUtil.valueOf(String) MUST be faster than Integer.valueOf(String) [1] -- boolean passed to check was fa\
> lse
> FAIL: java.sql.Date.DateTest
>  uncaught exception:
>   java.lang.OutOfMemoryError
> FAIL: java.lang.Character.Blocks15
>  uncaught exception:
>   java.lang.OutOfMemoryError
> FAIL: java.lang.InheritableThreadLocal.simple
>  Test timed out.  Use -timeout [millis] option to change the timeout value.
> FAIL: java.text.SimpleDateFormat.parse
>  line 132: parse pattern yyyy-MM-dd HH:mm z [3] -- Objects were not equal.  Use -debug for more information.
>  line 132: parse pattern yyyy-MM-dd HH:mm Z [3] -- Objects were not equal.  Use -debug for more information.
> FAIL: java.util.Calendar.ampm
>  line 72: 12:00 AM couldn't be parsed [1] -- forced fail
>  line 72: 12:10 AM couldn't be parsed [1] -- forced fail
>  line 57: 12:10 AM couldn't be parsed [2] -- Objects were not equal.  Use -debug for more information.
>  line 72: 0:00 AM couldn't be parsed [1] -- forced fail
>  line 57: 0:00 AM couldn't be parsed [2] -- Objects were not equal.  Use -debug for more information.
>  line 72: 0:10 AM couldn't be parsed [1] -- forced fail
>  line 72: 12:00 PM couldn't be parsed [1] -- forced fail
>  line 72: 12:10 PM couldn't be parsed [1] -- forced fail
>  line 57: 12:10 PM couldn't be parsed [2] -- Objects were not equal.  Use -debug for more information.
>  line 72: 0:00 PM couldn't be parsed [1] -- forced fail
>  line 57: 0:00 PM couldn't be parsed [2] -- Objects were not equal.  Use -debug for more information.
>  line 72: 0:10 PM couldn't be parsed [1] -- forced fail
> FAIL: javax.swing.text.DefaultStyledDocument.ElementBuffer.insert
>  line 746: EmptyStackException must be thrown [1] -- forced fail
>  line 759: EmptyStackException must be thrown [3] -- got 4 but expected 3
>  line 765: EmptyStackException must be thrown [7] -- got 7 but expected 15
>  line 767: EmptyStackException must be thrown [8] -- got 12 but expected 15
>  line 768: EmptyStackException must be thrown [9] -- got 15 but expected 16
>  line 771: EmptyStackException must be thrown [10] -- got javax.swing.text.AbstractDocument$DefaultDocumentEvent but ex\
> pected null
> FAIL: javax.swing.table.JTableHeader.AccessibleJTableHeader.AccessibleJTableHeaderEntry.getForeground
>  line 54:  [2] -- got javax.swing.plaf.ColorUIResource but expected java.awt.Color
>
> The first is odd, and CACAO+Classpath CVS fails this also. OpenJDK can't compile it.  CACAO + Classpath CVS
> also fails with java.text.SimpleDateFormat.parse, java.util.Calendar.ampm and
> javax.swing.text.DefaultStyledDocument.ElementBuffer.insert, which suggest a common Classpath issue.
> java.sql.Date.DateTest, java.lang.Character.Blocks15, java.lang.InheritableThreadLocal.simple and
> javax.swing.table.JTableHeader.AccessibleJTableHeader.AccessibleJTableHeaderEntry.getForeground are
> all GCJ-specific failures.  OpenJDK passes all but the first, which is GNU Classpath specific.
>
> Full logs are available at:
>
> http://fuseyism.com/classpath/mauve-gcj-4.3.log
> http://fuseyism.com/classpath/mauve-gcj-4.4.log
> --
> Andrew :)
>
> Support Free Java!
> Contribute to GNU Classpath and the OpenJDK
> http://www.gnu.org/software/classpath
> http://openjdk.java.net
> PGP Key: 94EFD9D8 (http://subkeys.pgp.net)
> Fingerprint = F8EF F1EA 401E 2E60 15FA  7927 142C 2591 94EF D9D8
>

Changed to:

http://fuseyism.com/classpath/mauve-gcj-4.3.log.gz
http://fuseyism.com/classpath/mauve-gcj-4.4.log.gz

due to size...
-- 
Andrew :-)

Support Free Java!
Contribute to GNU Classpath and the OpenJDK
http://www.gnu.org/software/classpath
http://openjdk.java.net

PGP Key: 94EFD9D8 (http://subkeys.pgp.net)
Fingerprint: F8EF F1EA 401E 2E60 15FA 7927 142C 2591 94EF D9D8