Re: [rvm-research] issues with dacapo benchmarks

Erik Brangs <[email protected]> Thu, 21 Mar 2019 18:55:32 +0100
Newsgroups gmane.comp.java.jikes.rvm.devel
Message-ID <[email protected]>
This is a multi-part message in MIME format.
--------------43EB8FC6F9870A7A38AA6815
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit

Hi,

On 21.03.19 10:21, Johannes Sinsel wrote:
> the Jikes User Guide recommends the Dacapo benchmark from 2006 for testing.
> With the current version of Jikes, there is a problem with (I think more memory intensive) benchmarks, like eclipse and hsqldb, also chart is not working, but this seems to be due to AWT-support and appeared in earlier versions, too.
> After several GC Warnings, the VM chrashes in eclipse. There are also GC Warnings in hsqldb, but I stopped the execution after like five minutes.

You will need to set the heap size for the benchmarks if you're running them manually. The dacapo test set has predefined heap sizes. You can find those in testing/tests/dacapo/build.xml .

There are more test sets in testing/tests but not all of them are readily usable. The following ones should mostly work:
- basic and opttests should always pass on x86/x64 (TestSysCalls fails on PowerPC)
- jni should always pass on x86/x64 (TestNestedGC fails on PowerPC)
- gctest should mostly pass (Exhaust fails sometimes, ReferenceTest fails sometimes on a few collectors, InlineAllocations fails when only using opt compiler)

> I used the prototype-opt build.

I've attached an example test run file with protoype-opt and dacapo. You can put it into build/test-runs and then use it with Ant or buildit. Depending on how much functional testing you want to do, it may be profitable to use "development" instead of "protoype-opt".


Kind regards,

Erik Brangs



--------------43EB8FC6F9870A7A38AA6815
Content-Type: text/plain; charset=UTF-8;
 name="prototype-opt-dacapo.properties"
Content-Transfer-Encoding: base64
Content-Disposition: attachment;
 filename="prototype-opt-dacapo.properties"

dGVzdC5jb25maWdzPXByb3RvdHlwZS1vcHQKdGVzdC50ZXN0cz1kYWNhcG8KdGVzdC5jb25m
aWcuZGFjYXBvLmNoYXJ0LmV4Y2x1ZGU9dHJ1ZQo=
--------------43EB8FC6F9870A7A38AA6815
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline


--------------43EB8FC6F9870A7A38AA6815
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Jikesrvm-researchers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/jikesrvm-researchers

--------------43EB8FC6F9870A7A38AA6815--