Re: [dylan] Testworks / Jenkins integration is running now on Linux release builds

A couple of further comments about this:


   - Failing tests means that the build gets flagged as "unstable".
   - The tests running with the C backend crash and don't report nearly as
   many tests as with HARP.
   - Tests that aren't implemented are reported as failures and mark the
   build as unstable.
   - We have no way of signifying "expected failure" for things that we
   know are bugs.
   - This has turned up a number of issues in the test suites themselves as
   some are very old and are using things that are no longer exported from the
   testworks libraries.


And finally, for those who don't know why this is great news ... this means
that starting from today, we have a historical record of our test suite
being run and we can readily see improvement or things getting worse.

This is something that we've been wanting for a very long time and that
Carl and I have been working towards off and on for a while.

 - Bruce



On Wed, Nov 27, 2013 at 1:03 PM, Bruce Mitchener
<[email protected]>wrote:

> Testworks / Jenkins integration is now running on the Linux release
> builds.  For a sample of the first run to complete, check out:
>
>
> https://jenkins.opendylan.org/job/opendylan-release-linux-precise-x86/673/testReport/
>
> This shows that there are probably some easy things to fix ... and also
> may motivate us to add more tests!
>
>  - Bruce
>
>

_______________________________________________
hackers mailing list
[email protected]
https://lists.opendylan.org/mailman/listinfo/hackers