Re: tests fail, build passes

"Davies, Greg" <[email protected]>
Newsgroups gmane.comp.java.cruise-control.user
Message-ID <EFA1E0866F87BF45A3E5BE3F6E50BAB2196AF78504@uemsexch.Ultra-UEMS.ca>
Thanks for the fast reply. I got it now. Any time I just had to rearrange a few things. I wasn’t returning a non-zero value from the tests on failure. Any time I did, there was no test results in the dashboard. I just had to rearrange things so that the failure stops the build AFTER the results are placed in the results directory.

From: Chuck Burgess [mailto:[email protected]]
Sent: Monday, March 08, 2010 12:13 PM
To: [email protected]
Subject: Re: [Cruisecontrol-user] tests fail, build passes

On Mon, Mar 8, 2010 at 9:45 AM, Davies, Greg <[email protected]<mailto:[email protected]>> wrote:
Hi,

I've been having some trouble with one of my builds passing, even when the tests fail. There are two executables that run CUnit tests. These are translated into JUnit style results, and then displayed on the dashboard. This has been working for me for a few months, when the tests fail, the build fails, and I know about it, and fix it.

Recently, I have added another suite of tests to one of my test executables. These tests fail, but the build still passes. This only happens with the new tests. If any other test fails, the build still fails like it should.

The dashboard detail even shows the tests as failures in the tests tab. Does anyone have any suggestions as to why some tests may not cause a test to fail while others do?


First thing in my mind is making sure your failonerror attribute is set true on the exec task that runs the new test suite.  Second thing would be to verify that a manual execution of that test suite returns a nonzero exit code if there are test failures, which is what the exec would look for to indicate the suite had failures.
--
CRB

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev

_______________________________________________
Cruisecontrol-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/cruisecontrol-user
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.