Test::Smoke reporting of "semi-failures"

[email protected] (Abe Timmerman) Mon, 4 Aug 2003 19:37:27 +0200
Newsgroups perl.perl5.porters,perl.daily-build
Organization ztreet
Message-ID <[email protected]>
Op een zonnige zomerdag (Monday 04 August 2003 16:58), schreef ikzelf:

> Op een zonnige zomerdag (Monday 04 August 2003 16:10), schreef Abe 
Timmerman:
<snip>
> > O - - -      -Accflags='-DPERL_COPY_ON_WRITE' -Uuseperlio
> > O O - -      -Accflags='-DPERL_COPY_ON_WRITE'
> > O O - -      -Accflags='-DPERL_COPY_ON_WRITE' -Duse64bitint
>
> I'm afraid this looks better than it is:
>
>   Memory fault (core dumped)
> ext/B/t/bytecode.....................FAILED at test 14
>
> I will try to fix Test::Smoke-1.18 asap to also report this sort of thing
> [at least report the failure!]

Okay, so this is what happens:
	* during "make _test" this test failes
	* It is then run under t/harness and doesn't fail

The "bug" in Test::Smoke is that this situation isn't reported at all (that is 
the dash). I believe it used to report "F".

What would you like to see in this case? "O", "F", or some new status?

BTW: At the moment, Test::Smoke can only see the test failure and not the 
"Memory fault (core dumped)" bit.

Good luck,

Abe
-- 
I'm not convinced.  By setting up mock-ups you are not testing the
real thing: you are testing mock-ups.  It's really emptying shotguns
at decoys and concluding that yup, we are eating duck tonight.
                                   -- Jarkko Hietaniemi on p5p @ 2001-10-20