Test::Smoke reporting of "semi-failures"
[email protected] (Abe Timmerman) Mon, 4 Aug 2003 19:37:27 +0200
| Newsgroups | perl.perl5.porters,perl.daily-build |
|---|---|
| Organization | ztreet |
| Message-ID | <[email protected]> |
Op een zonnige zomerdag (Monday 04 August 2003 16:58), schreef ikzelf:
> Op een zonnige zomerdag (Monday 04 August 2003 16:10), schreef Abe
Timmerman:
<snip>
> > O - - - -Accflags='-DPERL_COPY_ON_WRITE' -Uuseperlio
> > O O - - -Accflags='-DPERL_COPY_ON_WRITE'
> > O O - - -Accflags='-DPERL_COPY_ON_WRITE' -Duse64bitint
>
> I'm afraid this looks better than it is:
>
> Memory fault (core dumped)
> ext/B/t/bytecode.....................FAILED at test 14
>
> I will try to fix Test::Smoke-1.18 asap to also report this sort of thing
> [at least report the failure!]
Okay, so this is what happens:
* during "make _test" this test failes
* It is then run under t/harness and doesn't fail
The "bug" in Test::Smoke is that this situation isn't reported at all (that is
the dash). I believe it used to report "F".
What would you like to see in this case? "O", "F", or some new status?
BTW: At the moment, Test::Smoke can only see the test failure and not the
"Memory fault (core dumped)" bit.
Good luck,
Abe
--
I'm not convinced. By setting up mock-ups you are not testing the
real thing: you are testing mock-ups. It's really emptying shotguns
at decoys and concluding that yup, we are eating duck tonight.
-- Jarkko Hietaniemi on p5p @ 2001-10-20