Re: Test::Buildder v. Test2 subtests

[email protected] (Chad Granum) Tue, 13 Dec 2016 08:35:19 -0800
Newsgroups perl.qa
Message-ID <CAJFr3ks99fMxGbB1sfoLqNB1wc7sCpGVaHbRjrmP4szw1STPqA@mail.gmail.com>
--94eb2c192480507d2b05438cce45
Content-Type: text/plain; charset=UTF-8

ok, thanks for trying that, I will look into it when I have time and if
nothing else at least explain why it behaves like it does. If it is a bug I
will fix it.

On Tue, Dec 13, 2016 at 8:18 AM, Ricardo Signes <[email protected]>
wrote:

> * Chad Granum <[email protected]> [2016-12-13T11:13:56]
> > I would like to see the results when you use
> > Test2::Tools::Subtest::subtest_streamed() which is the actual
> equivalent to
> > Test::More::subtest().
>
> Thanks for the pointer.  I have tried this and got identical ("bad")
> results to
> Test2::API::run_subtest:
>
>   ~$ perl foo t2ss
>   # Subtest: test
>   not ok 1 - Subtest: test
>   # Failed test 'Subtest: test'
>   # at foo line 24.
>   # Caught exception in subtest: 123 at foo line 13.
>   1..1
>       not ok 1 - subprocess died
>       #   Failed test 'subprocess died'
>       #   at foo line 11.
>       #          got: 0
>       #     expected: anything else
>       1..1
>   not ok 1 - Subtest: test
>   # Failed test 'Subtest: test'
>   # at foo line 24.
>   1..1
>   # Looks like you failed 1 test of 1.
>
> Compare to:
>
>   ~$ perl foo t2rs
>   # test
>   not ok 1 - test
>   # Failed test 'test'
>   # at foo line 24.
>   # Caught exception in subtest: 123 at foo line 13.
>   1..1
>       not ok 1 - subprocess died
>       #   Failed test 'subprocess died'
>       #   at foo line 11.
>       #          got: 0
>       #     expected: anything else
>       1..1
>   not ok 1 - test
>   # Failed test 'test'
>   # at foo line 24.
>   1..1
>   # Looks like you failed 1 test of 1.
>
> The entire difference appears to be "Subtest: test" vs. "test"
>
> --
> rjbs
>

--94eb2c192480507d2b05438cce45
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">ok, thanks for trying that, I will look into it when I hav=
e time and if nothing else at least explain why it behaves like it does. If=
 it is a bug I will fix it.</div><div class=3D"gmail_extra"><br><div class=
=3D"gmail_quote">On Tue, Dec 13, 2016 at 8:18 AM, Ricardo Signes <span dir=
=3D"ltr">&lt;<a href=3D"mailto:[email protected]" target=3D"_blank">=
[email protected]</a>&gt;</span> wrote:<br><blockquote class=3D"gmai=
l_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left=
:1ex">* Chad Granum &lt;<a href=3D"mailto:[email protected]">exodist7@gmai=
l.com</a>&gt; [2016-12-13T11:13:56]<br>
<span class=3D"">&gt; I would like to see the results when you use<br>
&gt; Test2::Tools::Subtest::<wbr>subtest_streamed() which is the actual equ=
ivalent to<br>
&gt; Test::More::subtest().<br>
<br>
</span>Thanks for the pointer.=C2=A0 I have tried this and got identical (&=
quot;bad&quot;) results to<br>
Test2::API::run_subtest:<br>
<br>
=C2=A0 ~$ perl foo t2ss<br>
=C2=A0 # Subtest: test<br>
=C2=A0 not ok 1 - Subtest: test<br>
=C2=A0 # Failed test &#39;Subtest: test&#39;<br>
=C2=A0 # at foo line 24.<br>
=C2=A0 # Caught exception in subtest: 123 at foo line 13.<br>
<span class=3D"">=C2=A0 1..1<br>
=C2=A0 =C2=A0 =C2=A0 not ok 1 - subprocess died<br>
=C2=A0 =C2=A0 =C2=A0 #=C2=A0 =C2=A0Failed test &#39;subprocess died&#39;<br=
>
</span>=C2=A0 =C2=A0 =C2=A0 #=C2=A0 =C2=A0at foo line 11.<br>
<span class=3D"">=C2=A0 =C2=A0 =C2=A0 #=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 g=
ot: 0<br>
=C2=A0 =C2=A0 =C2=A0 #=C2=A0 =C2=A0 =C2=A0expected: anything else<br>
=C2=A0 =C2=A0 =C2=A0 1..1<br>
</span>=C2=A0 not ok 1 - Subtest: test<br>
=C2=A0 # Failed test &#39;Subtest: test&#39;<br>
=C2=A0 # at foo line 24.<br>
<span class=3D"">=C2=A0 1..1<br>
=C2=A0 # Looks like you failed 1 test of 1.<br>
<br>
</span>Compare to:<br>
<br>
=C2=A0 ~$ perl foo t2rs<br>
<span class=3D"">=C2=A0 # test<br>
=C2=A0 not ok 1 - test<br>
=C2=A0 # Failed test &#39;test&#39;<br>
</span>=C2=A0 # at foo line 24.<br>
=C2=A0 # Caught exception in subtest: 123 at foo line 13.<br>
<span class=3D"">=C2=A0 1..1<br>
=C2=A0 =C2=A0 =C2=A0 not ok 1 - subprocess died<br>
=C2=A0 =C2=A0 =C2=A0 #=C2=A0 =C2=A0Failed test &#39;subprocess died&#39;<br=
>
</span>=C2=A0 =C2=A0 =C2=A0 #=C2=A0 =C2=A0at foo line 11.<br>
<span class=3D"">=C2=A0 =C2=A0 =C2=A0 #=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 g=
ot: 0<br>
=C2=A0 =C2=A0 =C2=A0 #=C2=A0 =C2=A0 =C2=A0expected: anything else<br>
=C2=A0 =C2=A0 =C2=A0 1..1<br>
=C2=A0 not ok 1 - test<br>
=C2=A0 # Failed test &#39;test&#39;<br>
</span>=C2=A0 # at foo line 24.<br>
<span class=3D"">=C2=A0 1..1<br>
=C2=A0 # Looks like you failed 1 test of 1.<br>
<br>
</span>The entire difference appears to be &quot;Subtest: test&quot; vs. &q=
uot;test&quot;<br>
<span class=3D"HOEnZb"><font color=3D"#888888"><br>
--<br>
rjbs<br>
</font></span></blockquote></div><br></div>

--94eb2c192480507d2b05438cce45--