Re: 2.5 console runner documenation
"Charlie Poole" <[email protected]> Sun, 7 Sep 2008 14:54:13 -0700
| Newsgroups | gmane.comp.windows.dotnet.nunit.user |
|---|---|
| Message-ID | <002a01c91134$4795eff0$6401a8c0@ferrari> |
This is a multi-part message in MIME format. --===============1821774720== Content-Type: multipart/alternative; boundary="----=_NextPart_000_002B_01C910F9.9B3717F0" This is a multi-part message in MIME format. ------=_NextPart_000_002B_01C910F9.9B3717F0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit That sounds like a valid use case, altough unusual. What's interesting is that it matches exactly the use cases I wrote about earlier: You want a report in a particular format, but the fact that it is produced on stdout by NUnit is just an implementation detail and not a requirement. AFAICS, you can do everything you want using any of the options I described in the last note. If it's not clear, I'll try to supply more detail. Charlie _____ From: [email protected] [mailto:[email protected]] On Behalf Of Jay Lemmon Sent: Sunday, September 07, 2008 2:29 PM To: [email protected] Subject: Re: [Nunit-users] 2.5 console runner documenation A quick follow up to my last email. This is the format I'm looking for the console runner to output. I need it this way because it mirrors the output from another unit testing framework (UnitTest++), so it makes everything nice and consistent for my tool chain. c:\glassworksstudio\lodestone\source\trunk\unittests\quartictests.cpp(56): error: Failure in Fixture1.Test_1: Expected 0 but was 2 c:\glassworksstudio\lodestone\source\trunk\unittests\quartictests.cpp(63): error: Failure in Fixture1.Test_2: 20 < 10 FAILURE: 2 out of 156 tests failed (2 failures). Test time: 0.02 seconds. Note each test failure follows this format: [file]([line]): error: Failure in [TestFixture].[TestName]: [Error message] all inline, with a new line for each failed test. Then a summary report and the time to run the tests comes last. -Jay Lemmon --- On Sun, 9/7/08, Jay Lemmon <[email protected]> wrote: From: Jay Lemmon <[email protected]> Subject: Re: [Nunit-users] 2.5 console runner documenation To: [email protected] Date: Sunday, September 7, 2008, 2:16 PM Well I can't speak for anyone else, but customizing the (console) output of the console runner is important to me. If it's impossible in 2.5, it'll mean I can't upgrade :( It doesn't have to be xslt. And it doesn't have to be a command line switch. Right now I'm actually linking against the console runner assemblies (DLLs) to build my own custom EXE for every test project I build, so it could be something done purely in code. How is the format for the console runner decided right now if it's not xslt? -Jay Lemmon --- On Sun, 9/7/08, Charlie Poole <[email protected]> wrote: From: Charlie Poole <[email protected]> Subject: Re: [Nunit-users] 2.5 console runner documenation To: [email protected] Date: Sunday, September 7, 2008, 1:10 PM Hi Jay, There doesn't seem to be a real need to customize console output, except possibly to have NUnit show more detailed info - an option I'm working on. Most people using the old feature seemed to be producing html with it. That's still possible, but the xml would need to be formatted after the NUnit run. Charlie _____ From: [email protected] [mailto:[email protected]] On Behalf Of Jay Lemmon Sent: Sunday, September 07, 2008 12:54 PM To: [email protected] Subject: Re: [Nunit-users] 2.5 console runner documenation I just copied the 2.5 binaries over my old binaries, so it wasn't a fool proof test, no :) So how do I, the end user, customize console output now? The release notes don't mention anything in this regard. -Jay Lemmon --- On Sun, 9/7/08, Charlie Poole <[email protected]> wrote: From: Charlie Poole <[email protected]> Subject: Re: [Nunit-users] 2.5 console runner documenation To: [email protected] Date: Sunday, September 7, 2008, 6:39 AM Hi Jay, There's mention in the release notes, under 2.5 alpha 1, about the removal of the transform option. The console output is now indepedent of the xml, so it no longer has any purpose. Since the option is no longer there, I'm pretty sure it can't be working. :-) Are you sure you were using 2.5 for your test? Charlie _____ From: [email protected] [mailto:[email protected]] On Behalf Of Jay Lemmon Sent: Saturday, September 06, 2008 9:42 PM To: [email protected] Subject: [Nunit-users] 2.5 console runner documenation When comparing the 2.4.8 docs and the 2.5 docs, I noticed that this section in console runner: command-line was mostly deleted and partly merged with the one before it: "Specifying the Transform file The console interface uses XSLT to transform the test results from the XML file to what is printed to the screen when the program executes. The console interface has a default transformation that is part of the executable. To specify your own transformation named "myTransform.xslt" use the following command line option: nunit-console /transform:myTransform.xslt nunit.tests.dll Note: For additional information see the XML schema for the test results. This file is in the same directory as the executable and is called Results.xsd. The default transform Summary.xslt is located in the core source directory." In the 2.5 docs, there's no such section, and the mention of the Results.xsd is merged in to the section before it on specifying an output xml file. Is this an error in the docs, or is this feature (specifying a transform) going to be removed in 2.5? A quick test shows that it still works. -Jay Lemmon ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Nunit-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nunit-users ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Nunit-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nunit-users ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Nunit-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nunit-users ------=_NextPart_000_002B_01C910F9.9B3717F0 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> <HTML><HEAD> <META http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"> <META content=3D"MSHTML 6.00.6000.16705" name=3DGENERATOR></HEAD> <BODY> <DIV><SPAN class=3D734075121-07092008><FONT face=3DArial color=3D#0000ff = size=3D2>That=20 sounds like a valid use case, altough unusual. What's interesting = is that=20 it matches exactly</FONT></SPAN></DIV> <DIV><SPAN class=3D734075121-07092008><FONT face=3DArial color=3D#0000ff = size=3D2>the=20 use cases I wrote about earlier: You want a report in a particular = format, but=20 the fact that</FONT></SPAN></DIV> <DIV><SPAN class=3D734075121-07092008><FONT face=3DArial color=3D#0000ff = size=3D2>it is=20 produced on stdout by NUnit is just an implementation detail and not a=20 requirement.</FONT></SPAN></DIV> <DIV><SPAN class=3D734075121-07092008><FONT face=3DArial color=3D#0000ff = size=3D2></FONT></SPAN> </DIV> <DIV><SPAN class=3D734075121-07092008><FONT face=3DArial color=3D#0000ff = size=3D2>AFAICS, you can do everything you want using any of the options = I=20 described in the last</FONT></SPAN></DIV> <DIV><SPAN class=3D734075121-07092008><FONT face=3DArial color=3D#0000ff = size=3D2>note.=20 If it's not clear, I'll try to supply more detail.</FONT></SPAN></DIV> <DIV><SPAN class=3D734075121-07092008><FONT face=3DArial color=3D#0000ff = size=3D2></FONT></SPAN> </DIV> <DIV><SPAN class=3D734075121-07092008><FONT face=3DArial color=3D#0000ff = size=3D2>Charlie</FONT></SPAN></DIV><BR> <BLOCKQUOTE=20 style=3D"PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px = solid; MARGIN-RIGHT: 0px"> <DIV class=3DOutlookMessageHeader lang=3Den-us dir=3Dltr align=3Dleft> <HR tabIndex=3D-1> <FONT face=3DTahoma size=3D2><B>From:</B>=20 [email protected]=20 [mailto:[email protected]] <B>On Behalf Of = </B>Jay=20 Lemmon<BR><B>Sent:</B> Sunday, September 07, 2008 2:29 = PM<BR><B>To:</B>=20 [email protected]<BR><B>Subject:</B> Re: [Nunit-users] = 2.5=20 console runner documenation<BR></FONT><BR></DIV> <DIV></DIV> <TABLE cellSpacing=3D0 cellPadding=3D0 border=3D0> <TBODY> <TR> <TD vAlign=3Dtop>A quick follow up to my last email. This is = the=20 format I'm looking for the console runner to output. I = need it=20 this way because it mirrors the output from another unit testing = framework (UnitTest++), so it makes everything nice and = consistent for=20 my tool=20 = chain.<BR><BR>c:\glassworksstudio\lodestone\source\trunk\unittests\quarti= ctests.cpp(56):=20 error: Failure in Fixture1.Test_1: Expected 0 but was=20 = 2<BR>c:\glassworksstudio\lodestone\source\trunk\unittests\quartictests.cp= p(63):=20 error: Failure in Fixture1.Test_2: 20 < 10<BR>FAILURE: 2 out = of 156=20 tests failed (2 failures).<BR>Test time: 0.02 = seconds.<BR><BR>Note each=20 test failure follows this format:<BR>[file]([line]): error: = Failure in=20 [TestFixture].[TestName]: [Error message]<BR>all inline, with a = new line=20 for each failed test. Then a summary report and the time = to run=20 the tests comes last.<BR><BR>-Jay Lemmon<BR><BR>--- On <B>Sun, = 9/7/08,=20 Jay Lemmon <I><[email protected]></I></B> wrote:<BR> <BLOCKQUOTE=20 style=3D"PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: = rgb(16,16,255) 2px solid">From:=20 Jay Lemmon <[email protected]><BR>Subject: Re: = [Nunit-users]=20 2.5 console runner documenation<BR>To:=20 [email protected]<BR>Date: Sunday, September = 7, 2008,=20 2:16 PM<BR><BR> <DIV id=3Dyiv1061438529> <TABLE cellSpacing=3D0 cellPadding=3D0 border=3D0> <TBODY> <TR> <TD=20 style=3D"FONT-FAMILY: inherit; font-size-adjust: inherit; = font-stretch: inherit; -x-system-font: none"=20 vAlign=3Dtop>Well I can't speak for anyone else, but = customizing=20 the (console) output of the console runner is important = to=20 me. If it's impossible in 2.5, it'll mean I can't = upgrade=20 :(<BR><BR>It doesn't have to be xslt. And it = doesn't have=20 to be a command line switch. Right now I'm = actually=20 linking against the console runner assemblies (DLLs) to = build my=20 own custom EXE for every test project I build, so it = could be=20 something done purely in code. How is the format = for the=20 console runner decided right now if it's not = xslt?<BR><BR>-Jay=20 Lemmon<BR><BR>--- On <B>Sun, 9/7/08, Charlie Poole=20 <I><[email protected]></I></B> = wrote:<BR> <BLOCKQUOTE=20 style=3D"PADDING-LEFT: 5px; MARGIN-LEFT: 5px; = BORDER-LEFT: rgb(16,16,255) 2px solid">From:=20 Charlie Poole = <[email protected]><BR>Subject:=20 Re: [Nunit-users] 2.5 console runner = documenation<BR>To:=20 [email protected]<BR>Date: Sunday, = September=20 7, 2008, 1:10 PM<BR><BR> <DIV id=3Dyiv1697249361> <DIV><SPAN class=3D093490620-07092008></SPAN><FONT=20 face=3DArial><FONT color=3D#0000ff><FONT=20 size=3D2>Hi Jay,</FONT></FONT></FONT></DIV> <DIV><FONT face=3DArial><FONT color=3D#0000ff><FONT=20 size=3D2></FONT></FONT></FONT> </DIV> <DIV><FONT size=3D+0><FONT size=3D+0><FONT = face=3DArial><FONT=20 color=3D#0000ff><FONT size=3D2>T<SPAN=20 class=3D093490620-07092008>here doesn't seem to be a = real need=20 to customize console output, except possibly to=20 have</SPAN></FONT></FONT></FONT></FONT></FONT></DIV> <DIV><FONT size=3D+0><FONT size=3D+0><FONT = face=3DArial><FONT=20 color=3D#0000ff><FONT size=3D2><SPAN=20 class=3D093490620-07092008>NUnit show more detailed = info - an=20 option I'm working on. Most people using the old=20 = feature</SPAN></FONT></FONT></FONT></FONT></FONT></DIV> <DIV><SPAN class=3D093490620-07092008></SPAN><FONT=20 face=3DArial><FONT color=3D#0000ff><FONT = size=3D2>s<SPAN=20 class=3D093490620-07092008>eemed to be producing html = with it.=20 That's still possible, but the xml would need to be=20 </SPAN></FONT></FONT></FONT></DIV> <DIV><FONT face=3DArial><FONT color=3D#0000ff><FONT = size=3D2><SPAN=20 class=3D093490620-07092008>formatted after=20 the</SPAN></FONT></FONT></FONT><FONT = face=3DArial><FONT=20 color=3D#0000ff><FONT size=3D2><SPAN = class=3D093490620-07092008>=20 NUnit run.</SPAN></FONT></FONT></FONT></DIV> <DIV><FONT face=3DArial><FONT color=3D#0000ff><FONT = size=3D2><SPAN=20 = class=3D093490620-07092008></SPAN></FONT></FONT></FONT> </DIV> <DIV><FONT face=3DArial><FONT color=3D#0000ff><FONT = size=3D2><SPAN=20 = class=3D093490620-07092008>Charlie</SPAN></FONT></FONT></FONT></DIV> <DIV><BR></DIV> <BLOCKQUOTE=20 style=3D"PADDING-LEFT: 5px; MARGIN-LEFT: 5px; = BORDER-LEFT: rgb(0,0,255) 2px solid; MARGIN-RIGHT: 0px"> <DIV class=3DOutlookMessageHeader lang=3Den-us = dir=3Dltr=20 align=3Dleft> <HR tabIndex=3D-1> <FONT face=3DTahoma size=3D2><B>From:</B>=20 [email protected]=20 [mailto:[email protected]] = <B>On=20 Behalf Of </B>Jay Lemmon<BR><B>Sent:</B> Sunday, = September=20 07, 2008 12:54 PM<BR><B>To:</B>=20 [email protected]<BR><B>Subject:</B> = Re:=20 [Nunit-users] 2.5 console runner=20 documenation<BR></FONT><BR></DIV> <DIV></DIV> <TABLE cellSpacing=3D0 cellPadding=3D0 border=3D0> <TBODY> <TR> <TD vAlign=3Dtop>I just copied the 2.5 binaries = over my=20 old binaries, so it wasn't a fool proof test, = no=20 :)<BR><BR>So how do I, the end user, customize = console=20 output now? The release notes don't = mention=20 anything in this regard.<BR><BR>-Jay = Lemmon<BR><BR>---=20 On <B>Sun, 9/7/08, Charlie Poole=20 <I><[email protected]></I></B> = wrote:<BR> <BLOCKQUOTE=20 style=3D"PADDING-LEFT: 5px; MARGIN-LEFT: 5px; = BORDER-LEFT: rgb(16,16,255) 2px solid">From:=20 Charlie Poole=20 = <[email protected]><BR>Subject: Re:=20 [Nunit-users] 2.5 console runner = documenation<BR>To:=20 [email protected]<BR>Date: = Sunday,=20 September 7, 2008, 6:39 AM<BR><BR> <DIV id=3Dyiv257795230> <DIV><FONT face=3DArial color=3D#0000ff = size=3D2><SPAN=20 class=3D796543513-07092008>Hi = Jay,</SPAN></FONT></DIV> <DIV><FONT face=3DArial color=3D#0000ff = size=3D2><SPAN=20 = class=3D796543513-07092008></SPAN></FONT> </DIV> <DIV><FONT face=3DArial color=3D#0000ff = size=3D2><SPAN=20 class=3D796543513-07092008>There's mention = in the=20 release notes, under 2.5 alpha 1, about the = removal=20 of the transform</SPAN></FONT></DIV> <DIV><FONT face=3DArial color=3D#0000ff = size=3D2><SPAN=20 class=3D796543513-07092008>option. The = console output=20 is now indepedent of the xml, so it no = longer has=20 any purpose.</SPAN></FONT></DIV> <DIV><FONT face=3DArial color=3D#0000ff = size=3D2><SPAN=20 = class=3D796543513-07092008></SPAN></FONT> </DIV> <DIV><FONT face=3DArial color=3D#0000ff = size=3D2><SPAN=20 class=3D796543513-07092008>Since the option = is no=20 longer there, I'm pretty sure it can't be = working.=20 :-) Are you sure</SPAN></FONT></DIV> <DIV><FONT face=3DArial color=3D#0000ff = size=3D2><SPAN=20 class=3D796543513-07092008>you were using = 2.5 for your=20 test?</SPAN></FONT></DIV> <DIV><FONT face=3DArial color=3D#0000ff = size=3D2><SPAN=20 = class=3D796543513-07092008></SPAN></FONT> </DIV> <DIV><FONT face=3DArial color=3D#0000ff = size=3D2><SPAN=20 = class=3D796543513-07092008>Charlie</SPAN></FONT></DIV><BR> <BLOCKQUOTE=20 style=3D"PADDING-LEFT: 5px; MARGIN-LEFT: = 5px; BORDER-LEFT: rgb(0,0,255) 2px solid; MARGIN-RIGHT: 0px"> <DIV class=3DOutlookMessageHeader = lang=3Den-us dir=3Dltr=20 align=3Dleft> <HR tabIndex=3D-1> <FONT face=3DTahoma size=3D2><B>From:</B>=20 [email protected]=20 = [mailto:[email protected]]=20 <B>On Behalf Of </B>Jay = Lemmon<BR><B>Sent:</B>=20 Saturday, September 06, 2008 9:42 = PM<BR><B>To:</B>=20 = [email protected]<BR><B>Subject:</B>=20 [Nunit-users] 2.5 console runner=20 documenation<BR></FONT><BR></DIV> <DIV></DIV> <TABLE cellSpacing=3D0 cellPadding=3D0 = border=3D0> <TBODY> <TR> <TD vAlign=3Dtop>When comparing the = 2.4.8 docs and=20 the 2.5 docs, I noticed that this = section in=20 console runner: command-line was mostly = deleted=20 and partly merged with the one before=20 it:<BR><BR><SPAN=20 style=3D"FONT-WEIGHT: bold">"Specifying = the=20 Transform file</SPAN><BR=20 style=3D"FONT-WEIGHT: bold"><BR=20 style=3D"FONT-WEIGHT: bold"><SPAN=20 style=3D"FONT-WEIGHT: bold">The console = interface=20 uses XSLT to transform the test results = from the=20 XML file to what is printed to the = screen when=20 the program executes. The console = interface has=20 a default transformation that is part of = the=20 executable. To specify your own = transformation=20 named "myTransform.xslt" use the = following=20 command line option:</SPAN><BR=20 style=3D"FONT-WEIGHT: bold"><BR=20 style=3D"FONT-WEIGHT: bold"><SPAN=20 style=3D"FONT-WEIGHT: = bold">nunit-console=20 /transform:myTransform.xslt=20 nunit.tests.dll</SPAN><BR=20 style=3D"FONT-WEIGHT: bold"><BR=20 style=3D"FONT-WEIGHT: bold"><SPAN=20 style=3D"FONT-WEIGHT: bold">Note: For = additional=20 information see the XML schema for the = test=20 results. This file is in the same = directory as=20 the executable and is called = Results.xsd. The=20 default transform Summary.xslt is = located in the=20 core source directory."</SPAN><BR=20 style=3D"FONT-WEIGHT: bold"><BR>In the = 2.5 docs,=20 there's no such section, and the mention = of the=20 Results.xsd is merged in to the section = before=20 it on specifying an output xml = file.<BR><BR>Is=20 this an error in the docs, or is this = feature=20 (specifying a transform) going to be = removed in=20 2.5? A quick test shows that it still=20 works.<BR><BR>-Jay=20 = Lemmon<BR></TD></TR></TBODY></TABLE><BR></BLOCKQUOTE></DIV><PRE>---------= ----------------------------------------------------------------<BR>This = SF.Net email is sponsored by the Moblin Your Move = Developer's<BR>challenge<BR>Build the coolest Linux based applications = with Moblin SDK & win great<BR>prizes<BR>Grand prize is a trip for = two to an Open Source event anywhere in the = world<BR>http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D= /</PRE><PRE>_______________________________________________<BR>Nunit-user= s mailing = list<BR>[email protected]<BR>https://lists.sourceforge.ne= t/lists/listinfo/nunit-users<BR></PRE></BLOCKQUOTE></TD></TR></TBODY></TA= BLE><BR></BLOCKQUOTE></DIV><PRE>-----------------------------------------= --------------------------------<BR>This SF.Net email is sponsored by = the Moblin Your Move Developer's<BR>challenge<BR>Build the coolest Linux = based applications with Moblin SDK & win<BR> great<BR>prizes<BR>Grand prize is a trip for two to an Open Source = event anywhere in the = world<BR>http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D= /</PRE><PRE>_______________________________________________<BR>Nunit-user= s mailing = list<BR>[email protected]<BR>https://lists.sourceforge.ne= t/lists/listinfo/nunit-users<BR></PRE></BLOCKQUOTE></TD></TR></TBODY></TA= BLE><BR></DIV><PRE>------------------------------------------------------= -------------------<BR>This SF.Net email is sponsored by the Moblin Your = Move Developer's<BR>challenge<BR>Build the coolest Linux based = applications with Moblin SDK & win great<BR>prizes<BR>Grand prize is = a trip for two to an Open Source event anywhere in the = world<BR>http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D= /</PRE><PRE>_______________________________________________<BR>Nunit-user= s mailing = list<BR>[email protected]<BR>https://lists.sourceforge.ne= t/lists/listinfo/nunit-users<BR></PRE></BLOCKQUOTE></TD></TR></TBODY></TA= BLE><BR></BLOCKQUOTE></BODY></HTML> ------=_NextPart_000_002B_01C910F9.9B3717F0-- --===============1821774720== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ --===============1821774720== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Nunit-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nunit-users --===============1821774720==--