Re: 2.5 console runner documenation
Jay Lemmon <[email protected]> Sun, 7 Sep 2008 22:38:23 -0700 (PDT)
| Newsgroups | gmane.comp.windows.dotnet.nunit.user |
|---|---|
| Message-ID | <[email protected]> |
--===============1417722035== Content-Type: multipart/alternative; boundary="0-421974720-1220852303=:4721" --0-421974720-1220852303=:4721 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable I'm not sure I see how using a documented feature is out of the ordinary :)= =A0=20 Really, if it's the only way to customize the console output to produce ext= ra terse output, it'd be a shame to scrap it entirely.=A0 It's like the /b = option for the dir command in dos.=A0 Sometimes you just need something tha= t outputs the bear minimal information.=A0 The benefit of xslt is that you = can go beyond that and customize things however you like.=A0 I apologize th= at I wasn't around to voice a vote when you were looking for opinions of th= e matter.=A0 And I appreciate that xslt is a pain to use for something as s= imple as this.=A0 But I guarantee if you don't have something to replace it= s functionality you're going to get other users grumbling, too.=A0 I can't = be the only one that works from the command line, relying on stdout. Is it that you're not familiar with xslt, and another contributor who isn't= around anymore is the one who added it?=A0 I can appreciate that, too.=A0 = But really, it should be a simple matter to test one way or another on cons= ole output.=A0 If the transform file was specified, feed the current test's= output XML into it and print the result to stdout.=A0 Otherwise use whatev= er system you've built to replace it.=A0 Just because the system can use xs= lt doesn't mean YOU have to.=A0 This just seems like a case where you shoul= dn't be breaking backwards compatibility for no reason. Actually, if NUnit didn't have the transform option on the console, you and= I wouldn't be having this conversation.=A0 I would have found another unit= testing framework that did what I needed.=A0 At the very least you need to= have a little error message saying that -transform is no longer supported = if you try to run the console runner with that option. Okay, my little rant over, let's get to the matter at hand.=A0 1 and 2 won'= t work, because I need the output to go to the console before the unit test= s can return a return code.=A0 That's really the way the whole chain is set= up, and it'd be a major pain to change things. #3 sounds promising.=A0 Looking through the source it doesn't seem too bad.= =A0 What's a mile high overview of what ConsoleUi does?=A0 It's only summar= y statement is: "Summary description for ConsoleUi.", which isn't terribly = descriptive ;) The other option is the non-action of just sticking with the 2.4.X fork and= lumping it.=A0 Right now there's nothing in 2.5 that I need, but I'd hate = to cut myself off from future updates. -Jay Lemmon --- On Sun, 9/7/08, Charlie Poole <[email protected]> wrote: From: Charlie Poole <[email protected]> Subject: RE: [Nunit-users] 2.5 console runner documenation To: [email protected] Date: Sunday, September 7, 2008, 5:32 PM =20 Hi=20 Jay, =A0 I'll=20 start with the last question: based on feedback from users, most=20 people assumed that the option caused the xml file to be=20 reformatted, not the console output. I got a lot of "bugs" about how using=20 /transform broke the=20 console output and sent html to stdout instead of to the file.=20 :-) =A0 The=20 xml is the primary output from nunit and it seemed that=20 anyone wanting=A0to reformat it=A0could do so easily=20 enough. My own little command-line utility that reformats the xml using a stylesheet=20 is about 15 lines long. =A0 But=20 using something as sophisticated as xml and xslt just to produce=20 the command-line output, which is not intended for=20 reporting purposes seemed like a=20 waste of effort=A0- using a sledge hammer to crack walnuts. More=20 important, it=20 coupled two different things together: console output and reporting,=20 making it=20 very ard to=A0change either one. With a reporting subsystem on the=20 drawing board,=A0I didn't want to have to think about how=20 changes in the xml would impact the=A0nunit-console display. =A0 Back=20 to your problem, then... =A0 I see=20 five options... =A0 1. Use=20 the /xmlconsole switch to send the xml to the console and add a filter=20 program to=20 your toolchain to reformat it. =A0 2. Use=20 the same external filter program with TestResult.xml as it's=20 input. =A0 3. Do=20 the reformatting within your own runner, taking the code=20 from ConsoleUi.cs. =A0 4.=20 Replicate the nunit logic in your own runner - i.e. copy it - and=20 modify the=20 runner to write output in the form you prefer. =A0 5.=20 Same as #4, but modify the event handlers in EventCollector.cs=20 to do the=20 same thing. =A0 =A0 I=20 don't think any of these are particularly harder than what you=20 have done -=20 but of course, you've already done that work, so I recognize=20 this=20 is extra effort for you. I apologize for that, but I think this=20 change will=20 get us farther in the long run. =A0 Charlie =A0 PS:=20 The change was discussed before and at the time of=20 implementing. It's=20 good to be involved in such list disussions, particularly if you=20 know you're=20 doing something a little out of the ordinary. =A0 =A0 =20 =20 From: Jay Lemmon=20 [mailto:[email protected]]=20 Sent: Sunday, September 07, 2008=20 3:04 PM To: Charlie Poole Subject: Re: [Nunit-users] 2.5=20 console runner documenation =20 =20 =20 =20 Yes, I'm still pretty raw with NUnit, so any help would=20 be appreciated :) My tool chain is set to use the console pretty=20 exclusively.=A0 That means stdout AND return codes.=A0 Also, the=20 stdout needs to be kept very clean, because I don't want to write a= lot=20 of special logic excising extra data.=A0 So a command line option= =20 would probably be too weird. So that leaves something done in=20 code.=A0 Right now my test runner is pretty stupid.=A0 It just=20 adds some command line switches automatically to the console option= s and=20 feeds it to the console runner library.=A0 How deeply am I going to= =20 have to dig in to the code to get what I need? Also, out of=20 curiosity, why was the xslt option removed?=A0 It seems like a step= =20 backwards without the corresponding two steps forward.=A0 But then = my=20 scope is pretty narrow :) -Jay Lemmon --- On Sun,=20 9/7/08, Charlie Poole <[email protected]>=20 wrote: From:=20 Charlie Poole <[email protected]> Subject: Re:=20 [Nunit-users] 2.5 console runner documenation To:=20 [email protected], [email protected] Date:=20 Sunday, September 7, 2008, 2:54 PM =20 That sounds like a valid=A0use case, altough unusual. What's=20 interesting is that it matches exactly the use cases I wrote about earlier: You want a report in a=20 particular format, but the fact that it is produced on stdout by NUnit is just an implementation=20 detail and not a requirement. =A0 AFAICS, you can do everything you want using any of the options= =20 I described in the last note. If it's not clear, I'll try to supply more=20 detail. =A0 Charlie ... The output is created in code. You could certainly do that=20 yourself if you like. Essentially, you have two choices: to look = at=20 the final tree of results, as NUnit does, or to handle each test= =20 result as it comes along - which is how NUnit creates it's test= =20 output. =A0 Of course, you can also continue to use xslt as you now do -=20 you just can't have=20 NUnit apply the xslt for you. That's trivial to do at the end=20 of the test run by taking the xml output adn transforming it. =A0 Charlie =20 =20 =20 From:=20 [email protected]=20 [mailto:[email protected]] On Behalf Of= =20 Jay Lemmon Sent: Sunday, September 07, 2008 2:29=20 PM To:=20 [email protected] Subject: Re:=20 [Nunit-users] 2.5 console runner documenation =20 =20 =20 =20 A quick follow up to my last email.=A0 This=20 is the format I'm looking for the console runner to=20 output.=A0 I need it this way because it mirrors the outp= ut=20 from another unit testing framework (UnitTest++), so it m= akes=20 everything nice and consistent for my tool=20 chain. c:\glassworksstudio\lodestone\source\trunk\unittests\quartictests.cpp(56):= =20 error: Failure in Fixture1.Test_1: Expected 0 but was=20 2 c:\glassworksstudio\lodestone\source\trunk\unittests\quartictests.cpp(63):= =20 error: Failure in Fixture1.Test_2: 20 < 10 FAILURE: 2=20 out of 156 tests failed (2 failures). Test time: 0.02=20 seconds. Note each test failure follows this=20 format: [file]([line]): error: Failure in=20 [TestFixture].[TestName]: [Error message] all inline, with=20 a new line for each failed test.=A0 Then a summary report= =20 and the time to run the tests comes last. -Jay=20 Lemmon --- On Sun, 9/7/08, Jay Lemmon=20 <[email protected]> wrote: From:=20 Jay Lemmon <[email protected]> Subject: Re:=20 [Nunit-users] 2.5 console runner documenation To:=20 [email protected] Date: Sunday, September=20 7, 2008, 2:16 PM =20 =20 =20 =20 Well I can't speak for anyone else, but=20 customizing the (console) output of the console r= unner=20 is important to me.=A0 If it's impossible in 2.5,= =20 it'll mean I can't upgrade :( It doesn't have=20 to be xslt.=A0 And it doesn't have to be a comman= d=20 line switch.=A0 Right now I'm actually linking=20 against the console runner assemblies (DLLs) to b= uild=20 my own custom EXE for every test project I build,= so=20 it could be something done purely in code.=A0 How= =20 is the format for the console runner decided righ= t now=20 if it's not xslt? -Jay Lemmon --- On=20 Sun, 9/7/08, Charlie Poole=20 <[email protected]>=20 wrote: From:=20 Charlie Poole=20 <[email protected]> Subject: Re:=20 [Nunit-users] 2.5 console runner documenation To:=20 [email protected] Date: Sunday,=20 September 7, 2008, 1:10 PM =20 Hi=A0Jay, =A0 There doesn't seem to be a=20 real need to customize console output, except= =20 possibly to=20 have NUnit show more detailed=20 info - an option I'm working on. Most people=20 using=A0the old=20 feature seemed to be producing html=20 with it. That's still possible, but the xml wou= ld=20 need to be=20 formatted=20 after the NUnit=20 run. =A0 Charlie =20 =20 =20 =20 From:=20 [email protected]=20 [mailto:[email protected]= .net]=20 On Behalf Of Jay Lemmon Sent:=20 Sunday, September 07, 2008 12:54 PM To:=20 [email protected] Subject:=20 Re: [Nunit-users] 2.5 console runner=20 documenation =20 =20 =20 =20 I just copied the 2.5 binaries=20 over my old binaries, so it wasn't a fool p= roof=20 test, no :) So how do I, the end user,=20 customize console output now?=A0 The releas= e=20 notes don't mention anything in this=20 regard. -Jay Lemmon --- On Sun,=20 9/7/08, Charlie Poole=20 <[email protected]>=20 wrote: From:=20 Charlie Poole=20 <[email protected]> Subject:=20 Re: [Nunit-users] 2.5 console runner=20 documenation To:=20 [email protected] Date:=20 Sunday, September 7, 2008, 6:39 AM =20 Hi=20 Jay, =A0 There's mention in the=20 release notes, under 2.5 alpha 1, about the= =20 removal of the transform option. The console=20 output is now indepedent of the xml, so it = no=20 longer has any purpose. =A0 Since the option is no=20 longer there, I'm pretty sure it can't be= =20 working. :-) Are you sure you were using 2.5 for=20 your test? =A0 Charlie =20 =20 =20 From:=20 [email protected]= =20 [mailto:[email protected]= ge.net]=20 On Behalf Of Jay Lemmon Sent:=20 Saturday, September 06, 2008 9:42=20 PM To:=20 [email protected] Subject:=20 [Nunit-users] 2.5 console runner=20 documenation =20 =20 =20 =20 When comparing the 2.4.8 docs and=20 the 2.5 docs, I noticed that this section i= n=20 console runner: command-line was mostly del= eted=20 and partly merged with the one before=20 it: "Specifying the=20 Transform file The console interface=20 uses XSLT to transform the test results fro= m the=20 XML file to what is printed to the screen w= hen=20 the program executes. The console interface= has=20 a default transformation that is part of th= e=20 executable. To specify your own transformat= ion=20 named "myTransform.xslt" use the following= =20 command line option: nunit-console=20 /transform:myTransform.xslt=20 nunit.tests.dll Note: For additional=20 information see the XML schema for the test= =20 results. This file is in the same directory= as=20 the executable and is called Results.xsd. T= he=20 default transform Summary.xslt is located i= n the=20 core source directory." In the 2.5 docs,=20 there's no such section, and the mention of= the=20 Results.xsd is merged in to the section bef= ore=20 it on specifying an output xml file. Is=20 this an error in the docs, or is this featu= re=20 (specifying a transform) going to be remove= d in=20 2.5? A quick test shows that it still=20 works. -Jay=20 Lemmon ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D/_____________= __________________________________ Nunit-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nunit-users ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D/_____________= __________________________________ Nunit-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nunit-users ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D/_____________= __________________________________ Nunit-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nunit-users ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D/_____________= __________________________________ Nunit-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nunit-users =0A=0A=0A --0-421974720-1220852303=:4721 Content-Type: text/html; charset=us-ascii <table cellspacing="0" cellpadding="0" border="0" ><tr><td valign="top" style="font: inherit;">I'm not sure I see how using a documented feature is out of the ordinary :) <br><br>Really, if it's the only way to customize the console output to produce extra terse output, it'd be a shame to scrap it entirely. It's like the /b option for the dir command in dos. Sometimes you just need something that outputs the bear minimal information. The benefit of xslt is that you can go beyond that and customize things however you like. I apologize that I wasn't around to voice a vote when you were looking for opinions of the matter. And I appreciate that xslt is a pain to use for something as simple as this. But I guarantee if you don't have something to replace its functionality you're going to get other users grumbling, too. I can't be the only one that works from the command line, relying on stdout.<br><br>Is it that you're not familiar with xslt, and another contributor who isn't around anymore is the one who added it? I can appreciate that, too. But really, it should be a simple matter to test one way or another on console output. If the transform file was specified, feed the current test's output XML into it and print the result to stdout. Otherwise use whatever system you've built to replace it. Just because the system can use xslt doesn't mean YOU have to. This just seems like a case where you shouldn't be breaking backwards compatibility for no reason.<br><br>Actually, if NUnit didn't have the transform option on the console, you and I wouldn't be having this conversation. I would have found another unit testing framework that did what I needed. At the very least you need to have a little error message saying that -transform is no longer supported if you try to run the console runner with that option.<br><br>Okay, my little rant over, let's get to the matter at hand. 1 and 2 won't work, because I need the output to go to the console before the unit tests can return a return code. That's really the way the whole chain is set up, and it'd be a major pain to change things.<br><br>#3 sounds promising. Looking through the source it doesn't seem too bad. What's a mile high overview of what ConsoleUi does? It's only summary statement is: "Summary description for ConsoleUi.", which isn't terribly descriptive ;)<br><br>The other option is the non-action of just sticking with the 2.4.X fork and lumping it. Right now there's nothing in 2.5 that I need, but I'd hate to cut myself off from future updates.<br><br>-Jay Lemmon<br><br>--- On <b>Sun, 9/7/08, C harlie Poole <i><[email protected]></i></b> wrote:<br><blockquote style="border-left: 2px solid rgb(16, 16, 255); margin-left: 5px; padding-left: 5px;">From: Charlie Poole <[email protected]><br>Subject: RE: [Nunit-users] 2.5 console runner documenation<br>To: [email protected]<br>Date: Sunday, September 7, 2008, 5:32 PM<br><br><div id="yiv134940637"> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">Hi Jay,</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">I'll start with the last question: based on feedback from users, most people</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">assumed that the option caused the xml file to be reformatted, not the</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">console output. I got a lot of "bugs" about how using /transform broke</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">the console output and sent html to stdout instead of to the file. :-)</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">The xml is the primary output from nunit and it seemed that anyone</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">wanting to reformat it could do so easily enough. My own little command-line</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">utility </span></font><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">that reformats the xml using a stylesheet is about 15 lines long.</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">But using something as sophisticated as xml and xslt just to produce the</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">command-line output, which is not intended for reporting purposes seemed</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">like a waste of effort - using a sledge hammer to crack walnuts. More important,</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">it coupled two different things together: console output and reporting, making</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">it very ard to change either one. With a reporting subsystem on the drawing</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">board, I didn't want to have to think about how changes in the xml would impact</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">the nunit-console display.</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">Back to your problem, then...</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">I see five options...</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">1. Use the /xmlconsole switch to send the xml to the console and add a filter program</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">to your toolchain to reformat it.</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">2. Use the same external filter program with TestResult.xml as it's input.</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">3. Do the reformatting within your own runner, taking the code from</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">ConsoleUi.cs.</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">4. Replicate the nunit logic in your own runner - i.e. copy it - and modify</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">the runner to write output in the form you prefer.</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">5. Same as #4, but modify the event handlers in EventCollector.cs to</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="328131400-08092008">do the same thing.</span></font></div> <div> </div> <div><font color="#0000ff" size="2" face="Arial"></font> </div> <div><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial">I don't think any of these are particularly harder than what you have</font></span></div> <div><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial">done - but of course, you've already done that work, </font></span><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial">so I recognize </font></span></div> <div><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial">this is extra effort for you. I apologize for that, but I think this change</font></span></div> <div><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial">will get us farther in the long run.</font></span></div> <div><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial"></font></span> </div> <div><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial">Charlie</font></span></div> <div><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial"></font></span> </div> <div><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial">PS: The change was discussed before and at the time of implementing.</font></span></div> <div><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial">It's good to be involved in such list disussions, particularly if you know</font></span></div> <div><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial">you're doing something a little out of the ordinary.</font></span></div> <div><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial"></font></span> </div> <div><span class="328131400-08092008"><font color="#0000ff" size="2" face="Arial"></font></span> </div> <div><br></div> <blockquote style="border-left: 2px solid rgb(0, 0, 255); padding-left: 5px; margin-left: 5px; margin-right: 0px;"> <div class="OutlookMessageHeader" dir="ltr" align="left" lang="en-us"> <hr tabindex="-1"> <font size="2" face="Tahoma"><b>From:</b> Jay Lemmon [mailto:[email protected]] <br><b>Sent:</b> Sunday, September 07, 2008 3:04 PM<br><b>To:</b> Charlie Poole<br><b>Subject:</b> Re: [Nunit-users] 2.5 console runner documenation<br></font><br></div> <div></div> <table border="0" cellpadding="0" cellspacing="0"> <tbody> <tr> <td valign="top">Yes, I'm still pretty raw with NUnit, so any help would be appreciated :)<br><br>My tool chain is set to use the console pretty exclusively. That means stdout AND return codes. Also, the stdout needs to be kept very clean, because I don't want to write a lot of special logic excising extra data. So a command line option would probably be too weird.<br><br>So that leaves something done in code. Right now my test runner is pretty stupid. It just adds some command line switches automatically to the console options and feeds it to the console runner library. How deeply am I going to have to dig in to the code to get what I need?<br><br>Also, out of curiosity, why was the xslt option removed? It seems like a step backwards without the corresponding two steps forward. But then my scope is pretty narrow :)<br><br>-Jay Lemmon<br><br>--- On <b>Sun, 9/7/08, Charlie Poole <i><[email protected]></i></b> wrote:<br> <blockquote style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;">From: Charlie Poole <[email protected]><br>Subject: Re: [Nunit-users] 2.5 console runner documenation<br>To: [email protected], [email protected]<br>Date: Sunday, September 7, 2008, 2:54 PM<br><br> <div id="yiv1828285976"> <div><span class="734075121-07092008"><font color="#0000ff" size="2" face="Arial">That sounds like a valid use case, altough unusual. What's interesting is that it matches exactly</font></span></div> <div><span class="734075121-07092008"><font color="#0000ff" size="2" face="Arial">the use cases I wrote about earlier: You want a report in a particular format, but the fact that</font></span></div> <div><span class="734075121-07092008"><font color="#0000ff" size="2" face="Arial">it is produced on stdout by NUnit is just an implementation detail and not a requirement.</font></span></div> <div><span class="734075121-07092008"><font color="#0000ff" size="2" face="Arial"></font></span> </div> <div><span class="734075121-07092008"><font color="#0000ff" size="2" face="Arial">AFAICS, you can do everything you want using any of the options I described in the last</font></span></div> <div><span class="734075121-07092008"><font color="#0000ff" size="2" face="Arial">note. If it's not clear, I'll try to supply more detail.</font></span></div> <div><span class="734075121-07092008"><font color="#0000ff" size="2" face="Arial"></font></span> </div> <div><span class="734075121-07092008"><font color="#0000ff" size="2" face="Arial">Charlie</font></span></div><br>...<br><br> <div><span class="718164621-07092008"><font color="#0000ff" size="2" face="Arial">The output is created in code. You could certainly do that yourself if you like. Essentially, you have two choices: to look at the final tree of results, as NUnit does, or to handle each test result as it comes along - which is how NUnit creates it's test output.</font></span></div> <div><span class="718164621-07092008"></span> </div> <div><span class="718164621-07092008"><font color="#0000ff" size="2" face="Arial">Of course, you can also continue to use xslt as you now do - you just can't have </font></span></div> <div><span class="718164621-07092008"><font color="#0000ff" size="2" face="Arial">NUnit apply the xslt for you. That's trivial to do at the end of the test run by taking</font></span></div> <div><span class="718164621-07092008"><font color="#0000ff" size="2" face="Arial">the xml output adn transforming it.</font></span></div> <div><span class="718164621-07092008"></span> </div> <div><span class="718164621-07092008"><font color="#0000ff" size="2" face="Arial">Charlie</font></span></div><br> <blockquote style="border-left: 2px solid rgb(0, 0, 255); padding-left: 5px; margin-left: 5px; margin-right: 0px;"> <div class="OutlookMessageHeader" dir="ltr" align="left" lang="en-us"> <hr tabindex="-1"> <font size="2" face="Tahoma"><b>From:</b> [email protected] [mailto:[email protected]] <b>On Behalf Of </b>Jay Lemmon<br><b>Sent:</b> Sunday, September 07, 2008 2:29 PM<br><b>To:</b> [email protected]<br><b>Subject:</b> Re: [Nunit-users] 2.5 console runner documenation<br></font><br></div> <div></div> <table border="0" cellpadding="0" cellspacing="0"> <tbody> <tr> <td valign="top">A quick follow up to my last email. This is the format I'm looking for the console runner to output. I need it this way because it mirrors the output from another unit testing framework (UnitTest++), so it makes everything nice and consistent for my tool chain.<br><br>c:\glassworksstudio\lodestone\source\trunk\unittests\quartictests.cpp(56): error: Failure in Fixture1.Test_1: Expected 0 but was 2<br>c:\glassworksstudio\lodestone\source\trunk\unittests\quartictests.cpp(63): error: Failure in Fixture1.Test_2: 20 < 10<br>FAILURE: 2 out of 156 tests failed (2 failures).<br>Test time: 0.02 seconds.<br><br>Note each test failure follows this format:<br>[file]([line]): error: Failure in [TestFixture].[TestName]: [Error message]<br>all inline, with a new line for each failed test. Then a summary report and the time to run the tests comes last.<br><br>-Jay Lemmon<br><br>--- On <b>Sun, 9/7/08, Jay Lemmon <i><[email protected]></i></b> wrote:<br> <blockquote style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;">From: Jay Lemmon <[email protected]><br>Subject: Re: [Nunit-users] 2.5 console runner documenation<br>To: [email protected]<br>Date: Sunday, September 7, 2008, 2:16 PM<br><br> <div id="yiv1061438529"> <table border="0" cellpadding="0" cellspacing="0"> <tbody> <tr> <td style="font-family: inherit; font-size-adjust: inherit; font-stretch: inherit;" valign="top">Well I can't speak for anyone else, but customizing the (console) output of the console runner is important to me. If it's impossible in 2.5, it'll mean I can't upgrade :(<br><br>It doesn't have to be xslt. And it doesn't have to be a command line switch. Right now I'm actually linking against the console runner assemblies (DLLs) to build my own custom EXE for every test project I build, so it could be something done purely in code. How is the format for the console runner decided right now if it's not xslt?<br><br>-Jay Lemmon<br><br>--- On <b>Sun, 9/7/08, Charlie Poole <i><[email protected]></i></b> wrote:<br> <blockquote style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;">From: Charlie Poole <[email protected]><br>Subject: Re: [Nunit-users] 2.5 console runner documenation<br>To: [email protected]<br>Date: Sunday, September 7, 2008, 1:10 PM<br><br> <div id="yiv1697249361"> <div><span class="093490620-07092008"></span><font face="Arial"><font color="#0000ff"><font size="2">Hi Jay,</font></font></font></div> <div><font face="Arial"><font color="#0000ff"><font size="2"></font></font></font> </div> <div><font size="+0"><font size="+0"><font face="Arial"><font color="#0000ff"><font size="2">T<span class="093490620-07092008">here doesn't seem to be a real need to customize console output, except possibly to have</span></font></font></font></font></font></div> <div><font size="+0"><font size="+0"><font face="Arial"><font color="#0000ff"><font size="2"><span class="093490620-07092008">NUnit show more detailed info - an option I'm working on. Most people using the old feature</span></font></font></font></font></font></div> <div><span class="093490620-07092008"></span><font face="Arial"><font color="#0000ff"><font size="2">s<span class="093490620-07092008">eemed to be producing html with it. That's still possible, but the xml would need to be </span></font></font></font></div> <div><font face="Arial"><font color="#0000ff"><font size="2"><span class="093490620-07092008">formatted after the</span></font></font></font><font face="Arial"><font color="#0000ff"><font size="2"><span class="093490620-07092008"> NUnit run.</span></font></font></font></div> <div><font face="Arial"><font color="#0000ff"><font size="2"><span class="093490620-07092008"></span></font></font></font> </div> <div><font face="Arial"><font color="#0000ff"><font size="2"><span class="093490620-07092008">Charlie</span></font></font></font></div> <div><br></div> <blockquote style="border-left: 2px solid rgb(0, 0, 255); padding-left: 5px; margin-left: 5px; margin-right: 0px;"> <div class="OutlookMessageHeader" dir="ltr" align="left" lang="en-us"> <hr tabindex="-1"> <font size="2" face="Tahoma"><b>From:</b> [email protected] [mailto:[email protected]] <b>On Behalf Of </b>Jay Lemmon<br><b>Sent:</b> Sunday, September 07, 2008 12:54 PM<br><b>To:</b> [email protected]<br><b>Subject:</b> Re: [Nunit-users] 2.5 console runner documenation<br></font><br></div> <div></div> <table border="0" cellpadding="0" cellspacing="0"> <tbody> <tr> <td valign="top">I just copied the 2.5 binaries over my old binaries, so it wasn't a fool proof test, no :)<br><br>So how do I, the end user, customize console output now? The release notes don't mention anything in this regard.<br><br>-Jay Lemmon<br><br>--- On <b>Sun, 9/7/08, Charlie Poole <i><[email protected]></i></b> wrote:<br> <blockquote style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;">From: Charlie Poole <[email protected]><br>Subject: Re: [Nunit-users] 2.5 console runner documenation<br>To: [email protected]<br>Date: Sunday, September 7, 2008, 6:39 AM<br><br> <div id="yiv257795230"> <div><font color="#0000ff" size="2" face="Arial"><span class="796543513-07092008">Hi Jay,</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="796543513-07092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="796543513-07092008">There's mention in the release notes, under 2.5 alpha 1, about the removal of the transform</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="796543513-07092008">option. The console output is now indepedent of the xml, so it no longer has any purpose.</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="796543513-07092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="796543513-07092008">Since the option is no longer there, I'm pretty sure it can't be working. :-) Are you sure</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="796543513-07092008">you were using 2.5 for your test?</span></font></div> <div><font color="#0000ff" size="2" face="Arial"><span class="796543513-07092008"></span></font> </div> <div><font color="#0000ff" size="2" face="Arial"><span class="796543513-07092008">Charlie</span></font></div><br> <blockquote style="border-left: 2px solid rgb(0, 0, 255); padding-left: 5px; margin-left: 5px; margin-right: 0px;"> <div class="OutlookMessageHeader" dir="ltr" align="left" lang="en-us"> <hr tabindex="-1"> <font size="2" face="Tahoma"><b>From:</b> [email protected] [mailto:[email protected]] <b>On Behalf Of </b>Jay Lemmon<br><b>Sent:</b> Saturday, September 06, 2008 9:42 PM<br><b>To:</b> [email protected]<br><b>Subject:</b> [Nunit-users] 2.5 console runner documenation<br></font><br></div> <div></div> <table border="0" cellpadding="0" cellspacing="0"> <tbody> <tr> <td valign="top">When comparing the 2.4.8 docs and the 2.5 docs, I noticed that this section in console runner: command-line was mostly deleted and partly merged with the one before it:<br><br><span style="font-weight: bold;">"Specifying the Transform file</span><br style="font-weight: bold;"><br style="font-weight: bold;"><span style="font-weight: bold;">The console interface uses XSLT to transform the test results from the XML file to what is printed to the screen when the program executes. The console interface has a default transformation that is part of the executable. To specify your own transformation named "myTransform.xslt" use the following command line option:</span><br style="font-weight: bold;"><br style="font-weight: bold;"><span style="font-weight: bold;">nunit-console /transform:myTransform.xslt nunit.tests.dll</span><br style="font-weight: bold;"><br style="font-weight: bold;"><span style="font-weight: bold;">Note: For additional information see the XML schema for the test results. This file is in the same directory as the executable and is called Results.xsd. The default transform Summary.xslt is located in the core source directory."</span><br style="font-weight: bold;"><br>In the 2.5 docs, there's no such section, and the mention of the Results.xsd is merged in to the section before it on specifying an output xml file.<br><br>Is this an error in the docs, or is this feature (specifying a transform) going to be removed in 2.5? A quick test shows that it still works.<br><br>-Jay Lemmon<br></td></tr></tbody></table><br></blockquote></div><pre>-------------------------------------------------------------------------<br>This SF.Net email is sponsored by the Moblin Your Move Developer's<br>challenge<br>Build the coolest Linux based applications with Moblin SDK & win great<br>prizes<br>Grand prize is a trip for two to an Open Source event anywhere in the world<br>http://moblin-contest.org/redirect.php?banner_id=100&url=/</pre><pre>_______________________________________________<br>Nunit-users mailing list<br>[email protected]<br>https://lists.sourceforge.net/lists/listinfo/nunit-users<br></pre></blockquote></td></tr></tbody></table><br></blockquote></div><pre>------------------------------------------------------- ------------------<br>This SF.Net email is sponsored by the Moblin Your Move Developer's<br>challenge<br>Build the coolest Linux based applications with Moblin SDK &<br> win<br><br> great<br>prizes<br>Grand prize is a trip for two to an Open Source event anywhere in the world<br>http://moblin-contest.org/redirect.php?banner_id=100&url=/</pre><pre>_______________________________________________<br>Nunit-users mailing list<br>[email protected]<br>https://lists.sourceforge.net/lists/listinfo/nunit-users<br></pre></blockquote></td></tr></tbody></table><br></div><pre>-------------------------------------------------------------------------<br>This SF.Net email is sponsored by the Moblin Your Move Developer's<br>challenge<br>Build the coolest Linux based applications with Moblin SDK & win great<br>prizes<br>Grand prize is a trip for two to an Open Source event anywhere in the world<br>http://moblin-contest.org/redirect.php?bann er_id=100&url=/</pre><pre>_______________________________________________<br>Nunit-users mailing<br> list<br>[email protected]<br>https://lists.sourceforge.net/lists/listinfo/nunit-users<br></pre></blockquote></td></tr></tbody></table><br></blockquote></div><pre>-------------------------------------------------------------------------<br>This SF.Net email is sponsored by the Moblin Your Move Developer's<br>challenge<br>Build the coolest Linux based applications with Moblin SDK & win great<br>prizes<br>Grand prize is a trip for two to an Open Source event anywhere in the world<br>http://moblin-contest.org/redirect.php?banner_id=100&url=/</pre><pre>_______________________________________________<br>Nunit-users mailing list<br>[email protected]<br>https://lists.sourceforge.net/lists/listinfo/nunit-users<br></pre></blockquote></td></tr></tbody></table> <br></blockquote></div></blockquote></td></tr></table><br> --0-421974720-1220852303=:4721-- --===============1417722035== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ --===============1417722035== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Nunit-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nunit-users --===============1417722035==--