Re: Asking for general testing feedback

Hello all,
I have some feedback on top of my head. Hope it helps. 


Lawrence

On Thu, 2006-01-05 at 17:51 -0800, Wichmann, Mats D wrote:
> For those who run the LSB runtime tests, particularly distribution
> vendors (and Marvin :-) ...
> 
> We've been thinking about LSB 4 topics for a while now, but haven't
> really done much to gather thoughts on testing futures. If you
> want to think about it for a bit and then reply to lsb-test (or
> if you prefer, privately to myself, Andrew, Ian, or whomever 
> else you trust to convey the concerns but keep the submitter 
> in confidence if that's what you desire) on what you'd like 
> to see, it would be extremely useful.  Some thoughts:
> 
> - what would make tests easier to use?
- interview questions prompted perhaps can be read from an external file
so user dont have to enter multiple. Of course user may use expect
script to repeat the process afterward, but just a thought. :)

- using expect script to perform the manual task during appbats testing,
supplying the script as part of the test suite will ease the maintenance
of updating the FVT page and effort running the test.

> - what would make them easier to interpret, debug, etc.?
> - what ought to get tested that isn't (any particlar compatibility
>   issues, for example, or something that poses a credibility
>   problem because there's no testing)?
>From an issue I have raised earlier, is it possible to indicate in the
LSB specification which test component or test case is testing the
specific chapter. This may help to identify the sections that are not
covered in the Test Suite to prevent the confusion form public which
generally believe everything in the specification is covered in the Test
Suite. In addition, it also help when a newbie wish to contribute test
to the Test Suite.

<http://mail.freestandards.org/pipermail/lsb-test/2005-
December/004502.html>

> - is there anything that is required now,  but doesn't seem to
>   add value? (as in, things we might want to drop)
> 
> Plus anything else you'd like to comment on.
> 
> Normal disclaimers apply:  we don't currently have a lot of
> resources to do test development, so who knows what could
> actually get done.  For this particular question, please don't
> worry about that issue.  We'll get to the zero-based-budgeting
> activity later, where we figure out what we can accomplish
> with the resources we can get. But let's flush out the list
> of what it would be GREAT to do first!!!
> 
> 
> Thanks,
> 
> Mats
> _______________________________________________
> lsb-test mailing list
> [email protected]
> http://mail.freestandards.org/mailman/listinfo/lsb-test