Re: Smoker setup to compare old vs new versions?

David Golden <[email protected]>
Newsgroups gmane.comp.lang.perl.quality-assurance
Message-ID <CAOeq1c_58+00bJQTpN__LnowMQ-tY0x_VkWBe2iC2Kb9mc4zRA@mail.gmail.com>
On Tue, Nov 15, 2011 at 8:28 AM, Michael G Schwern <[email protected]> wrote:
> I've never used the CPAN smoker software before and I'm hoping somebody has a
> recipe?

Regression testing is less well developed.  As far as I know, people
have rolled their own.

I have some poorly documented tools I used to use to regression smoke
Module::Build:

https://github.com/dagolden/cpan-testers-tools

Steffen has another regression smoker (possibly with some parts
adapted from mine) that he's been using to do Perl regression tests
against CPAN:

https://github.com/tsee/cpan_perl_branch_smoke

The general approach is this:

* Smoke configuration 1 and save reports to a directory
* Smoke configuration 2 and save reports to a different directory
* Compare directories and output HTML to browse differences

Hope that helps point you in the right direction.

-- David
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.