bug#71422: no easy way to generate a test-suite.log without skipped tests

Sam James <[email protected]> Sat, 08 Jun 2024 09:16:27 +0100

Newsgroups	gmane.comp.sysutils.automake.bugs
Organization	Gentoo
Message-ID	<[email protected]>

Bruno Haible <[email protected]> writes:

> Hi,
>
> In my projects that use Automake and the "parallel" test driver, often
> I have 1000 unit tests, of which 100-150 are skipped and 1-5 fail.
> When analyzing the "make check" results, the generated test-suite.log
> is more handy to use than the 1000 different <test>.log files. However,
> before I get an overview of the results, I have to eliminate the logs
> of the SKIPped tests (because the 1-5 failures are intermixed with
> the 100-150 SKIPped test logs). This is a process that takes 1-2 minutes
> each time.

Thanks for proposing this. I'd find this useful too.

>
> I could write a script that post-processes the test-suite.log to eliminate
> them. But it is better if the logs of the SKIPped tests wouldn't appear
> in the file in the first place. The SKIPped tests are uninteresting
> in my case.
>
> Here is a patch that allows the package maintainer to eliminate the
> SKIPped test logs, thus making test-suite.log more useful: either
> by running
>   make check IGNORE_SKIPPED_LOGS=1
> or by defining in the Makefile (or Makefile.am):
>   IGNORE_SKIPPED_LOGS = 1
>
> It includes a unit test, documentation updates, and passes "make check".
>
> [2. text/x-patch; 0001-automake-Allow-omitting-the-logs-of-skipped-tests-fr.patch]...

signature.asc (application/pgp-signature, 377 B)