bug#68808: subsecond mtime discovery code insufficient
Karl Berry <[email protected]> Wed, 29 May 2024 15:53:52 -0600
| Newsgroups | gmane.comp.sysutils.automake.bugs |
|---|---|
| Message-ID | <[email protected]> |
Hi Erik,
* color-tests2.sh and color-tests2-w.sh fail -- logs attached.
Is this with the old make 3.81 from the system, or the new make you
compiled? What is in the "stdout" file in t/color-tests2.dir/stdout?
And, are these the only two tests that fail in the entire suite?
What I see in the log you sent is that color-tests2.log correctly runs
make pass fail skip xpass xfail error
But then the test output only shows the PASS line:
..
make check-TESTS
^[[0;32mPASS^[[m: pass
+ test_color
..
I believe that is doing "cat stdout", so everything else is missing,
even the Automake "Testsuite summary" footer.
I don't know why. It's as if the output from the parallel running of
make check overwrote itself, or maybe never ran. But this is not a
problem that's ever been reported before (and doesn't happen for me),
and I haven't knowingly changed anything here.
Thus I somewhat suspect this is some problem of make, and/or expect,
and/or something else. If it's something we can detect, we could skip
the test if we can't fix it. Help?
On my system, I see (I'll attach the whole log):
..
make check-TESTS
make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir'
make[2]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir'
^[[0;32mPASS^[[m: pass
^[[0;31mFAIL^[[m: fail
^[[1;34mSKIP^[[m: skip
^[[0;31mXPASS^[[m: xpass
^[[1;32mXFAIL^[[m: xfail
^[[0;35mERROR^[[m: error
^[[0;31m============================================================================^[[m
^[[0;31mTestsuite summary for color-tests2 1.0^[[m
..
+ test_color
..
(For the sake of this mail, I've removed ^M characters and replaced true
^[ ESC character with ASCII ^[.)
BTW, color-tests2-w is just a wrapper of color-tests2 to test VPATH, so
if we can solve color-tests2, its problems should go away too.
Thanks,
Karl
color-tests2.log
(application/octet-stream, 23.6 KB)
color-tests2: subsecond-mtime supported per automake and auto4mte --version, but am_cv_filesystem_timestamp_resolution not set; that's an error somewhere. Proceeding with value 1. am-test-lib.sh: Running from installcheck: no am-test-lib.sh: Test Protocol: none am-test-lib.sh: PATH = /u/karl/gnu/src/akarl/bin:/u/karl/gnu/src/akarl/t/ax:.:/u/karl/bin:/l/bin:/v/texlive/karl/Master/bin/x86_64-linux:/usr/local/gnu/emacs-21.4/bin:/usr/local/gnu/bin:/usr/local/bin:/usr/bin:/usr/sbin:/r/tug/home/tubprod/svn/misc:/v/texlive/karl/Master/tlpkg/bin:/r/tug/home/karl/bin ++ pwd /u/karl/gnu/src/akarl/t/color-tests2.dir + red='\[0;31m' + grn='\[0;32m' + lgn='\[1;32m' + blu='\[1;34m' + mgn='\[0;35m' + std='\[m' + set +e + expect -c 'exit 77' + test 77 -eq 77 + cat + cat + MAKE=make + expect -f expect-check spawn make stdout is a tty + rm -f expect-check Makefile + cat + cat + cat + cat + cat + cat + cp fail xfail + cp pass xpass + chmod +x pass fail skip xpass xfail error + aclocal-1.16 -Werror + autoconf + automake-1.16 --foreign -Werror -Wall --add-missing parallel-tests: installing './test-driver' + cat + for vpath in false : + false + srcdir=. + ./configure checking for a BSD-compatible install... /usr/bin/install -c checking whether sleep supports fractional seconds... true checking filesystem timestamp resolution... 0.01 checking whether build environment is sane... yes checking for a race-free mkdir -p... /usr/bin/mkdir -p checking for gawk... gawk checking whether make sets $(MAKE)... yes checking whether make supports nested variables... yes checking xargs -n works... yes checking that generated files are newer than configure... done configure: creating ./config.status config.status: creating Makefile + our_make TERM=ansi + set MAKE=make TERM=ansi + env MAKE=make TERM=ansi expect -f ./expect-make + cat stdout spawn make -e check make pass fail skip xpass xfail error make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[1]: Nothing to be done for 'pass'. make[1]: Nothing to be done for 'fail'. make[1]: Nothing to be done for 'skip'. make[1]: Nothing to be done for 'xpass'. make[1]: Nothing to be done for 'xfail'. make[1]: Nothing to be done for 'error'. make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make check-TESTS make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[2]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' [0;32mPASS[m: pass [0;31mFAIL[m: fail [1;34mSKIP[m: skip [0;31mXPASS[m: xpass [1;32mXFAIL[m: xfail [0;35mERROR[m: error [0;31m============================================================================[m [0;31mTestsuite summary for color-tests2 1.0[m [0;31m============================================================================[m [1m# TOTAL: 6[m [0;32m# PASS: 1[m [1;34m# SKIP: 1[m [1;32m# XFAIL: 1[m [0;31m# FAIL: 1[m [0;31m# XPASS: 1[m [0;35m# ERROR: 1[m [0;31m============================================================================[m [0;31mSee ./test-suite.log for debugging.[m [0;31m============================================================================[m make[2]: *** [Makefile:490: test-suite.log] Error 1 make[2]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[1]: *** [Makefile:615: check-TESTS] Error 2 make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make: *** [Makefile:854: check-am] Error 2 + test_color + cat stdout + grep '^\[0;32mPASS\[m: .*pass' [0;32mPASS[m: pass + cat stdout + grep '^\[0;31mFAIL\[m: .*fail' [0;31mFAIL[m: fail + cat stdout + grep '^\[1;34mSKIP\[m: .*skip' [1;34mSKIP[m: skip + cat stdout + grep '^\[1;32mXFAIL\[m: .*xfail' [1;32mXFAIL[m: xfail + cat stdout + grep '^\[0;31mXPASS\[m: .*xpass' [0;31mXPASS[m: xpass + test x = xyes + cat stdout + grep '^\[0;35mERROR\[m: .*error' [0;35mERROR[m: error + : + our_make TERM=dumb + set MAKE=make TERM=dumb + env MAKE=make TERM=dumb expect -f ./expect-make + cat stdout spawn make -e check make pass fail skip xpass xfail error make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[1]: Nothing to be done for 'pass'. make[1]: Nothing to be done for 'fail'. make[1]: Nothing to be done for 'skip'. make[1]: Nothing to be done for 'xpass'. make[1]: Nothing to be done for 'xfail'. make[1]: Nothing to be done for 'error'. make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make check-TESTS make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[2]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' PASS: pass FAIL: fail SKIP: skip XPASS: xpass XFAIL: xfail ERROR: error ============================================================================ Testsuite summary for color-tests2 1.0 ============================================================================ # TOTAL: 6 # PASS: 1 # SKIP: 1 # XFAIL: 1 # FAIL: 1 # XPASS: 1 # ERROR: 1 ============================================================================ See ./test-suite.log for debugging. ============================================================================ make[2]: *** [Makefile:490: test-suite.log] Error 1 make[2]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[1]: *** [Makefile:615: check-TESTS] Error 2 make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make: *** [Makefile:854: check-am] Error 2 + test_no_color + /usr/local/gnu/bin/grep -F '= Xalways; then' stdout + cat stdout + grep $'\E' + : For shells with broken 'set -e' + our_make AM_COLOR_TESTS=no + set MAKE=make AM_COLOR_TESTS=no + env MAKE=make AM_COLOR_TESTS=no expect -f ./expect-make + cat stdout spawn make -e check make pass fail skip xpass xfail error make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[1]: Nothing to be done for 'pass'. make[1]: Nothing to be done for 'fail'. make[1]: Nothing to be done for 'skip'. make[1]: Nothing to be done for 'xpass'. make[1]: Nothing to be done for 'xfail'. make[1]: Nothing to be done for 'error'. make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make check-TESTS make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[2]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' PASS: pass FAIL: fail SKIP: skip XPASS: xpass XFAIL: xfail ERROR: error ============================================================================ Testsuite summary for color-tests2 1.0 ============================================================================ # TOTAL: 6 # PASS: 1 # SKIP: 1 # XFAIL: 1 # FAIL: 1 # XPASS: 1 # ERROR: 1 ============================================================================ See ./test-suite.log for debugging. ============================================================================ make[2]: *** [Makefile:490: test-suite.log] Error 1 make[2]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[1]: *** [Makefile:615: check-TESTS] Error 2 make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make: *** [Makefile:854: check-am] Error 2 + test_no_color + /usr/local/gnu/bin/grep -F '= Xalways; then' stdout + cat stdout + grep $'\E' + : For shells with broken 'set -e' + ./configure testsuite_colorized=false checking for a BSD-compatible install... /usr/bin/install -c checking whether sleep supports fractional seconds... true checking filesystem timestamp resolution... 0.01 checking whether build environment is sane... yes checking for a race-free mkdir -p... /usr/bin/mkdir -p checking for gawk... gawk checking whether make sets $(MAKE)... yes checking whether make supports nested variables... yes checking xargs -n works... yes checking that generated files are newer than configure... done configure: creating ./config.status config.status: creating Makefile + our_make TERM=ansi + set MAKE=make TERM=ansi + env MAKE=make TERM=ansi expect -f ./expect-make + cat stdout spawn make -e check make pass fail skip xpass xfail error make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[1]: Nothing to be done for 'pass'. make[1]: Nothing to be done for 'fail'. make[1]: Nothing to be done for 'skip'. make[1]: Nothing to be done for 'xpass'. make[1]: Nothing to be done for 'xfail'. make[1]: Nothing to be done for 'error'. make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make check-TESTS make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[2]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' PASS: pass FAIL: fail SKIP: skip XPASS: xpass XFAIL: xfail ERROR: error ============================================================================ Testsuite summary for color-tests2 1.0 ============================================================================ # TOTAL: 6 # PASS: 1 # SKIP: 1 # XFAIL: 1 # FAIL: 1 # XPASS: 1 # ERROR: 1 ============================================================================ See ./test-suite.log for debugging. ============================================================================ make[2]: *** [Makefile:490: test-suite.log] Error 1 make[2]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[1]: *** [Makefile:615: check-TESTS] Error 2 make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make: *** [Makefile:854: check-am] Error 2 + test_no_color + /usr/local/gnu/bin/grep -F '= Xalways; then' stdout + cat stdout + grep $'\E' + : For shells with broken 'set -e' + our_make TERM=ansi 'MAKE=env AM_COLOR_TESTS=always make' + set MAKE=make TERM=ansi 'MAKE=env AM_COLOR_TESTS=always make' + env MAKE=make TERM=ansi 'MAKE=env AM_COLOR_TESTS=always make' expect -f ./expect-make + cat stdout spawn env AM_COLOR_TESTS=always make -e check env AM_COLOR_TESTS=always make pass fail skip xpass xfail error make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[1]: Nothing to be done for 'pass'. make[1]: Nothing to be done for 'fail'. make[1]: Nothing to be done for 'skip'. make[1]: Nothing to be done for 'xpass'. make[1]: Nothing to be done for 'xfail'. make[1]: Nothing to be done for 'error'. make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' env AM_COLOR_TESTS=always make check-TESTS make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[2]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' [0;32mPASS[m: pass [0;31mFAIL[m: fail [1;34mSKIP[m: skip [0;31mXPASS[m: xpass [1;32mXFAIL[m: xfail [0;35mERROR[m: error [0;31m============================================================================[m [0;31mTestsuite summary for color-tests2 1.0[m [0;31m============================================================================[m [1m# TOTAL: 6[m [0;32m# PASS: 1[m [1;34m# SKIP: 1[m [1;32m# XFAIL: 1[m [0;31m# FAIL: 1[m [0;31m# XPASS: 1[m [0;35m# ERROR: 1[m [0;31m============================================================================[m [0;31mSee ./test-suite.log for debugging.[m [0;31m============================================================================[m make[2]: *** [Makefile:490: test-suite.log] Error 1 make[2]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make[1]: *** [Makefile:615: check-TESTS] Error 2 make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir' make: *** [Makefile:854: check-am] Error 2 + test_color + cat stdout + grep '^\[0;32mPASS\[m: .*pass' [0;32mPASS[m: pass + cat stdout + grep '^\[0;31mFAIL\[m: .*fail' [0;31mFAIL[m: fail + cat stdout + grep '^\[1;34mSKIP\[m: .*skip' [1;34mSKIP[m: skip + cat stdout + grep '^\[1;32mXFAIL\[m: .*xfail' [1;32mXFAIL[m: xfail + cat stdout + grep '^\[0;31mXPASS\[m: .*xpass' [0;31mXPASS[m: xpass + test x = xyes + cat stdout + grep '^\[0;35mERROR\[m: .*error' [0;35mERROR[m: error + : + make distclean rm -f pass.log fail.log skip.log xpass.log xfail.log error.log rm -f pass.trs fail.trs skip.trs xpass.trs xfail.trs error.trs rm -f test-suite.log rm -f test . = "." || rm -f rm -f config.status config.cache config.log configure.lineno config.status.lineno rm -f Makefile + cd . + for vpath in false : + : + mkdir build + cd build + srcdir=.. + ../configure checking for a BSD-compatible install... /usr/bin/install -c checking whether sleep supports fractional seconds... true checking filesystem timestamp resolution... 0.01 checking whether build environment is sane... yes checking for a race-free mkdir -p... /usr/bin/mkdir -p checking for gawk... gawk checking whether make sets $(MAKE)... yes checking whether make supports nested variables... yes checking xargs -n works... yes checking that generated files are newer than configure... done configure: creating ./config.status config.status: creating Makefile + our_make TERM=ansi + set MAKE=make TERM=ansi + env MAKE=make TERM=ansi expect -f ../expect-make + cat stdout spawn make -e check make pass fail skip xpass xfail error make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[1]: Nothing to be done for '../pass'. make[1]: Nothing to be done for '../fail'. make[1]: Nothing to be done for '../skip'. make[1]: Nothing to be done for '../xpass'. make[1]: Nothing to be done for '../xfail'. make[1]: Nothing to be done for '../error'. make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make check-TESTS make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[2]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' [0;32mPASS[m: pass [0;31mFAIL[m: fail [1;34mSKIP[m: skip [0;31mXPASS[m: xpass [1;32mXFAIL[m: xfail [0;35mERROR[m: error [0;31m============================================================================[m [0;31mTestsuite summary for color-tests2 1.0[m [0;31m============================================================================[m [1m# TOTAL: 6[m [0;32m# PASS: 1[m [1;34m# SKIP: 1[m [1;32m# XFAIL: 1[m [0;31m# FAIL: 1[m [0;31m# XPASS: 1[m [0;35m# ERROR: 1[m [0;31m============================================================================[m [0;31mSee ./test-suite.log for debugging.[m [0;31m============================================================================[m make[2]: *** [Makefile:490: test-suite.log] Error 1 make[2]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[1]: *** [Makefile:615: check-TESTS] Error 2 make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make: *** [Makefile:854: check-am] Error 2 + test_color + cat stdout + grep '^\[0;32mPASS\[m: .*pass' [0;32mPASS[m: pass + cat stdout + grep '^\[0;31mFAIL\[m: .*fail' [0;31mFAIL[m: fail + cat stdout + grep '^\[1;34mSKIP\[m: .*skip' [1;34mSKIP[m: skip + cat stdout + grep '^\[1;32mXFAIL\[m: .*xfail' [1;32mXFAIL[m: xfail + cat stdout + grep '^\[0;31mXPASS\[m: .*xpass' [0;31mXPASS[m: xpass + test x = xyes + cat stdout + grep '^\[0;35mERROR\[m: .*error' [0;35mERROR[m: error + : + our_make TERM=dumb + set MAKE=make TERM=dumb + env MAKE=make TERM=dumb expect -f ../expect-make + cat stdout spawn make -e check make pass fail skip xpass xfail error make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[1]: Nothing to be done for '../pass'. make[1]: Nothing to be done for '../fail'. make[1]: Nothing to be done for '../skip'. make[1]: Nothing to be done for '../xpass'. make[1]: Nothing to be done for '../xfail'. make[1]: Nothing to be done for '../error'. make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make check-TESTS make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[2]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' PASS: pass FAIL: fail SKIP: skip XPASS: xpass XFAIL: xfail ERROR: error ============================================================================ Testsuite summary for color-tests2 1.0 ============================================================================ # TOTAL: 6 # PASS: 1 # SKIP: 1 # XFAIL: 1 # FAIL: 1 # XPASS: 1 # ERROR: 1 ============================================================================ See ./test-suite.log for debugging. ============================================================================ make[2]: *** [Makefile:490: test-suite.log] Error 1 make[2]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[1]: *** [Makefile:615: check-TESTS] Error 2 make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make: *** [Makefile:854: check-am] Error 2 + test_no_color + /usr/local/gnu/bin/grep -F '= Xalways; then' stdout + cat stdout + grep $'\E' + : For shells with broken 'set -e' + our_make AM_COLOR_TESTS=no + set MAKE=make AM_COLOR_TESTS=no + env MAKE=make AM_COLOR_TESTS=no expect -f ../expect-make + cat stdout spawn make -e check make pass fail skip xpass xfail error make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[1]: Nothing to be done for '../pass'. make[1]: Nothing to be done for '../fail'. make[1]: Nothing to be done for '../skip'. make[1]: Nothing to be done for '../xpass'. make[1]: Nothing to be done for '../xfail'. make[1]: Nothing to be done for '../error'. make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make check-TESTS make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[2]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' PASS: pass FAIL: fail SKIP: skip XPASS: xpass XFAIL: xfail ERROR: error ============================================================================ Testsuite summary for color-tests2 1.0 ============================================================================ # TOTAL: 6 # PASS: 1 # SKIP: 1 # XFAIL: 1 # FAIL: 1 # XPASS: 1 # ERROR: 1 ============================================================================ See ./test-suite.log for debugging. ============================================================================ make[2]: *** [Makefile:490: test-suite.log] Error 1 make[2]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[1]: *** [Makefile:615: check-TESTS] Error 2 make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make: *** [Makefile:854: check-am] Error 2 + test_no_color + /usr/local/gnu/bin/grep -F '= Xalways; then' stdout + cat stdout + grep $'\E' + : For shells with broken 'set -e' + ../configure testsuite_colorized=false checking for a BSD-compatible install... /usr/bin/install -c checking whether sleep supports fractional seconds... true checking filesystem timestamp resolution... 0.01 checking whether build environment is sane... yes checking for a race-free mkdir -p... /usr/bin/mkdir -p checking for gawk... gawk checking whether make sets $(MAKE)... yes checking whether make supports nested variables... yes checking xargs -n works... yes checking that generated files are newer than configure... done configure: creating ./config.status config.status: creating Makefile + our_make TERM=ansi + set MAKE=make TERM=ansi + env MAKE=make TERM=ansi expect -f ../expect-make + cat stdout spawn make -e check make pass fail skip xpass xfail error make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[1]: Nothing to be done for '../pass'. make[1]: Nothing to be done for '../fail'. make[1]: Nothing to be done for '../skip'. make[1]: Nothing to be done for '../xpass'. make[1]: Nothing to be done for '../xfail'. make[1]: Nothing to be done for '../error'. make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make check-TESTS make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[2]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' PASS: pass FAIL: fail SKIP: skip XPASS: xpass XFAIL: xfail ERROR: error ============================================================================ Testsuite summary for color-tests2 1.0 ============================================================================ # TOTAL: 6 # PASS: 1 # SKIP: 1 # XFAIL: 1 # FAIL: 1 # XPASS: 1 # ERROR: 1 ============================================================================ See ./test-suite.log for debugging. ============================================================================ make[2]: *** [Makefile:490: test-suite.log] Error 1 make[2]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[1]: *** [Makefile:615: check-TESTS] Error 2 make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make: *** [Makefile:854: check-am] Error 2 + test_no_color + /usr/local/gnu/bin/grep -F '= Xalways; then' stdout + cat stdout + grep $'\E' + : For shells with broken 'set -e' + our_make TERM=ansi 'MAKE=env AM_COLOR_TESTS=always make' + set MAKE=make TERM=ansi 'MAKE=env AM_COLOR_TESTS=always make' + env MAKE=make TERM=ansi 'MAKE=env AM_COLOR_TESTS=always make' expect -f ../expect-make + cat stdout spawn env AM_COLOR_TESTS=always make -e check env AM_COLOR_TESTS=always make pass fail skip xpass xfail error make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[1]: Nothing to be done for '../pass'. make[1]: Nothing to be done for '../fail'. make[1]: Nothing to be done for '../skip'. make[1]: Nothing to be done for '../xpass'. make[1]: Nothing to be done for '../xfail'. make[1]: Nothing to be done for '../error'. make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' env AM_COLOR_TESTS=always make check-TESTS make[1]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[2]: Entering directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' [0;32mPASS[m: pass [0;31mFAIL[m: fail [1;34mSKIP[m: skip [0;31mXPASS[m: xpass [1;32mXFAIL[m: xfail [0;35mERROR[m: error [0;31m============================================================================[m [0;31mTestsuite summary for color-tests2 1.0[m [0;31m============================================================================[m [1m# TOTAL: 6[m [0;32m# PASS: 1[m [1;34m# SKIP: 1[m [1;32m# XFAIL: 1[m [0;31m# FAIL: 1[m [0;31m# XPASS: 1[m [0;35m# ERROR: 1[m [0;31m============================================================================[m [0;31mSee ./test-suite.log for debugging.[m [0;31m============================================================================[m make[2]: *** [Makefile:490: test-suite.log] Error 1 make[2]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make[1]: *** [Makefile:615: check-TESTS] Error 2 make[1]: Leaving directory '/u/karl/gnu/src/akarl/t/color-tests2.dir/build' make: *** [Makefile:854: check-am] Error 2 + test_color + cat stdout + grep '^\[0;32mPASS\[m: .*pass' [0;32mPASS[m: pass + cat stdout + grep '^\[0;31mFAIL\[m: .*fail' [0;31mFAIL[m: fail + cat stdout + grep '^\[1;34mSKIP\[m: .*skip' [1;34mSKIP[m: skip + cat stdout + grep '^\[1;32mXFAIL\[m: .*xfail' [1;32mXFAIL[m: xfail + cat stdout + grep '^\[0;31mXPASS\[m: .*xpass' [0;31mXPASS[m: xpass + test x = xyes + cat stdout + grep '^\[0;35mERROR\[m: .*error' [0;35mERROR[m: error + : + make distclean rm -f pass.log fail.log skip.log xpass.log xfail.log error.log rm -f pass.trs fail.trs skip.trs xpass.trs xfail.trs error.trs rm -f test-suite.log rm -f test . = ".." || rm -f rm -f config.status config.cache config.log configure.lineno config.status.lineno rm -f Makefile + cd .. + : + am_exit_trap 0 + exit_status=0 + set +e + cd /u/karl/gnu/src/akarl + test none = tap + case $am_explicit_skips in + test 0 -eq 0 + am_keeping_testdirs + case $keep_testdirs in + return 0 + set +x PASS t/color-tests2.sh (exit status: 0)