Latest Test Results for si on s390

Since Eliuth will soon be moving on to another project I arranged access 
to a fresh s390 system here in Austin. Using the code currently in cvs I 
was able to successfully build the si for s390, thus confirming that it is 
a repeatable procedure. Next, I ran the runtime tests in the si and got 
very good results. The total number of failures was 48. Of the 48 only 
three appear to be different from the known set of LI18NUX problems. The 
three in question are:

/tset/LI18NUX2K.L1/base/vfwprintf/T.vfwprintf 52 FAIL
/tset/LI18NUX2K.L1/utils/locale/locale 6 FAIL
/tset/LSB.fhs/usr/share-misc/share-misc-tc 4 FAIL

The first two will probably fail on the native system, so I will do a 
native test run to compare.

The problem with share-misc-tc is more interesting. The failure occurs 
because for some reason the test suite thinks the si supports termcap. 
When it checks for the file /usr/share/misc/termcap and doesn't find it, 
the error is reported. The question is why it thinks termcap is supported. 
When I look at the tetexec.cfg file I see it has LSB_FILE_TERMCAP set to 
"true", but there is no /usr/share/misc/termcap file in the si. The script 
for installing the test suites is somehow figuring out whether or not 
termcap is supported. The native system does have termcap, but it should 
not be visible within the si chroot environment. When I compare this to my 
ppc32 system I see that it has termcap on the native system, but the test 
suite in the si does not see it, so the LSB_FILE_TERMCAP variable is not 
set to anything.

Here is the complete report from the test suite run.

/tset/LI18NUX2K.L1/base/vfwprintf/T.vfwprintf 52 FAIL
/tset/LI18NUX2K.L1/utils/diff/diff 2 FAIL
/tset/LI18NUX2K.L1/utils/egrep-tp/egrep-tp 5 FAIL
/tset/LI18NUX2K.L1/utils/fgrep/fgrep 5 FAIL
/tset/LI18NUX2K.L1/utils/fold/fold 1 FAIL
/tset/LI18NUX2K.L1/utils/fold/fold 2 FAIL
/tset/LI18NUX2K.L1/utils/fold/fold 3 FAIL
/tset/LI18NUX2K.L1/utils/grep-tp/grep-tp 5 FAIL
/tset/LI18NUX2K.L1/utils/join/join 3 FAIL
/tset/LI18NUX2K.L1/utils/join/join 4 FAIL
/tset/LI18NUX2K.L1/utils/locale/locale 6 FAIL
/tset/LI18NUX2K.L1/utils/msgfmt/msgfmt 9 FAIL
/tset/LI18NUX2K.L1/utils/pr/pr 1 FAIL
/tset/LI18NUX2K.L1/utils/pr/pr 3 FAIL
/tset/LI18NUX2K.L1/utils/pr/pr 4 FAIL
/tset/LI18NUX2K.L1/utils/pr/pr 5 FAIL
/tset/LI18NUX2K.L1/utils/pr/pr 6 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 8 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 9 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 10 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 11 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 12 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 13 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 14 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 15 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 16 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 24 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 25 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 26 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 27 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 28 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 29 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 30 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 31 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 32 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 40 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 41 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 42 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 43 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 44 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 45 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 46 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 47 FAIL
/tset/LI18NUX2K.L1/utils/sort/sort 48 FAIL
/tset/LI18NUX2K.L1/utils/unexpand/unexpand 1 FAIL
/tset/LI18NUX2K.L1/utils/uniq/uniq 2 FAIL
/tset/LI18NUX2K.L1/utils/uniq/uniq 3 FAIL
/tset/LSB.fhs/usr/share-misc/share-misc-tc 4 FAIL


Test system: SI for S390
Test was run: 20030710 13:59:16
Total Tests Passed: 8689
Total Tests Failed (including waived): 48
Total Tests Failed (excluding waived): :48

Test Result Breakdown:
PASS: 4531
WARNING: 20
NOTIMP: 0
UNAPPROVE: 0
UNSUPPORTED: 127
TEST_ERROR: 0
FIP: 37
NOTINUSE: 3923
UNRESOLVED: 0
UNINITIATED: 0
UNTESTED: 51
FAIL: 48
UNKNOWN: 0
UNREPORTED: 0

Regards,

Marvin Heffler
Linux Standard Base
IBM Linux Technology Center
11400 Burnet Road, Zip 908-1A33
Austin, TX 78758
(512) 838-0953    T/L 678-0953