QA Status
"Ken McDonell" <[email protected]>
| Newsgroups | gmane.comp.sysutils.pcp |
|---|---|
| Message-ID | <[email protected]> |
This is not too bad. There are very recent commits that I'm confident will address the 702 and 821 failures.
For 022, all I know at the moment is that the proc metrics are not accessible via the unix: socket when the test is launched by cron on another machine, but passes when run from an interactive shell (either locally or remotely via ssh) ... so there is probably some /dev/tty (or similar) check here I've not tracked down or figured out how to trick.
Details for the most commonly failing tests are available from
ftp://oss.sgi.com/projects/pcp/download/qa-status/
=== Synopsis ===
QA Status from Ken McDonell's QA Farm in Melbourne
Summary: 24637 run, 118 failed (0.48%)
QA Test Fail Failure Signatures (number of different failure patterns)
702 26 22 2
022 11 1 1 1 1 1 1 1 1 1 1
821 8 6 2
908 4 3
888 4 1 1 1 1
365 4 1 1 1 1
964 3 1 1 1
713 3 3
667 3 2 1
666 3 1 1 1
651 3 2 1
870 2 1 1
706 2 1 1
662 2 1 1
280 2 1 1
279 2 2
^ ^
| |
| +-- A B C ... means one failure signature occurred A times,
| another occurred B times, a third occurred C times, ...
+-- total number of failures for this test, equals A+B+C+...
Each tarball in this directory contains .out, .out.bad and possibly
.full files for all failing test cases where a test failed on at least
5% of the QA hosts.
The latest tarball is 20161221.tgz.
==== QA Summary ====
Date Run Pass Fail Nrun Host
2016-12-21 782 778 4 62|bo|bozo PCP 3.11.7 x86_64 Ubuntu 16.04
Daily runs, but no QA |bl|bozo-laptop PCP 3.11.4 i686 LinuxMint 15
Daily runs, but no QA |bv|bozo-vm PCP 3.11.5 x86_64 Debian 8.5
Daily runs, but no QA |fu|fuji PCP 3.11.5 i386 Darwin 10.8.0
Daily runs, but no QA |gr|grundy.sgi.com|grundy.sgi.com
2016-12-20 874 871 3 83|00|vm00 PCP 3.11.7 x86_64 Ubuntu 12.04
2016-12-20 882 879 3 74|01|vm01 PCP 3.11.7 i686 Ubuntu 15.10
2016-12-20 894 890 4 63|02|vm02 PCP 3.11.7 i686 openSUSE 13.2
2016-12-16 901 896 5 56|03|vm03 PCP 3.11.7 x86_64 Fedora 24
2016-12-21 771 766 5 186|04|vm04 PCP 3.11.7 i686 CentOS 5.11
2016-12-21 870 864 6 87|05|vm05 PCP 3.11.7 x86_64 Gentoo 2.2
2016-12-21 61 61 0 4|06|vm06 PCP 3.11.7 amd64 FreeBSD 10.2-RELEASE
2016-12-17 875 872 3 82|07|vm07 PCP 3.11.7 x86_64 Debian stretch/sid
2016-12-19 896 891 5 61|08|vm08 PCP 3.11.7 x86_64 CentOS Linux7.2.1511
2016-12-19 61 58 3 4|09|vm09 PCP 3.11.7 i386 NetBSD 6.1.5
2016-12-20 61 61 0 4|10|vm10 PCP 3.11.7 i386 FreeBSD 9.3-RELEASE-p30
2016-12-17 873 870 3 84|11|vm11 PCP 3.11.7 i686 Debian stretch/sid
2016-12-17 894 889 5 63|12|vm12 PCP 3.11.7 i686 Fedora 22
Daily runs, but no QA |13|vm13 PCP unknown i86pc OpenIndiana Development oi_151.1.8
2016-12-18 889 885 4 68|14|vm14 PCP 3.11.7 x86_64 CentOS6.7
2016-12-19 819 815 4 138|15|vm15 PCP unknown x86_64 Slackware "14.2"
2016-12-18 780 776 4 64|18|vm18 PCP 3.11.7 x86_64 LinuxMint 17.3
2016-12-18 861 856 5 96|19|vm19 PCP 3.11.7 x86_64 openSUSE 12.2
2016-12-18 889 888 1 68|20|vm20 PCP 3.11.7 x86_64 Ubuntu 14.04
2016-12-18 870 868 2 87|21|vm21 PCP 3.11.7 i686 Debian 7.10
2016-12-18 890 886 4 67|22|vm22 PCP 3.11.7 x86_64 Fedora 19
2016-12-19 893 890 3 64|23|vm23 PCP 3.11.7 i686 Fedora 20
2016-12-19 886 880 6 71|24|vm24 PCP 3.11.7 i686 openSUSE 13.1
2016-12-19 766 755 11 191|25|vm25 PCP 3.11.7 x86_64 CentOS 5.11
2016-12-20 892 891 1 65|26|vm26 PCP 3.11.7 x86_64 Fedora 21
2016-12-18 882 878 4 75|27|vm27 PCP 3.11.7 x86_64 Ubuntu 15.04
2016-12-19 886 882 4 71|28|vm28 PCP 3.11.7 x86_64 RHEL Server 6.8
2016-12-18 893 890 3 64|29|vm29 PCP 3.11.7 x86_64 RHEL Server 7.2
2016-12-19 891 885 6 66|30|vm30 PCP 3.11.7 x86_64 SUSE SLES12 SP0
2016-12-20 891 888 3 66|31|vm31 PCP 3.11.7 x86_64 Fedora 23
2016-12-19 74 74 0 5|32|vm32 PCP 3.11.7 amd64 FreeBSD 11.0-CURRENT
2016-12-19 64 62 2 1|33|vm33 PCP 3.11.7 amd64 OpenBSD 5.8
2016-12-21 882 880 2 75|34|vm34 PCP 3.11.7 x86_64 Arch Linux
2016-12-21 44 44 0 7|35|vm35 PCP 2.7.8 x86_64 Ubuntu 14.04
Summary: 24637 run, 118 failed (0.48%)
==== QA Failure (X) and Not Run or Skipped (-) Map ====
Host bo 00 01 02 03 04 05 07 08 09 11 12 14 15 18 19 20 21 22 23 24 25 26 27 28 29 30 31 33 34
Test %fail Test QA groups
702 76% X X X X X - X X X - X X X X X X X X X X X - X X X X X X - X 702 python libpcp
022 32% X X X - X X X X X X X X - 022 context_local pmda pmda.proc
821 24% X X X - X X X X X - 821 pmda.linux
365 12% - X X X X - 365 pmcd
888 12% X - X X X - 888 pmda.linux
908 12% X X - X X - 908 indom help pmda pminfo
651 9% X - X X - 651 pmproxy
666 9% - X X X - 666 pmmgr slow valgrind
667 9% X - - - - X - X - - 667 python
713 9% X X - - - - X 713 context libpcp pmproxy secure
964 9% X - - - X X - 964 pmcd
279 6% X - X - 279 pmcd
280 6% X - X - 280 pmlogger logutil folio pmlc
662 6% - - - - - - - X - X - 662 pmwebapi pmda.sample
706 6% X - X - 706 libpcp
870 6% - X X - 870 pmlogcheck
005 3% X 005 context archive
007 3% X 007 fetch
Host bo 00 01 02 03 04 05 07 08 09 11 12 14 15 18 19 20 21 22 23 24 25 26 27 28 29 30 31 33 34
Test %fail Test QA groups
040 3% - X - 040 pmlogger mem_leak
048 3% X 048 archive
051 3% - X - 051 pmcd
072 3% X - - 072 pmlogger pmdumplog
075 3% X - - 075 pmval pmstore
091 3% X 091 archive
119 3% - X - 119 logutil
169 3% X - - 169 pmcd
177 3% - X - 177 archive pmval pmdumplog pmlc
211 3% - X - 211 pmns pmval pmie pmdumplog
216 3% X - - 216 pmda.linux
241 3% - X - 241 pmda.mmv pmval perl
244 3% - X - 244 pmcd pmprobe
260 3% - X - 260 derive pmie
295 3% - X - 295 pmproxy pmval pmstat pmie
300 3% X - - 300 pmcd
326 3% - X - 326 pmlogger pmval libpcp pmcd pmda.install folio pmdumplog pmlc timezone
353 3% X - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 353 pmsocks
359 3% X 359 pmcd pminfo
389 3% - X - 389 pmlogger
416 3% - X 416 pmda.news dbpmda perl
Host bo 00 01 02 03 04 05 07 08 09 11 12 14 15 18 19 20 21 22 23 24 25 26 27 28 29 30 31 33 34
Test %fail Test QA groups
462 3% X - - 462 pmcd_wait
535 3% - X - 535 pmie pmprobe
575 3% - X - 575 pmie
669 3% - X - 669 pmmgr
755 3% - X - 755 pmda.apache pmda.install
823 3% - - - - X - - - - - - - - - - - - 823 pmda.sample pmstore secure
832 3% - - X - - - - - - - - - 832 pmda.sample pmstore secure
854 3% X - - 854 pmlogger
892 3% X - - 892 pmcd libpcp
895 3% - X - 895 pmlogger
1010 3% - - - - - X - 1010 pmdumptext pmlogger libqmc
1041 3% - - - - X - - - - - - - - - - - - - - - - - - - - - - - - 1041 pmda.libvirt
1068 3% - - - - - - - - X - 1068 pmrep python zabbix
Test %fail Test QA groups
Host bo 00 01 02 03 04 05 07 08 09 11 12 14 15 18 19 20 21 22 23 24 25 26 27 28 29 30 31 33 34
-=-=-=-=-=-=-=-=-=-=-=-
Groups.io Links:
You receive all messages sent to this group.
View/Reply Online (#14932): https://groups.io/g/pcp/message/14932
View All Messages In Topic (1): https://groups.io/g/pcp/topic/3835654
Mute This Topic: https://groups.io/mt/3835654?uid=174580
New Topic: https://groups.io/g/pcp/post
-=-=-
pcp mailing list
[email protected]
https://groups.io/g/pcp/messages
-=-=-
Change Your Subscription: https://groups.io/g/pcp/editsub?uid=174580
Group Home: https://groups.io/g/pcp
Contact Group Owner: [email protected]
Terms of Service: https://groups.io/static/tos
Unsubscribe: https://groups.io/g/pcp/leave/354243/563757577/xyzzy
-=-=-=-=-=-=-=-=-=-=-=-