pcp updates: pmdalio

"Lukas Berk" <[email protected]> Sat, 11 Feb 2017 15:25:23 -0500
Newsgroups gmane.comp.sysutils.pcp
Message-ID <[email protected]>
Hi,

Changes committed to git://git.pcp.io/lberk/pcp.git master

Paul Cuzner (15):
      1st code commit
      pmdalio.python: Updated domain ID to avoid upstream conflicts
      pcp-lio.te: Add example SELINUX TE file
      README: clarified use of the TE example
      Tests: 1st commit of test/validation code
      Sample configfs directory added for testing
      tests: json conf file added
      tests: 1st commit for automated tests of the pmda agent
      pmdalio: syntax fix
      pmdalio: Catch RTSLIBNotInCFS error on storage object
      tests: enable the drop configuraton method
      README: document current issues with repeated test runs
      pmdalio: ensure pmda sees config changes, and correct LUN size calculation
      tests: add unittest based automated testing
      spec: spec file added

Lukas Berk (9):
      pmdalio: rework file layout slightly and add build bits
      pmdalio: Move test to qa directory
      qa: add wrapper test for the pmdalio tests
      pmdalio: further qa work
      pmdalio: add postun call to pmda removal scriptlet
      Update .gitignore
      pmdalio: QA Install and Remove pmdalio in qa/1060
      Add pmdalio to pmns
      pmdalio: add metric help text and minor corrections

pcuzner (4):
      Initial commit
      added README documentation
      README: include rtslib and SELINUX info
      Updated to reflect python3 rtslib tests

 .gitignore                               |   95 ++++++++
 LICENSE                                  |  339 +++++++++++++++++++++++++++++
 README.md                                |   73 ++++++
 build/rpm/pcp.spec.in                    |   36 ++-
 dev/null                                 |binary
 lio/Install                              |   28 ++
 lio/Remove                               |   25 ++
 lio/pmdalio.python                       |  356 +++++++++++++++++++++++++++++--
 pcp-lio.te                               |   29 ++
 pcp-pmda-lio.spec                        |   65 +++++
 qa/1060                                  |   72 ++++++
 qa/1060.out                              |   23 +-
 qa/GNUmakefile                           |    2 
 qa/GNUmakefile.install                   |    2 
 qa/group                                 |    2 
 qa/lio/.gitignore                        |    5 
 qa/lio/GNUmakefile                       |   22 +
 qa/lio/GNUmakefile.install               |   23 ++
 qa/lio/README                            |   39 +++
 qa/lio/iscsi_conf.json                   |   22 +
 qa/lio/iscsi_target.py                   |  202 ++++++++---------
 qa/lio/iscsi_target.python               |  101 ++++++++
 qa/lio/iscsi_target_configfs_dump.tar.gz |binary
 qa/lio/lio_test.py                       |  212 +++++++++---------
 qa/lio/lio_test.python                   |  106 +++++++++
 src/pmdas/GNUmakefile                    |    2 
 src/pmdas/lio/GNUmakefile                |   46 ++++
 src/pmdas/lio/Install                    |   32 ++
 src/pmdas/lio/Remove                     |   29 ++
 src/pmdas/lio/lio/Install                |   28 --
 src/pmdas/lio/lio/Remove                 |   25 --
 src/pmdas/lio/lio/pmdalio.python         |  320 ---------------------------
 src/pmdas/lio/pcp-lio.te                 |   29 --
 src/pmdas/lio/pcp-pmda-lio.spec          |   65 -----
 src/pmdas/lio/pmdalio.python             |  328 ++++++++++++++++++++++++++++
 src/pmdas/lio/tests/README               |   39 ---
 src/pmdas/lio/tests/iscsi_conf.json      |   22 -
 src/pmdas/lio/tests/iscsi_target.py      |  101 --------
 src/pmdas/lio/tests/lio_test.py          |  106 ---------
 src/pmns/stdpmid.pcp                     |    1 
 tests/README                             |   91 +++++--
 tests/iscsi_conf.json                    |   22 +
 tests/iscsi_target.py                    |  119 +++++++++-
 tests/iscsi_target_configfs_dump.tar.gz  |binary
 tests/lio_test.py                        |  136 ++++++++++-
 45 files changed, 2391 insertions(+), 1029 deletions(-)

Details ...

commit ab53d338a95b9676ae3e72fd557ee25770c670a6
Author: Lukas Berk <[email protected]>
Date:   Sat Feb 11 15:14:43 2017 -0500

    pmdalio: add metric help text and minor corrections
    
    Install/Remove - correct date / pmda name
    help - add help text for metrics
    pmdalio.python - small typo correction
    pcp-pmda-lio.spec - remove
    pcp-lio.te - remove, now within pcp's upstream policy package

commit 7e8fb15cf944a02769470bd769bd1d3c583c2780
Author: Lukas Berk <[email protected]>
Date:   Fri Feb 10 16:17:15 2017 -0500

    Add pmdalio to pmns
    
    Added as 142

commit c5734bbdb2bf48322d9d2c6e53b29cc829b1f60e
Author: Lukas Berk <[email protected]>
Date:   Tue Feb 7 10:42:14 2017 -0500

    pmdalio: QA Install and Remove pmdalio in qa/1060

commit e73b0e2e5af39f35147a1d8db2f0587c784d5dd0
Author: Lukas Berk <[email protected]>
Date:   Fri Feb 3 22:13:24 2017 -0500

    Update .gitignore

commit de6a283e51b513646a807ec8b3048846237fd9f1
Author: Lukas Berk <[email protected]>
Date:   Fri Feb 3 21:32:41 2017 -0500

    pmdalio: add postun call to pmda removal scriptlet

commit 358463d045df8e21df35db7940491e03f78a09c2
Author: Lukas Berk <[email protected]>
Date:   Fri Feb 3 21:32:23 2017 -0500

    pmdalio: further qa work

commit 0370eac68461d43597f73f35c53ddc94c8cd975c
Author: Lukas Berk <[email protected]>
Date:   Fri Feb 3 12:04:13 2017 -0500

    qa: add wrapper test for the pmdalio tests

commit 0a5f45012e6c0cdee001982acaf55f78d3ad46e1
Author: Lukas Berk <[email protected]>
Date:   Thu Feb 2 21:29:59 2017 -0500

    pmdalio: Move test to qa directory
    
    Tests are typically kept within the pcp/qa directory, just moving things across for
    a typical qa test to be written to include the pre-written test

commit c0853f13e617d5e3ae553b499fa8f36a93115c8d
Author: Lukas Berk <[email protected]>
Date:   Thu Feb 2 17:48:49 2017 -0500

    pmdalio: rework file layout slightly and add build bits
    
    Drop the sub lio directory and move Install/Remove/pmdalio.python
    files to the main pmdas/lio dir
    
    Add GNUmakefile, include pmda in pcp.spec.in

commit e2e2df067ac41cd652b943494375f3f707812663
Author: Paul Cuzner <[email protected]>
Date:   Thu Jan 5 17:28:21 2017 +1300

    spec: spec file added
    
    Allow rpm to be built from the repo

commit ccf7f3032b877cd0b4893fc8c0b71cb88b9abf02
Author: Paul Cuzner <[email protected]>
Date:   Wed Jan 4 11:20:19 2017 +1300

    tests: add unittest based automated testing
    
    the lio_test script has been added to build a test environment and
    validate the PMDA values dynamically. The test iscsi environment is
    determined by iscsi_conf.json and so can be changed to meet
    different levels of complexity.
    
    See README for further details

commit 4a6f5930e0d1c3fa25836314d2d762e76cbbf5d3
Author: Paul Cuzner <[email protected]>
Date:   Wed Jan 4 11:12:58 2017 +1300

    pmdalio: ensure pmda sees config changes, and correct LUN size calculation
    
    By default the tcm module holds a cache dict of storage object so it only
    walks configfs once for device discovery. This is fine, if adds/removes are
    done through the same system - but in the case of the pmda the cache is
    a problem since it won't reflect changes to configfs correctly. This fix drops
    the cache (bs_cache) at each refresh interval.
    
    In addition a minor change was made to the calculation of LUN size to round
    up (4.8GB = 5GB)

commit 0368886f8b0c073b75fae1a611882aee31d21546
Author: Paul Cuzner <[email protected]>
Date:   Fri Dec 23 18:10:01 2016 +1300

    README: document current issues with repeated test runs
    
    Issues section added to the README

commit e8f6364a74ea48425399bd0e064db7780ee99b0d
Author: Paul Cuzner <[email protected]>
Date:   Fri Dec 23 18:00:49 2016 +1300

    tests: enable the drop configuraton method
    
    In the teardown class method, the call to drop the iscsi
    definition needed to be enabled (was commented out!)

commit 360d9f328af5686c4d6f4232ca3f333f359fa5ef
Author: Paul Cuzner <[email protected]>
Date:   Fri Dec 23 17:44:52 2016 +1300

    pmdalio: Catch RTSLIBNotInCFS error on storage object
    
    When rebuilding the lun dict (refresh call), new luns added to the environment
    can trigger an RTSLIBNotInCFS  exception, likely due to timing. By catching the exception
    we allow the lun dict to be updated properly, bypassing this issue.

commit a5069220a3e9739ca898543db45c8d93eb5fe24f
Author: Paul Cuzner <[email protected]>
Date:   Fri Dec 23 16:06:53 2016 +1300

    pmdalio: syntax fix
    
    call public property not internal method on tpg object

commit e7416ce3872645a78c6ad75b193a4eaa48f0ceee
Author: Paul Cuzner <[email protected]>
Date:   Fri Dec 23 15:48:23 2016 +1300

    tests: 1st commit for automated tests of the pmda agent
    
    the lio_test script creates a standalone iscsi target instance on the
    local machine using the iscsi_target module, which is then compared
    to the values in the testcases

commit 61f99b0957148d8ef0e2cb17d0f32ef7e93c73b2
Author: Paul Cuzner <[email protected]>
Date:   Fri Dec 23 15:46:29 2016 +1300

    tests: json conf file added
    
    the json file is used by the lio_test.py code to dynamically create a
    local iscsi configuration on the host.

commit 152b40c9780a54feaa3cb00d0d440289af2bc284
Author: Paul Cuzner <[email protected]>
Date:   Fri Dec 23 12:04:43 2016 +1300

    Sample configfs directory added for testing

commit b4a57906880a36a6927fde597bf43e2cda560308
Author: Paul Cuzner <[email protected]>
Date:   Wed Dec 21 12:49:55 2016 +1300

    Tests: 1st commit of test/validation code

commit 9a0f3242ccf36dba61229f997ed504a67e4c1d1f
Author: pcuzner <[email protected]>
Date:   Wed Dec 21 09:14:02 2016 +1300

    Updated to reflect python3 rtslib tests

commit 67351bfde15fb2695fdca0ca4c101b0f85a60cbf
Author: Paul Cuzner <[email protected]>
Date:   Tue Dec 20 10:09:42 2016 +1300

    README: clarified use of the TE example

commit 13c8cc36964478371411322ac4280cc036c711ed
Author: Paul Cuzner <[email protected]>
Date:   Tue Dec 20 10:01:14 2016 +1300

    pcp-lio.te: Add example SELINUX TE file
    
    This is an example TE file used during testing to allow pmcd to start the lio pmda at
    boot time.

commit 68188c24a414cdc985b553f51a0f5e2b0537de99
Author: pcuzner <[email protected]>
Date:   Tue Dec 20 09:53:57 2016 +1300

    README: include rtslib and SELINUX info
    
    Updated to explain the dependency on python-rtslib for interaction with the LIO metadata held in configfs. Also included information relating to running the pmda in SELINUX environments.

commit b3e6ecd0398c63acfc71fe01bc014daff8167815
Author: Paul Cuzner <[email protected]>
Date:   Tue Dec 13 17:10:49 2016 +1300

    pmdalio.python: Updated domain ID to avoid upstream conflicts
    
    Initial domain id was 140, but informed by Lucas Berk @ Red Hat that this conflicts
    with upstream domains.

commit 14d0737fc42b745072e19e25e743aaf2d75e876f
Author: Paul Cuzner <[email protected]>
Date:   Tue Dec 13 16:17:53 2016 +1300

    1st code commit

commit ae901e270390e19aa01f2a63f9811cab33d93359
Author: pcuzner <[email protected]>
Date:   Tue Dec 13 15:54:47 2016 +1300

    added README documentation

commit c57c02efe5b2422b8561f25d346b7a67460f90a8
Author: pcuzner <[email protected]>
Date:   Tue Dec 13 15:24:06 2016 +1300

    Initial commit

-=-=-=-=-=-=-=-=-=-=-=-
Groups.io Links:

You receive all messages sent to this group.

View/Reply Online (#15117): https://groups.io/g/pcp/message/15117
View All Messages In Topic (1): https://groups.io/g/pcp/topic/4358936
Mute This Topic: https://groups.io/mt/4358936?uid=174580
New Topic: https://groups.io/g/pcp/post
-=-=-
pcp mailing list
[email protected]
https://groups.io/g/pcp/messages
-=-=-
Change Your Subscription: https://groups.io/g/pcp/editsub?uid=174580
Group Home: https://groups.io/g/pcp
Contact Group Owner: [email protected]
Terms of Service: https://groups.io/static/tos
Unsubscribe: https://groups.io/g/pcp/leave/354243/563757577/xyzzy
-=-=-=-=-=-=-=-=-=-=-=-