Re: XML collection not working

Ronald Roskens <[email protected]>
Newsgroups gmane.network.opennms.general
Message-ID <[email protected]> 
I can understand the confusion. Services need to be discovered (either manually or automatically) first before you can either poll them or collect data from them.

What documentation or tutorials have you read through so far? I’d like to know what was missed so that this can be improved for the next person who tries to do this.

Ron

> On Jul 18, 2017, at 10:09 PM, JohnD Blackburn <[email protected]> wrote:
> 
> Thankyou for your response.
>  
> I installed the VTD required packages before I tried setting it as a handler.
>  
> As suggested, I’ve  removed the handler class entry from collectd-configuration.xml, but it was still not working.
>  
> I have just now added the following to the default-foreign-source.xml
>  
>       <detector name="ABBCS-CUPS" class="org.opennms.netmgt.provision.detector.simple.HttpDetector">
>          <parameter key="url" value="/printers.xml"/>
>          <parameter key="port" value="8000"/>
>       </detector>
>  
> Which seems to have fixed the issue, but then I found I also needed to add a “~” to the “response-text” parameter in poller-configuration.xml:
>  
>          <parameter key="response-text" value="~.*printer.*"/>
>  
>  
> The documentation for the XML collector doesn’t mention default-foreign-source.xml at all, so is this something that I shouldn’t really need, and I’ve missed something else in my configuration, or is this  just an oversight, and should be in the doco?
>  
>  
>  
>  
> 
>                                                                                                        
>  
>  
> <image001.gif>
> John Blackburn
>  
> Solution Architect - Cloud Services
>  
> Enterprise Software
>  
>  
>  
> Level 1, 757 Ann Street
>  
> Fortitude Valley, Queensland, 4006
> AUSTRALIA
> Phone: +61 7 33033219
>  
> Mobile: +61 403 344 524
> E-Mail:  [email protected] <mailto:[email protected]>
> www.abb.com <http://www.abb.com/>	
>  
>  
>  
> From: Ronald Roskens [mailto:[email protected] <mailto:[email protected]>] 
> Sent: Tuesday, 18 July 2017 11:31 PM
> To: General OpenNMS Discussion <[email protected] <mailto:[email protected]>>
> Subject: Re: [opennms-discuss] XML collection not working
>  
> Does it work if you take out the handler-class parameter in the collectd-configuration.xml? The size of your XML is so small, that I don’t think VTD is going to make that much of a difference in speed for parsing it, so lets try with the default handler first. (You didn’t list which packages you have installed. The VTD handler isn’t installed by default and you need an extra package for it.
>  
> On Jul 17, 2017, at 12:32 AM, JohnD Blackburn <[email protected] <mailto:[email protected]>> wrote:
>  
> Hi all,
>  
> I have been trying to implement a custom monitor for CUPS printers using the XML collector, but I’m having problems getting it to collect any data.
>  
> Can someone please confirm that my configuration is correct, or let me know what I’ve missed.
>  
> We’re running opennms 20.0.1
>  
>  
>  
> I have a webserver set up that returns the metrics I care about in xml format:
>  
> [root@aue-s-opennms01 etc]# curl http://10.1.2.3:8000/printers.xml <http://10.1.2.3:8000/printers.xml>
> <?xml version="1.0" encoding="UTF-8"?>
> <printers>
>      <printer name="Printer1">
>            <njobs>5</njobs>
>      </printer>
>      <printer name="Printer2">
>            <njobs>0</njobs>
>      </printer>
>      <printer name="Printer3">
>            <njobs>0</njobs>
>      </printer>
> </printers>
>  
>  
> Here is (I think) all the relevant configuration bits:
>  
> xml-datacollection-config.xml:
>  
>     <xml-collection name="ABBCS-CUPS">
>         <rrd step="300">
>             <rra>RRA:AVERAGE:0.5:1:2016</rra>
>             <rra>RRA:AVERAGE:0.5:12:1488</rra>
>             <rra>RRA:AVERAGE:0.5:288:366</rra>
>             <rra>RRA:MAX:0.5:288:366</rra>
>             <rra>RRA:MIN:0.5:288:366</rra>
>         </rrd>
>         <xml-source url="http://{ipaddr}:8000/printers.xml <http://{ipaddr}:8000/printers.xml>">
>             <import-groups>xml-datacollection/CUPS-Printers.xml</import-groups>
>         </xml-source>
>     </xml-collection>
>  
>  
> xml-datacollection/CUPS-Printers.xml:
>  
> <xml-groups>
>     <xml-group name="CUPS-Printer-stats" resource-type="CUPSPrinters"
>                 resource-xpath="/printers/printer"
>                 key-xpath="@name">
>       <xml-object name="printerName" type="string" xpath="@name" />
>       <xml-object name="njobs" type="GAUGE" xpath="njobs" />
>     </xml-group>
> </xml-groups>
>  
> collectd-configuration.xml:
>  
>    <package name="ABBCS-CUPS">
>       <filter>(IPADDR != '0.0.0.0')</filter>
>       <include-range begin="1.1.1.1" end="254.254.254.254"/>
>       <include-range begin="::1" end="ffff:ffff:ffff:ffff:ffff:ffff:ffff:ffff"/>
>       <service name="ABBCS-CUPS" interval="300000" user-defined="false" status="on">
>          <parameter key="collection" value="ABBCS-CUPS"/>
>          <parameter key="handler-class" value="org.opennms.protocols.xml.vtdxml.DefaultVTDXmlCollectionHandler"/>
>       </service>
>    </package>
>  
> …
>  
>    <collector service="ABBCS-CUPS" class-name="org.opennms.protocols.xml.collector.XmlCollector"/>
>  
>  
> datacollection-configuration.xml:
>  
> <?xml version="1.0"?>
> <datacollection-config rrdRepository="/opt/opennms/share/rrd/snmp/">
> …
>     <snmp-collection name="ABBCS" snmpStorageFlag="select">
>         <rrd step="300">
>             <rra>RRA:AVERAGE:0.5:1:8928</rra>
>             <rra>RRA:AVERAGE:0.5:12:8784</rra>
>             <rra>RRA:AVERAGE:0.5:480:366</rra>
>             <rra>RRA:MIN:0.5:12:8784</rra>
>             <rra>RRA:MAX:0.5:12:8784</rra>
>         </rrd>
> …
>         <include-collection dataCollectionGroup="ABBCS-CUPS"/>
>     </snmp-collection>
> </datacollection-config>
>  
>  
>  
> datacollection/ABBCS-CUPS.xml:
>  
> <datacollection-group name="ABBCS-CUPS">
>   <resourceType name="CUPSPrinters" label="CUPS Printers"
>    resourceLabel="Printer ${printerName}" >
>      <persistenceSelectorStrategy
>           class="org.opennms.netmgt.collection.support.PersistAllSelectorStrategy"/>
>      <storageStrategy
>           class="org.opennms.netmgt.collection.support.IndexStorageStrategy"/>
>   </resourceType>
> </datacollection-group>
>  
>  
> poller-configuration.xml:
>  
>    <package name="ABBCS-CUPS">
>       <filter>((IPADDR != '0.0.0.0') &amp; (catincServers))</filter>
>       <include-range begin="1.1.1.1" end="254.254.254.254"/>
>       <include-range begin="::1" end="ffff:ffff:ffff:ffff:ffff:ffff:ffff:ffff"/>
>       <rrd step="300">
>          <rra>RRA:AVERAGE:0.5:1:2016</rra>
>          <rra>RRA:AVERAGE:0.5:12:1488</rra>
>          <rra>RRA:AVERAGE:0.5:288:366</rra>
>          <rra>RRA:MAX:0.5:288:366</rra>
>          <rra>RRA:MIN:0.5:288:366</rra>
>       </rrd>
>       <service name="ABBCS-CUPS" interval="300000" user-defined="false" status="on">
>          <parameter key="retry" value="1"/>
>          <parameter key="timeout" value="3000"/>
>          <parameter key="port" value="8000"/>
>          <parameter key="url" value="/printers.xml"/>
>          <parameter key="rrd-repository" value="/opt/opennms/share/rrd/response" />
>          <parameter key="rrd-base-name" value="cups" />
>          <parameter key="response" value="200-202,299"/>
>          <parameter key="response-text" value=".*printer.*"/>
>       </service>
>       <downtime begin="0" end="300000" interval="30000"/>
>       <downtime begin="300000" end="43200000" interval="300000"/>
>       <downtime begin="43200000" end="432000000" interval="600000"/>
>       <downtime begin="432000000" delete="true"/>
>    </package>
>  
> …
>  
>    <monitor service="ABBCS-CUPS" class-name="org.opennms.netmgt.poller.monitors.HttpMonitor"/>
>  
>  
> Any assistance greatly appreciated.
>  
> Regards,
> John Blackburn.
>  
>  
>  
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org <http://slashdot.org/>! http://sdm.link/slashdot_______________________________________________ <http://sdm.link/slashdot_______________________________________________>
> Please read the OpenNMS Mailing List FAQ:
> http://www.opennms.org/index.php/Mailing_List_FAQ <http://www.opennms.org/index.php/Mailing_List_FAQ>
> 
> opennms-discuss mailing list
> 
> To *unsubscribe* or change your subscription options, see the bottom of this page:
> https://lists.sourceforge.net/lists/listinfo/opennms-discuss <https://lists.sourceforge.net/lists/listinfo/opennms-discuss>
>  
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org <http://slashdot.org/>! http://sdm.link/slashdot_______________________________________________ <http://sdm.link/slashdot_______________________________________________>
> Please read the OpenNMS Mailing List FAQ:
> http://www.opennms.org/index.php/Mailing_List_FAQ <http://www.opennms.org/index.php/Mailing_List_FAQ>
> 
> opennms-discuss mailing list
> 
> To *unsubscribe* or change your subscription options, see the bottom of this page:
> https://lists.sourceforge.net/lists/listinfo/opennms-discuss <https://lists.sourceforge.net/lists/listinfo/opennms-discuss>

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot

_______________________________________________
Please read the OpenNMS Mailing List FAQ:
http://www.opennms.org/index.php/Mailing_List_FAQ

opennms-discuss mailing list

To *unsubscribe* or change your subscription options, see the bottom of this page:
https://lists.sourceforge.net/lists/listinfo/opennms-discuss
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.