troubleshooting minion - failed delivery

Steven Vacaroaia <[email protected]> Mon, 11 Jun 2018 09:46:47 -0400
Newsgroups gmane.network.opennms.general
Message-ID <CAJ4cwkNjQ+dc1YnGUCPhhibiB+u9J9bwTXg=EmrVz-+ZdUM8NQ@mail.gmail.com>
Hi,
I am using OpenNMS version 21.0.4

2 days ago all my minions ( 4 of them)  start reporting connection issues
despite the fact that minion ping from client is fine

Nothing obvious in the logs ..greping for error ..or maybe I am not looking
for the right thing
Below I provided some log excerpts

Any hints / suggestions for troubleshooting this will be very appreciated

Thanks

grep "2018-06-08 15:30" /extra/logs/poller.log

2018-06-08 15:30:01,876 WARN  [Camel (rpcClient) thread #19 -
ProducerTemplate] o.a.c.c.j.r.TemporaryQueueReplyManager: ReplyTo
destination was not set and timeout occurred

2018-06-08 15:30:01,877 ERROR [Camel (rpcClient) thread #19 -
ProducerTemplate] o.a.c.p.DefaultErrorHandler: Failed delivery for
(MessageId: ID-nms-chi-medavail-net-38365-1528486183918-0-106 on
ExchangeId: ID-nms-chi-medavail-net-38365-1528486183918-0-91). Exhausted
after delivery attempt: 1 caught:
org.apache.camel.RuntimeExchangeException: Failed to resolve replyTo
destination on the exchange:
Exchange[ID-nms-chi-medavail-net-38365-1528486183918-0-91]

2018-06-08 15:30:01,887 WARN  [Camel (rpcClient) thread #28 -
ProducerTemplate] o.a.c.c.j.r.TemporaryQueueReplyManager: ReplyTo
destination was not set and timeout occurred
2018-06-08 15:30:01,887 ERROR [Camel (rpcClient) thread #28 -
ProducerTemplate] o.a.c.p.DefaultErrorHandler: Failed delivery for
(MessageId: ID-nms-chi-medavail-net-38365-1528486183918-0-123 on
ExchangeId: ID-nms-chi-medavail-net-38365-1528486183918-0-92). Exhausted
after delivery attempt: 1 caught:
org.apache.camel.RuntimeExchangeException: Failed to resolve replyTo
destination on the exchange:
Exchange[ID-nms-chi-medavail-net-38365-1528486183918-0-92]

2018-06-08 15:30:01,889 WARN  [Camel (rpcClient) thread #18 -
ProducerTemplate] o.a.c.c.j.r.TemporaryQueueReplyManager: ReplyTo
destination was not set and timeout occurred
2018-06-08 15:30:01,889 ERROR [Camel (rpcClient) thread #18 -
ProducerTemplate] o.a.c.p.DefaultErrorHandler: Failed delivery for
(MessageId: ID-nms-chi-medavail-net-38365-1528486183918-0-126 on
ExchangeId: ID-nms-chi-medavail-net-38365-1528486183918-0-84). Exhausted
after delivery attempt: 1 caught:
org.apache.camel.RuntimeExchangeException: Failed to resolve replyTo
destination on the exchange:
Exchange[ID-nms-chi-medavail-net-38365-1528486183918-0-84]

2018-06-08 15:30:01,872 WARN  [Camel (rpcClient) thread #15 -
ProducerTemplate] o.a.c.c.j.r.TemporaryQueueReplyManager: ReplyTo
destination was not set and timeout occurred
2018-06-08 15:30:01,900 ERROR [Camel (rpcClient) thread #15 -
ProducerTemplate] o.a.c.p.DefaultErrorHandler: Failed delivery for
(MessageId: ID-nms-chi-medavail-net-38365-1528486183918-0-151 on
ExchangeId: ID-nms-chi-medavail-net-38365-1528486183918-0-85). Exhausted
after delivery attempt: 1 caught:
org.apache.camel.RuntimeExchangeException: Failed to resolve replyTo
destination on the exchange: Exchange[ID-nms-chi-medavail-net-38365-152848



/extra/logs/provisiond.log:2018-06-08 16:22:07,211 ERROR [importExecutor-3]
o.o.n.p.p.FasterFilesystemForeignSourceRepository:
importResourceRequisition: can't save cached requisition associated with
file [/opt/opennms/etc/imports/pending/Minions.xml.1528489310448]


/extra/logs/provisiond.log:java.io.FileNotFoundException: there is no file
called 'Minions.xml.1528489310448' in directory /opt/opennms/etc/imports

ls -l /opt/opennms/etc/imports
total 72
-rw-rw-r--. 1 root root  2943 Sep 12  2017 APM.xml
-rw-rw-r--. 1 root root  2990 Mar  9 13:50 BANNER.xml
-rw-rw-r--. 1 root root   997 Feb 21  2017 DIS.xml
-rw-rw-r--. 1 root root  2869 Mar  1 11:24 GEISINGER.xml
-rw-rw-r--. 1 root root  3216 Jun  8 16:30 HCA.xml
-rw-rw-r--. 1 root root  2861 Mar 27 12:34 ILO.xml
-rw-rw-r--. 1 root root  1838 Dec 15 09:00 MC-APM.xml
-rw-rw-r--. 1 root root  1117 Jan  5 10:56 MC-BANNER.xml
-rw-rw-r--. 1 root root   919 Nov 20  2017 MC-HCA.xml
-rw-rw-r--. 1 root root  9651 Jun  5 11:24 MC-WAGPROD.xml
-rw-rw-r--. 1 root root  1821 Jun  8 16:22 Minions.xml
drwxrwxr-x. 2 root root     6 Jun  8 16:22 pending
-rw-rw-r--. 1 root root 15760 Jun  8 16:20 vCenterImport.xml
-rw-rw-r--. 1 root root  3197 Nov 21  2017 WAGPROD.xml
[root@nms ~]# ls -l /opt/opennms/etc/imports/pending/
total 0

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot

_______________________________________________
Please read the OpenNMS Mailing List FAQ:
http://www.opennms.org/index.php/Mailing_List_FAQ

opennms-discuss mailing list

To *unsubscribe* or change your subscription options, see the bottom of this page:
https://lists.sourceforge.net/lists/listinfo/opennms-discuss