Three Headed Monster

I've set up the three headed monster - OpenNMS (Kenny), Web-UI(Kyle), Database(Cartman).  I can start OpenNMS on Kenny and on Kyle each pointing to Cartman, no problem as standalone OpenNMS servers, but when I try to follow the documentation for separting the three, I get the following error:

[root@Kyle bin]# ./opennms -v start
Starting OpenNMS: Could not connect to 127.0.0.1 on port 8181 (OpenNMS might not be running or could be starting up or shutting down): Connection refused
Could not connect to 127.0.0.1 on port 8181 (OpenNMS might not be running or could be starting up or shutting down): Connection refused
OpenNMS.Eventd         : start_pending
OpenNMS.JettyServer    : start_pending
Could not connect to 127.0.0.1 on port 8181 (OpenNMS might not be running or could be starting up or shutting down): Connection refused
Started OpenNMS, but it stopped running: for details see /opt/opennms/logs/daemon/output.log

And when I look in the output.log file I see a problem with eventd:

Thu Mar 29 16:09:24 EDT 2012
begin ulimit settings:
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 31304
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 20480
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 1024
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
end ulimit settings
Executing command: /opt/opennms/bin/runjava -r  -- -Djava.endorsed.dirs=/opt/opennms/lib/endorsed   -Dopennms.home=/opt/opennms -Dcom.sun.management.jmxremote.port=18980 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Xmx256m -XX:+HeapDumpOnOutOfMemoryError  -XX:MaxPermSize=128m -jar /opt/opennms/lib/opennms_bootstrap.jar  start 
An error occurred while attempting to start the "OpenNMS:Name=Eventd" service (class org.opennms.netmgt.eventd.jmx.Eventd).  Shutting down and exiting.
javax.management.RuntimeMBeanException: org.springframework.beans.factory.access.BootstrapException: Unable to return specified BeanFactory instance: factory key [eventDaemonContext] ...............



Kenny's error is:

[opennms@Kenny bin] ./opennms -v start
Starting OpenNMS: Could not connect to 127.0.0.1 on port 8181 (OpenNMS might not be running or could be starting up or shutting down): Connection refused
Could not connect to 127.0.0.1 on port 8181 (OpenNMS might not be running or could be starting up or shutting down): Connection refused
Could not connect to 127.0.0.1 on port 8181 (OpenNMS might not be running or could be starting up or shutting down): Connection refused
Started OpenNMS, but it stopped running: for details see /opt/opennms/logs/daemon/output.log
failed

And the output.log says:

------------------------------------------------------------------------------
Thu Mar 29 16:30:01 EDT 2012
begin ulimit settings:
core file size        (blocks, -c) unlimited
data seg size         (kbytes, -d) unlimited
file size             (blocks, -f) unlimited
open files                    (-n) 20480
pipe size          (512 bytes, -p) 10
stack size            (kbytes, -s) 8192
cpu time             (seconds, -t) unlimited
max user processes            (-u) 29995
virtual memory        (kbytes, -v) unlimited
end ulimit settings
Executing command: /opt/opennms/bin/runjava -r  -- -Djava.endorsed.dirs=/opt/opennms/lib/endorsed   -Dopennms.home=/opt/opennms -Dcom.sun.management.jmxremote.port=18980 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Xmx256m -XX:+HeapDumpOnOutOfMemoryError  -XX:MaxPermSize=128m -verbose:gc -jar /opt/opennms/lib/opennms_bootstrap.jar  start 
[GC 18432K->1899K(66560K), 0.0135640 secs]
[DEBUG] System property 'opennms.library.jicmp' set to '/opt/NMSjicmp/lib/libjicmp.so.  Attempting to load jicmp library from this location.
[INFO] Successfully loaded jicmp library.
[DEBUG] System property 'opennms.library.jicmp' set to '/opt/NMSjicmp/lib/libjicmp.so.  Attempting to load jicmp library from this location.
[INFO] Successfully loaded jicmp library.
[DEBUG] System property 'opennms.library.jicmp6' set to '/usr/local/lib/libjicmp6.so.  Attempting to load jicmp6 library from this location.
[INFO] Successfully loaded jicmp6 library.
An error occurred while attempting to start the "OpenNMS:Name=TestLoadLibraries" service (class org.opennms.netmgt.vmmgr.Manager).  Shutting down and exiting.
javax.management.RuntimeMBeanException: java.lang.IllegalStateException: Unable to initialize any ICMP support.  Bailing out.
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.rethrow(Defa ............................


So Kenny nor Kyle will start.

Any ideas on this one?

I don't have iptables enabled, selinux is set to permissive.

A quick summary of the documentation that I followed:

OpenNMS (Kenny):
1.  Modify opennms-datasources.xml, point to Cartman.
2.  NFS export /opt/opennms/etc and /opt/opennms/share/rrd
3.  Modify eventd-configuration.xml to point to Kyle.

Web-UI (Kyle):
1.  NFS mounts /mnt/opennms/etc and /mnt/opennms/share/rrd
2.  Create new /opt/opennms/etc and /opt/opennms/share/rrd folders
3.  Symlink the mounts to these new directories.
4.  Replace the symlinked opennms.properties file with a new one making two changes:
opennms.rtc.event.proxy.host=Kenny
opennms-rtc-client.http-post.base-url = http://Kyle:8980/opennms/rtc/post
5.  Replace symlinked opennms-datasources.xml file with a local one pointing to Cartman.
6.  Replace symlinked c3po.properties file with a local one changing the initial, min, and max connections from 50 to 5
7.  Replace symlinked services-configuration.xml file, with only the following services enabled:
XSLTProcessor
HTTPAdaptor
HttpAdaptorMgmt
Manager
Eventd
JettyServer

Database (Cartman):
1.  Modified pg_hba.conf to allow connections from Kenny and Kyle


Thanks,
John

------------------------------------------------------------------------------
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here 
http://p.sf.net/sfu/sfd2d-msazure
_______________________________________________
Please read the OpenNMS Mailing List FAQ:
http://www.opennms.org/index.php/Mailing_List_FAQ

opennms-install mailing list

To *unsubscribe* or change your subscription options, see the bottom of this page:
https://lists.sourceforge.net/lists/listinfo/opennms-install