Restart of xinetd or syslog daemon causes failure?

"Montz, James C. (James Tower)" <[email protected]>
Newsgroups gmane.linux.redhat.piranha
Message-ID <[email protected]> 
Up until about 2 weeks ago, our fail over was working perfectly.

Now it seems, when the primary server restarts syslogd at 4am (as part of
logrotate), and the fail over partner detects a failure.

I cannot find any correlation.  Am I mistaken?  Pulse is not
controlled/affected by xinetd is it?
It would also appear that during this 4am flip-flop, the server is not
properly arping out the failover IP address.  From all indications, the fail
over server does this properly when assuming control, but the Primary does
not when re-assuming control a few minutes later.

Anyone else seen similar behaviour?  Any ideas on cause/resolution?

Any links to more detailed documentation on how pulse sends out the arp
broadcast?

Thanks in advance for any help the list can provide!

Kernel:  2.4.18-17.xsmp
Piranha: 0.7.0-3
Ipvsadm: 1.18-8

Lvs.cf:
----------------------------
service = fos
primary = *.*.17.68
primary_private = 10.50.254.68
backup = *.*.17.69
backup_private = 10.50.254.69
backup_active = 1
heartbeat = 1
heartbeat_port = 539
keepalive = 5
deadtime = 15
rsh_command = rsh
failover PFFS {
     address = *.*.17.221 eth0:1
     active = 1
     port = 11111
     timeout = 30
     reentry = 360
     start_cmd = "/etc/rc.d/init.d/pffs start"
     stop_cmd = "/etc/rc.d/init.d/pffs stop"
}

On Primary Server:
----------------------------
Nov 26 04:02:22 JtPfImsRsMkt1p syslogd 1.4.1: restart.

On Fail Over Server:
-------------------------------
Nov 26 04:05:44 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Sending heartbeat... 
Nov 26 04:05:44 JtPfImsRsMkt1F pulse[11786]: DEBUG -- setting SEND_heartbeat
timer
Nov 26 04:05:44 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Received Heartbeat
from partner
Nov 26 04:05:44 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Received Heartbeat
from partner
Nov 26 04:05:44 JtPfImsRsMkt1F pulse[11786]: DEBUG -- setting SEND_heartbeat
timer
Nov 26 04:05:49 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Sending heartbeat...
Nov 26 04:05:49 JtPfImsRsMkt1F pulse[11786]: DEBUG -- setting SEND_heartbeat
timer
Nov 26 04:05:54 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Sending heartbeat...
Nov 26 04:05:54 JtPfImsRsMkt1F pulse[11786]: DEBUG -- setting SEND_heartbeat
timer
Nov 26 04:05:59 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Sending heartbeat...
Nov 26 04:05:59 JtPfImsRsMkt1F pulse[11786]: DEBUG -- setting NEED_heartbeat
timer
Nov 26 04:05:59 JtPfImsRsMkt1F pulse[11786]: partner dead: activating
failover services
Nov 26 04:05:59 JtPfImsRsMkt1F fos[11789]: Shutting down due to signal 15
Nov 26 04:05:59 JtPfImsRsMkt1F fos[11789]: Shutting down monitor for PFFS
198.12.17.221:11111 running as pid 11823
Nov 26 04:05:59 JtPfImsRsMkt1F nanny[11823]: Terminating due to signal 15
Nov 26 04:05:59 JtPfImsRsMkt1F fos[11789]: will now exit to notify pulse...
Nov 26 04:05:59 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Executing
/usr/sbin/fos --active
Nov 26 04:05:59 JtPfImsRsMkt1F pulse[11786]: DEBUG -- setting SEND_heartbeat
timer
Nov 26 04:05:59 JtPfImsRsMkt1F pulse[28589]: DEBUG -- Executing
'/sbin/ifconfig eth0:1 198.12.17.221 up'
Nov 26 04:05:59 JtPfImsRsMkt1F fos[28587]: Stopping local services (if any)
Nov 26 04:05:59 JtPfImsRsMkt1F fos[28587]: Shutting down local service
198.12.17.221:11111
Nov 26 04:05:59 JtPfImsRsMkt1F pulse[28588]: DEBUG -- Executing
'/usr/sbin/send_arp'
Nov 26 04:06:00 JtPfImsRsMkt1F fos[28587]: Warning; shutdown of local
service 198.12.17.221:11111 returned error 1
Nov 26 04:06:00 JtPfImsRsMkt1F fos[28587]: Starting local service
198.12.17.221:11111 ...
Nov 26 04:06:03 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Received Heartbeat
from partner
Nov 26 04:06:03 JtPfImsRsMkt1F pulse[11786]: partner active: deactivating
services
Nov 26 04:06:03 JtPfImsRsMkt1F fos[28587]: Shutting down due to signal 15
Nov 26 04:06:03 JtPfImsRsMkt1F fos[28587]: Shutting down local service
198.12.17.221:11111
Nov 26 04:06:04 JtPfImsRsMkt1F pulse[28586]: gratuitous fos arps finished
Nov 26 04:06:04 JtPfImsRsMkt1F fos[28587]: Warning; shutdown of local
service 198.12.17.221:11111 returned error 1
Nov 26 04:06:04 JtPfImsRsMkt1F fos[28587]: will now exit to notify pulse...
Nov 26 04:06:04 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Executing
'/sbin/ifconfig eth0:1 down'
Nov 26 04:06:04 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Executing
/usr/sbin/fos --monitor
Nov 26 04:06:04 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Received Heartbeat
from partner
Nov 26 04:06:04 JtPfImsRsMkt1F pulse[11786]: DEBUG -- setting SEND_heartbeat
timer
Nov 26 04:06:04 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Sending heartbeat...
Nov 26 04:06:04 JtPfImsRsMkt1F pulse[11786]: DEBUG -- setting SEND_heartbeat
timer
Nov 26 04:06:04 JtPfImsRsMkt1F fos[28907]: Stopping local services (if any)
Nov 26 04:06:04 JtPfImsRsMkt1F fos[28907]: Shutting down local service
198.12.17.221:11111
Nov 26 04:06:05 JtPfImsRsMkt1F fos[28907]: Warning; shutdown of local
service 198.12.17.221:11111 returned error 1
Nov 26 04:06:05 JtPfImsRsMkt1F fos[28907]: Starting monitor for
198.12.17.221:11111 running as pid 28907
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Failover service monitor for
198.12.17.68:11111 started
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Send_program is NULL
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Send_string is NULL
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Expect_string is NULL
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Service_type value=1
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Opening TCP socket to remote
service port 11111...
Nov 26 04:06:05 JtPfImsRsMkt1F fos[28907]: Warning; shutdown of local
service 198.12.17.221:11111 returned error 1
Nov 26 04:06:05 JtPfImsRsMkt1F fos[28907]: Starting monitor for
198.12.17.221:11111 running as pid 28907
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Failover service monitor for
198.12.17.68:11111 started
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Send_program is NULL
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Send_string is NULL
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Expect_string is NULL
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Service_type value=1
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Opening TCP socket to remote
service port 11111...
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Connecting socket to remote
address...
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: DEBUG -- Posting CONNECT poll()
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: avail: 1 active: 0: count: 2
Nov 26 04:06:05 JtPfImsRsMkt1F nanny[28945]: Remote service
198.12.17.221:11111 is available
Nov 26 04:06:08 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Received Heartbeat
from partner
Nov 26 04:06:08 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Received Heartbeat
from partner 
Nov 26 04:06:08 JtPfImsRsMkt1F pulse[11786]: DEBUG -- setting SEND_heartbeat
timer
Nov 26 04:06:09 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Sending heartbeat...
Nov 26 04:06:09 JtPfImsRsMkt1F pulse[11786]: DEBUG -- setting SEND_heartbeat
timer
Nov 26 04:06:13 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Received Heartbeat
from partner
Nov 26 04:06:13 JtPfImsRsMkt1F pulse[11786]: DEBUG -- Received Heartbeat
from partner

________________________
James C. Montz    RHCE
Hosting Services Engineer
James Tower
<http://www.jamestower.com>
<mailto:[email protected]>
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.