Re: Piranha-list Digest, Vol 38, Issue 3

R R <[email protected]> Thu, 11 Jun 2009 23:21:08 +0200
Newsgroups gmane.linux.redhat.piranha
Message-ID <[email protected]>
--===============1873036923==
Content-Type: multipart/alternative; boundary=0016364d2ab59c80cb046c192b37

--0016364d2ab59c80cb046c192b37
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

Hi,

Could you please send your lvs.cf file?

--

Bigo

On Thu, Jun 11, 2009 at 6:00 PM, <[email protected]> wrote:

> Send Piranha-list mailing list submissions to
>        [email protected]
>
> To subscribe or unsubscribe via the World Wide Web, visit
>        https://www.redhat.com/mailman/listinfo/piranha-list
> or, via email, send a message with subject or body 'help' to
>        [email protected]
>
> You can reach the person managing the list at
>        [email protected]
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Piranha-list digest..."
>
> Today's Topics:
>
>   1. Re: lvsd kills off all nannies! (Dan Yocum)
>
>
> ---------- Forwarded message ----------
> From: Dan Yocum <[email protected]>
> To: Piranha clustering/HA technology <[email protected]>
> Date: Wed, 10 Jun 2009 15:58:09 -0500
> Subject: Re: lvsd kills off all nannies!
> I just had the same experience again when attempting to add another service
> to our LVS director and reloading pulse, so upgrading to
> piranha-0.8.4-11.el5 did not help.
>
> One thing that I noticed was that the monitor process to one real servers
> failed right away (the service on that system was actually down).  I think
> this caused the nanny to falter which brought everything down, too.  Not
> good.
>
> Here's what I saw in /var/log/messages:
>
> lvs[19604]: rereading configuration file
> lvs[19604]: create_monitor for saz-admin:8443/fg5x3 running as pid 31729
> lvs[19604]: create_monitor for saz-admin:8443/fg6x3 running as pid 31730
> lvs[19604]: nanny for child saz-admin:8443/fg5x3 died! shutting down lvs
> lvs[19604]: shutting down virtual service MYSQL:3306
> lvs[19604]: shutting down virtual service SAZ:8888
> lvs[19604]: shutting down virtual service SAZ:8881
> lvs[19604]: shutting down virtual service SAZ:8882
> lvs[19604]: shutting down virtual service voms:8443
> lvs[19604]: shutting down virtual service voms-osg:8443
> lvs[19604]: shutting down virtual service gums:8443
> nanny[19614]: Terminating due to signal 15
> nanny[19617]: Terminating due to signal 15
> nanny[19622]: Terminating due to signal 15
> nanny[19644]: Terminating due to signal 15
> nanny[19645]: Terminating due to signal 15
> nanny[19647]: Terminating due to signal 15
> etc.
>
> Thanks,
> Dan
>
>
>
> Dan Yocum wrote:
>
>> Hi Barry,
>>
>> We're on piranha-0.8.4-9.3.el5.  I will upgrade to release 11 and see if
>> that helps.
>>
>> Thanks,
>> Dan
>>
>>
>> Barry Brimer wrote:
>>
>>> Quoting Dan Yocum <[email protected]>:
>>>
>>>  Hi all,
>>>>
>>>> Here's the situation we're running into - after setting a real server to
>>>> active = 0 and weight = 0 and reloading pulse, <perform some work on the
>>>> RS>, set active = 1 and weight = 3 and reloading pulse, lvsd first
>>>> creates the monitor for the process, which dies for some strange reason,
>>>> then proceeds to shutdown *all* virtual services!!
>>>>
>>>> Here's what I see in /var/log/messages:
>>>>
>>>
>>> <snip>
>>>
>>>> Performing a 'service pulse restart' brings everything back online just
>>>> fine.
>>>>
>>>> What's going on here?
>>>>
>>>> The OS is Scientific Linux 5.2 (i.e., RHELv5.2) on a Xen VM, kernel
>>>> 2.6.18-128.1.6.el5xen.
>>>>
>>>
>>> What version of piranha do you have installed?  The latest version seems
>>> to
>>> correct some nanny/pulse related issues
>>> <https://rhn.redhat.com/errata/RHBA-2009-0095.html>
>>>
>>> Barry
>>>
>>> _______________________________________________
>>> Piranha-list mailing list
>>> [email protected]
>>> https://www.redhat.com/mailman/listinfo/piranha-list
>>>
>>
>>
> --
> Dan Yocum
> Fermilab  630.840.6509
> [email protected], http://fermigrid.fnal.gov
> Fermilab.  Just zeros and ones.
>
>
>
> _______________________________________________
> Piranha-list mailing list
> [email protected]
> https://www.redhat.com/mailman/listinfo/piranha-list
>

--0016364d2ab59c80cb046c192b37
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi,<br><br>Could you please send your <a href=3D"http://lvs.cf">lvs.cf</a> =
file?<br><br>--<br><br>Bigo <br><br><div class=3D"gmail_quote">On Thu, Jun =
11, 2009 at 6:00 PM,  <span dir=3D"ltr">&lt;<a href=3D"mailto:piranha-list-=
[email protected]">[email protected]</a>&gt;</span> wrote:<b=
r>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">Send Piranha-list=
 mailing list submissions to<br>
 =A0 =A0 =A0 =A0<a href=3D"mailto:[email protected]">piranha-list@red=
hat.com</a><br>
<br>
To subscribe or unsubscribe via the World Wide Web, visit<br>
 =A0 =A0 =A0 =A0<a href=3D"https://www.redhat.com/mailman/listinfo/piranha-=
list" target=3D"_blank">https://www.redhat.com/mailman/listinfo/piranha-lis=
t</a><br>
or, via email, send a message with subject or body &#39;help&#39; to<br>
 =A0 =A0 =A0 =A0<a href=3D"mailto:[email protected]">piranha-=
[email protected]</a><br>
<br>
You can reach the person managing the list at<br>
 =A0 =A0 =A0 =A0<a href=3D"mailto:[email protected]">piranha-li=
[email protected]</a><br>
<br>
When replying, please edit your Subject line so it is more specific<br>
than &quot;Re: Contents of Piranha-list digest...&quot;<br>
<br>Today&#39;s Topics:<br>
<br>
 =A0 1. Re: lvsd kills off all nannies! (Dan Yocum)<br>
<br><br>---------- Forwarded message ----------<br>From:=A0Dan Yocum &lt;<a=
 href=3D"mailto:[email protected]">[email protected]</a>&gt;<br>To:=A0Piranha clu=
stering/HA technology &lt;<a href=3D"mailto:[email protected]">piranh=
[email protected]</a>&gt;<br>
Date:=A0Wed, 10 Jun 2009 15:58:09 -0500<br>Subject:=A0Re: lvsd kills off al=
l nannies!<br>I just had the same experience again when attempting to add a=
nother service to our LVS director and reloading pulse, so upgrading to pir=
anha-0.8.4-11.el5 did not help.<br>

<br>
One thing that I noticed was that the monitor process to one real servers f=
ailed right away (the service on that system was actually down). =A0I think=
 this caused the nanny to falter which brought everything down, too. =A0Not=
 good.<br>

<br>
Here&#39;s what I saw in /var/log/messages:<br>
<br>
lvs[19604]: rereading configuration file<br>
lvs[19604]: create_monitor for saz-admin:8443/fg5x3 running as pid 31729<br=
>
lvs[19604]: create_monitor for saz-admin:8443/fg6x3 running as pid 31730<br=
>
lvs[19604]: nanny for child saz-admin:8443/fg5x3 died! shutting down lvs<br=
>
lvs[19604]: shutting down virtual service MYSQL:3306<br>
lvs[19604]: shutting down virtual service SAZ:8888<br>
lvs[19604]: shutting down virtual service SAZ:8881<br>
lvs[19604]: shutting down virtual service SAZ:8882<br>
lvs[19604]: shutting down virtual service voms:8443<br>
lvs[19604]: shutting down virtual service voms-osg:8443<br>
lvs[19604]: shutting down virtual service gums:8443<br>
nanny[19614]: Terminating due to signal 15<br>
nanny[19617]: Terminating due to signal 15<br>
nanny[19622]: Terminating due to signal 15<br>
nanny[19644]: Terminating due to signal 15<br>
nanny[19645]: Terminating due to signal 15<br>
nanny[19647]: Terminating due to signal 15<br>
etc.<br>
<br>
Thanks,<br>
Dan<br>
<br>
<br>
<br>
Dan Yocum wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Hi Barry,<br>
<br>
We&#39;re on piranha-0.8.4-9.3.el5. =A0I will upgrade to release 11 and see=
 if that helps.<br>
<br>
Thanks,<br>
Dan<br>
<br>
<br>
Barry Brimer wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Quoting Dan Yocum &lt;<a href=3D"mailto:[email protected]" target=3D"_blank">y=
[email protected]</a>&gt;:<br>
<br>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Hi all,<br>
<br>
Here&#39;s the situation we&#39;re running into - after setting a real serv=
er to<br>
active =3D 0 and weight =3D 0 and reloading pulse, &lt;perform some work on=
 the<br>
RS&gt;, set active =3D 1 and weight =3D 3 and reloading pulse, lvsd first<b=
r>
creates the monitor for the process, which dies for some strange reason,<br=
>
then proceeds to shutdown *all* virtual services!!<br>
<br>
Here&#39;s what I see in /var/log/messages:<br>
</blockquote>
<br>
&lt;snip&gt;<br>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Performing a &#39;service pulse restart&#39; brings everything back online =
just<br>
fine.<br>
<br>
What&#39;s going on here?<br>
<br>
The OS is Scientific Linux 5.2 (i.e., RHELv5.2) on a Xen VM, kernel<br>
2.6.18-128.1.6.el5xen.<br>
</blockquote>
<br>
What version of piranha do you have installed? =A0The latest version seems =
to<br>
correct some nanny/pulse related issues<br>
&lt;<a href=3D"https://rhn.redhat.com/errata/RHBA-2009-0095.html" target=3D=
"_blank">https://rhn.redhat.com/errata/RHBA-2009-0095.html</a>&gt;<br>
<br>
Barry<br>
<br>
_______________________________________________<br>
Piranha-list mailing list<br>
<a href=3D"mailto:[email protected]" target=3D"_blank">Piranha-list@r=
edhat.com</a><br>
<a href=3D"https://www.redhat.com/mailman/listinfo/piranha-list" target=3D"=
_blank">https://www.redhat.com/mailman/listinfo/piranha-list</a><br>
</blockquote>
<br>
</blockquote>
<br>
-- <br>
Dan Yocum<br>
Fermilab =A0630.840.6509<br>
<a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]</a>, <a =
href=3D"http://fermigrid.fnal.gov" target=3D"_blank">http://fermigrid.fnal.=
gov</a><br>
Fermilab. =A0Just zeros and ones.<br>
<br>
<br>
<br>_______________________________________________<br>
Piranha-list mailing list<br>
<a href=3D"mailto:[email protected]">[email protected]</a><br>
<a href=3D"https://www.redhat.com/mailman/listinfo/piranha-list" target=3D"=
_blank">https://www.redhat.com/mailman/listinfo/piranha-list</a><br></block=
quote></div><br>

--0016364d2ab59c80cb046c192b37--


--===============1873036923==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Piranha-list mailing list
[email protected]
https://www.redhat.com/mailman/listinfo/piranha-list
--===============1873036923==--