Re: Replacing ldirectord/heartbeat with LVS/piranha/pulse
Edward Croft <[email protected]> Tue, 10 Mar 2009 15:29:39 -0400
| Newsgroups | gmane.linux.redhat.piranha |
|---|---|
| Message-ID | <[email protected]> |
--===============1794500715==
Content-Type: multipart/related; boundary=0016364ee39eb5d80d0464c8c5cc
--0016364ee39eb5d80d0464c8c5cc
Content-Type: multipart/alternative; boundary=0016364ee39eb5d8080464c8c5cb
--0016364ee39eb5d8080464c8c5cb
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
I have my systems set up in simple failover. FW1 --> FW2, APP1 --> APP2 and
so forth. So at any time, I only have one active server running. If FW1
fails for whatever reason, FW2 is monitoring and takes control. It then
moves the shared external and shared internal addresses to itself. APP1 and
APP2 both use the internal shared address of the FW's for their gateway. The
app servers are doing basically the same except they only have a shared
internal address.
Here is a sample lvs.cf file. You would use the same file on both servers.
In this instance it is the firewall, so it manages two interfaces.
/etc/sysconfig/ha/lvs.cf
serial_no = 74
primary = FW1external (you would change this to your own external numbers
xx.xx.xx.xx)
service = fos
backup_active = 1
backup = FW2external
heartbeat = 1
heartbeat_port = 539
keepalive = 6
deadtime = 18
network = nat
reservation_conflict_action = preempt
debug_level = NONE
failover firewallext {
address = FWSharedExt eth0:1
vip_nmask = 255.255.255.192
active = 1
port = 80
timeout = 6
send = "GET / HTTP/1.0\r\n\r\n"
expect = "HTTP"
start_cmd = "/etc/rc.d/init.d/httpd start"
stop_cmd = "/etc/rc.d/init.d/httpd stop"
}
failover firewallint {
address = FWSharedInt eth1:2
vip_nmask = 255.255.255.0
active = 1
port = 80
timeout = 6
send = "GET / HTTP/1.0\r\n\r\n"
expect = "HTTP"
start_cmd = "/etc/init.d/httpd start"
stop_cmd = "/etc/init.d/httpd stop"
}
2009/3/9 Sean Drill <[email protected]>
> I am not sure if I am misreading this, but it appears that the FOS can
> only occur at the server level, and not at the node level
>
> What I am trying to configure is....
>
>
> Active LVS Server Backup LVS
> |
> |
> |-- VIP (HTTP)
> |
> |- Active HTTP
> |
> |- Backup HTTP
>
> In doing so I will have two layers of redundancy. The first layer will be
> if the LVS server hosting the VIP's fails, it will fail over to the backup
> LVS server. This functionality is default for LVS. However I also require
> redundancy at the node level. So if the active HTTP server fails, it moves
> to the backup HTTP server, without initiating a failover to the Backup LVS
> server.
>
> From what I am reading (I could be misreading) FOS occurs at the server
> level, and not at the node level. Basically I want all HTTP traffic to be
> handled by the Active HTTP server, and have the backup only take over if I
> choose to fail it over, or the active server fails on its own.
>
> Cheers
>
> - Sean
>
> ------------------------------
> *From:* [email protected] [mailto:
> [email protected]] *On Behalf Of *Edward Croft
> *Sent:* Tuesday, 10 March 2009 3:17 AM
> *To:* Piranha clustering/HA technology
> *Subject:* Re: Replacing ldirectord/heartbeat with LVS/piranha/pulse
>
> If you need to use scripting with FOS then you may need the patched version
> that Sebastion Bonnet put out.
>
>
> 2009/3/9 Mike Kemelmakher <[email protected]>
>
>> Hi Sean,
>> You can try to configure FOS ( fail-over service) mode which is
>> supported by piranha as well.
>>
>> Regards,
>> -Mike
>>
>> 2009/3/9 Sean Drill <[email protected]>
>>
>>> Hi there
>>>
>>> I have been having some issues implementing a new load balancing system,
>>> and was hoping someone could over some advice.
>>>
>>> Our current configuration is configured using ldirectord. The active node
>>> hosts all the virtual servers. Each virtual server will have an active real
>>> server, and a backup real server. All the traffic will be directed to the
>>> active real server, unless that server becomes unreachable, at which point
>>> all traffic will be directed to the backup server. In other words, a
>>> traditional real/fallback system.
>>>
>>> I am however only able to get piranha/lvs to do load sharing. In this
>>> case as long as both servers are set to UP, then traffic will be balanced
>>> between all servers (determined by load balancing scheme and weighting.)
>>> What I am attempting to do is create a virtual server in LVS, which has two
>>> active REAL servers, however direct traffic only to one of them, unless
>>> otherwise directed or if the active member fail, then direct traffic to the
>>> backup. I am basically trying to replicate the ldirectord/heartbeat
>>> system with piranha/lvs/pulse.
>>>
>>> Any directions which can be offered would be great appreciated.
>>> Regards,
>>> Sean
>>>
>>> Regards,
>>> Sean
>>> ____________________________________
>>>
>>> Sean Drill
>>> *Network Administrator - Network Services*
>>> [image: Westnet] <http://www.westnet.com.au/>
>>> *Westnet - Voted Number 1 ISP in Customer Satisfaction six years running
>>> *
>>>
>>> *Phone:* (08) 9218 2600 *Fax:* (08) 9218 2666
>>> Westnet Home <http://www.westnet.com.au/> | MyWestnet<http://www.mywestnet.com.au/>
>>> | Contact Us <http://www.westnet.com.au/contact/>
>>>
>>>
>>>
>>> _______________________________________________
>>> Piranha-list mailing list
>>> [email protected]
>>> https://www.redhat.com/mailman/listinfo/piranha-list
>>>
>>
>>
>> _______________________________________________
>> Piranha-list mailing list
>> [email protected]
>> https://www.redhat.com/mailman/listinfo/piranha-list
>>
>
>
>
> --
>
> Life's most urgent question is: what are you doing for others?
>
> -Martin Luther King Jr
>
> _______________________________________________
> Piranha-list mailing list
> [email protected]
> https://www.redhat.com/mailman/listinfo/piranha-list
>
--
Life's most urgent question is: what are you doing for others?
-Martin Luther King Jr
--0016364ee39eb5d8080464c8c5cb
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
I have my systems set up in simple failover. FW1 --> FW2, APP1 --> AP=
P2 and so forth. So at any time, I only have one active server running. If =
FW1 fails for whatever reason, FW2 is monitoring and takes control. It then=
moves the shared external and shared internal addresses to itself. APP1 an=
d APP2 both use the internal shared address of the FW's for their gatew=
ay. The app servers are doing basically the same except they only have a sh=
ared internal address. <br>
Here is a sample <a href=3D"http://lvs.cf">lvs.cf</a> file. You would use t=
he same file on both servers. In this instance it is the firewall, so it ma=
nages two interfaces.<br><br>/etc/sysconfig/ha/<a href=3D"http://lvs.cf">lv=
s.cf</a><br>
serial_no =3D 74<br>primary =3D FW1external (you would change this to your =
own external numbers xx.xx.xx.xx)<br>service =3D fos<br>backup_active =3D 1=
<br>backup =3D FW2external <br>heartbeat =3D 1<br>heartbeat_port =3D 539<br=
>keepalive =3D 6<br>
deadtime =3D 18<br>network =3D nat<br>reservation_conflict_action =3D preem=
pt<br>debug_level =3D NONE<br>failover firewallext {<br>=A0=A0=A0=A0 addres=
s =3D FWSharedExt eth0:1<br>=A0=A0=A0=A0 vip_nmask =3D 255.255.255.192<br>=
=A0=A0=A0=A0 active =3D 1<br>=A0=A0=A0=A0 port =3D 80<br>
=A0=A0=A0=A0 timeout =3D 6<br>=A0=A0=A0=A0 send =3D "GET / HTTP/1.0\r\=
n\r\n"<br>=A0=A0=A0=A0 expect =3D "HTTP"<br>=A0=A0=A0=A0 sta=
rt_cmd =3D "/etc/rc.d/init.d/httpd start"<br>=A0=A0=A0=A0 stop_cm=
d =3D "/etc/rc.d/init.d/httpd stop"<br>
}<br><br>failover firewallint {<br>=A0=A0=A0=A0 address =3D FWSharedInt eth=
1:2<br>=A0=A0=A0=A0 vip_nmask =3D 255.255.255.0<br>=A0=A0=A0=A0 active =3D =
1<br>=A0=A0=A0=A0 port =3D 80<br>=A0=A0=A0=A0 timeout =3D 6<br>=A0=A0=A0=A0=
send =3D "GET / HTTP/1.0\r\n\r\n"<br>=A0=A0=A0=A0 expect =3D &qu=
ot;HTTP"<br>
=A0=A0=A0=A0 start_cmd =3D "/etc/init.d/httpd start"<br>=A0=A0=A0=
=A0 stop_cmd =3D "/etc/init.d/httpd stop"<br>}<br><br><br><br><br=
><div class=3D"gmail_quote">2009/3/9 Sean Drill <span dir=3D"ltr"><<a hr=
ef=3D"mailto:[email protected]">[email protected].=
au</a>></span><br>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2">I a=
m not sure if I am misreading this, but it appears that the FOS can=20
only occur at the server level, and not at the node level</font></span></di=
v>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2"></f=
ont></span>=A0</div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2">Wha=
t I am trying to configure is....</font></span></div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2"></f=
ont></span>=A0</div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2"></f=
ont></span>=A0</div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2">Act=
ive LVS=20
Server=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 Backup=20
LVS</font></span></div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2">|</=
font></span></div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2">|</=
font></span></div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2">|--=
VIP (HTTP)</font></span></div>
<div dir=3D"ltr" align=3D"left"><span>=A0=A0=A0=A0=A0=A0=A0 <font face=3D"V=
erdana" size=3D"2">|</font></span></div>
<div dir=3D"ltr" align=3D"left"><span>=A0=A0=A0=A0=A0=A0=A0 <font face=3D"V=
erdana" size=3D"2">|- Active HTTP</font></span></div>
<div dir=3D"ltr" align=3D"left"><span>=A0=A0=A0=A0=A0=A0=A0 <font face=3D"V=
erdana" size=3D"2">|</font></span></div>
<div dir=3D"ltr" align=3D"left"><span>=A0=A0=A0=A0=A0=A0=A0 <font face=3D"V=
erdana" size=3D"2">|- Backup HTTP</font></span></div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2"></f=
ont></span>=A0</div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2">In =
doing so I will have two layers of redundancy. The first layer will be=20
if the LVS server hosting the VIP's fails, it will fail over to the bac=
kup LVS=20
server. This functionality is default for LVS. However I also require redun=
dancy=20
at the node level. So if the active HTTP server fails, it moves to the back=
up=20
HTTP server, without initiating a failover to the Backup LVS=20
server.</font></span></div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2"></f=
ont></span>=A0</div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2">Fro=
m what I am reading (I could be misreading) FOS occurs at the server=20
level, and not at the node level. Basically I want all HTTP traffic to be=
=20
handled by the Active HTTP server, and have the backup only take over if I=
=20
choose to fail it over, or the active server fails on its=20
own.</font></span></div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2"></f=
ont></span>=A0</div>
<div dir=3D"ltr" align=3D"left"><span></span><span></span><span><font face=
=3D"Verdana" size=3D"2">Cheers</font></span></div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2"></f=
ont></span>=A0</div>
<div dir=3D"ltr" align=3D"left"><span><font face=3D"Verdana" size=3D"2">- S=
ean</font></span></div><br>
<div dir=3D"ltr" align=3D"left" lang=3D"en-us">
<hr>
<font face=3D"Tahoma" size=3D"2"><b>From:</b> <a href=3D"mailto:piranha-lis=
[email protected]" target=3D"_blank">[email protected]</a>=
=20
[mailto:<a href=3D"mailto:[email protected]" target=3D"_blank=
">[email protected]</a>] <b>On Behalf Of </b>Edward=20
Croft<br><b>Sent:</b> Tuesday, 10 March 2009 3:17 AM<br><b>To:</b> Piranha=
=20
clustering/HA technology<br><b>Subject:</b> Re: Replacing ldirectord/heartb=
eat=20
with LVS/piranha/pulse<br></font><br></div><div><div></div><div class=3D"h5=
">
<div></div>If you need to use scripting with FOS then you may need the patc=
hed=20
version that Sebastion Bonnet put out. <br><br><br>
<div class=3D"gmail_quote">2009/3/9 Mike Kemelmakher <span dir=3D"ltr"><=
<a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]</a>>=
;</span><br>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div dir=3D"ltr">Hi Sean,=A0
<div><br></div>
<div>You can try to configure FOS =A0( fail-over service) =A0mode which=
=20
is supported by piranha as well.=A0</div>
<div><br></div>
<div>Regards,=A0</div>
<div>-Mike=A0<br>
<div><br>
<div class=3D"gmail_quote">2009/3/9 Sean Drill <span dir=3D"ltr"><<a h=
ref=3D"mailto:[email protected]" target=3D"_blank">sean.drill=
@staff.westnet.com.au</a>></span><br>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204=
, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div>
<div></div>
<div>
<div>
<div><font face=3D"Verdana" size=3D"2">
<div>
<p><span><font face=3D"Verdana" size=3D"2">Hi there</font></span></p>
<p><span><font face=3D"Verdana" size=3D"2">I have been having some issu=
es=20
implementing a new load balancing system, and was hoping someone could =
over=20
some advice.</font></span></p>
<p><font face=3D"Verdana"><font size=3D"2">Our current configuration is=
configured=20
using ldirectord. The active node hosts all the virtual servers. Each=
=20
virtual server will have an active real server, and a backup real serve=
r.=20
All the traffic will be directed to the active real server, unless that=
=20
server becomes unreachable, at which point all traffic will be directed=
to=20
the backup server.<span> In other words, a traditional real/fallback=20
system.</span></font></font></p>
<p><font face=3D"Verdana"><font size=3D"2">I am however only able to ge=
t piranha/lvs=20
to do load sharing. In this case as long as both servers are set to UP,=
then=20
traffic will be balanced between all servers (determined by load balanc=
ing=20
scheme and weighting.) What I am attempting to do is create a virtual s=
erver=20
in LVS, which has two active REAL servers, however direct traffic only =
to=20
one of them, unless otherwise directed or if the active member fail, th=
en=20
direct traffic to the backup.<span> I am basically trying to replicate =
the=20
ldirectord/heartbeat system with piranha/lvs/pulse.</span></font></font=
></p>
<p><font face=3D"Verdana"><font size=3D"2"><span>Any directions which c=
an be offered=20
would be great appreciated.</span></font></font></p></div>
<div align=3D"left"><font face=3D"Verdana," size=3D"2">Regards,<br>Sean=
<br></font></div></font></div>
<div><font face=3D"Verdana" size=3D"2"></font>=A0</div>
<div align=3D"left"><font face=3D"Verdana," size=3D"2">Regards,<br>Sean=
<br><font color=3D"#cccccc">____________________________________</font><br>=
<br>Sean=A0Drill<br><i>Network=20
Administrator - Network Services</i><br><a href=3D"http://www.westnet.c=
om.au/" target=3D"_blank"><img alt=3D"Westnet" src=3D"cid:109480602@1003200=
9-0FAB" align=3D"baseline" border=3D"0" hspace=3D"0" vspace=3D"8"></a><br><=
b><font size=3D"1">Westnet - Voted=20
Number 1 ISP in Customer Satisfaction=A0six years=20
running</font></b><br><br><font size=3D"1"><b>Phone:</b> (08) 9218=20
2600=A0=A0=A0=A0<b>Fax:</b> (08) 9218 2666<br><font face=3D"Verdana," s=
ize=3D"2"><font size=3D"1"><a href=3D"http://www.westnet.com.au/" target=3D=
"_blank">Westnet Home</a>=A0 | =A0<a href=3D"http://www.mywestnet.com.au/" =
target=3D"_blank">MyWestnet</a>=A0 |=20
=A0<a href=3D"http://www.westnet.com.au/contact/" target=3D"_blank">Con=
tact=20
Us</a></font></font><br><br></font></font></div>
<div>=A0</div></div><br></div></div>___________________________________=
____________<br>Piranha-list=20
mailing list<br><a href=3D"mailto:[email protected]" target=3D"_b=
lank">[email protected]</a><br><a href=3D"https://www.redhat.com/mail=
man/listinfo/piranha-list" target=3D"_blank">https://www.redhat.com/mailman=
/listinfo/piranha-list</a><br>
</blockquote></div><br></div></div></div><br>______________________________=
_________________<br>Piranha-list=20
mailing list<br><a href=3D"mailto:[email protected]" target=3D"_bla=
nk">[email protected]</a><br><a href=3D"https://www.redhat.com/mailma=
n/listinfo/piranha-list" target=3D"_blank">https://www.redhat.com/mailman/l=
istinfo/piranha-list</a><br>
</blockquote></div><br><br clear=3D"all"><br>-- <br><br>Life's most urg=
ent question is: what are you doing for=20
others?<br><br>-Martin Luther King Jr<br></div></div></div>
<br>_______________________________________________<br>
Piranha-list mailing list<br>
<a href=3D"mailto:[email protected]">[email protected]</a><br>
<a href=3D"https://www.redhat.com/mailman/listinfo/piranha-list" target=3D"=
_blank">https://www.redhat.com/mailman/listinfo/piranha-list</a><br></block=
quote></div><br><br clear=3D"all"><br>-- <br><br>Life's most urgent que=
stion is: what are you doing for others?<br>
<br>-Martin Luther King Jr<br>
--0016364ee39eb5d8080464c8c5cb--
--0016364ee39eb5d80d0464c8c5cc
Content-Type: image/gif; name="att3d006.gif"
Content-Transfer-Encoding: base64
Content-ID: <109480602@10032009-0FAB>
X-Attachment-Id: 0.0.1
R0lGODlhwAA0ANUAACRSlRZHjwk8iICawvf5+1V4reLp8TNenUNrpPz9/mqJt5Opy/L1+dTd6qO2
02i6LwGsxuzw9rDA2crV5rrI3ukwjcHO4dnl7+47GeypAbzHCgKO1PaHEPHRdPjpvQSghPv89erk
lo7MZPRpaSux1W1ZprDj6/q6sm7H3fnz1rDclELA143X6f3q3/alzfzT4M7qvf728fSJuPP56un1
4PmvXsrTNz22ofzt8/eVLPK4LM/H4piJwAA1hAA2hP///yH5BAAAAAAALAAAAADAADQAAAb/wJ9w
SCwaj8ikcslsOp/QqHCyKAACvmwvKwggFJKIdEwum8/otGFxyLrf8GxAYUnb7/i8fmgYBLZxW4CA
bj09CBR7iouMjAkLWG8CAj5dBwUKAwMKCJSEWwUXjaOkpU8NCD6EAAsXBg0XYkYGDp1acgtPBA1N
BgxKDbKmw4wSf4ZZoVANCpFuCr/AAwcB0Ue0BQIOSQZdCgnE4XiPtz4BuWMGzYQIBEqRPXVIqVsK
SQ7JpuDiQwn7ZQ0AqBJwYIAwMn3a+EDw70iqLAOQdEMGwN0RBVu2NZowoIA1YgkmKCjQ8EkMDzGE
MGgw4UJJMwQmWIhGwIQJi0MGqPJxAImE/0I+eBkhIFCAqEUEbAH4aMoAgi0AXjapwSFHi1IXSGzY
gKKIhZ0CDFwEiq7IhCw9GTGg5KOiuAZuDkhdEoOD3RweRhnYupVEEaJuNBIBPAjBkQX1GjGI5DZc
A09ypdS1W/Xqogha+XYtUuCZkbNwAhwU8tSHBMWMcQ57vCVyFBBUKVtVlCAz36NE8GVZWmRBMgCC
ThOJ8CeAWCMJVCuJIHPCaCEEGDeJcKGBgblDlRe5wDatFA+U76bUg4Lv1s1FurmZUOQhhc5Z7BGR
sMUwEQa1AOgv4ED7lALOBFCABPtEMJIAWwhQwIJCEcERAgFQEgAACjRoRAPT6HeAAuwRYf9AAQ9V
smABzy3RQXgc1IAdGSaYtwEJ/v2gkA9l/UBcJQz4hlZDCkBERAMHEKIFAscRsQBbOwFygFjq7VSI
PFN0IqQbAgjXG5Kq9CBAREPABZQbRT4BXngd4NGieSSUKMQAgNgnxE88/XABWA0moBCUF8AzIYJo
fQTnQFcAAoAYBjgjpDwMDIClflgKAKUQOkIlECBc/uBlloWE+UQLsVW1YhTlaRajEF+pItoQPfoQ
kZ3IlAVXD9UMEaICF+xCj6pDEDCjAr5EQIECAiTyAwEWSOBJABJQQIEsiMnBIQMEXMAmIAUQwR0X
DkSAXyQCCMUABUeqAoCyFIwqBA4yyPD/Ag5FtNBBDXndwQALKLCA2w8JpOBBBykMwQBwWwjHag/C
YpQPpAf/UGqcQ9zYlkVnGVLtdg0lEIl3OQlSKao7NfZDj1vU2GwPGzeJ8RIyVKByBTK4YBkpMaTQ
QQc6ZGBzmUN0Zoh8rJ36AwXIxPoDfGVhZIiVQqQaD6meLbHYbsr5tsXGQrDWVjTEbRGAak+39Y/V
rjExwspkj+DCC4qAsG8NNdvsdgY4C+GAkuBI7WbWWyTSdYdEJTja3CFPsVMADqy4GFTK6eRjesfw
9vNOExPxUFhd8hn2Ei6QrXkFZrObhto0vy26zf0OcW0WvMC3MT0k/4y4ENdqOeKIt8r3/y8hB7SC
RNceIzz1LI1HoxNUsy8IXBZQPrbjE5lvrrm6Z3jQ9uhv61A6EUFmlADAj+oYp+KRL3zLIG5Ejo+Q
Cgp73x8PF6E4rozvFk2qQJGfhZVgf1rECyk7T7YLZggB9dymgw7EywhsUkUBQCO0qvEpLE/pgWDg
lKBKVIISk1hIbrAwJQTci3dRyxLVflAocUUDPlywIAYtKBiwmQsJCeDf2JwngzOkIAQzy2EIPHC9
GcCABl5xA4UkVgQ77cQPlcDNT1pjgCY68YmjWUOQMGWOBoHQfVoYYaEM4TidqeqJYPRF5ZZXhgTg
4AUuSOPZGEEDFYjgAXBUwfqopIoaJf8NLGR0nSHcpAsJZCNLh9jH4XrQux8g5neMg8oJ2WLHJLiw
CSZYgSRRUC+baGsUIICBG+HIyQeIgDNT6hARKBAH+VRtcEw5BciSqJLUYFEVWuSg4xLoA1MuQXk8
0d8PWACBXvryl5NkgQlqZQcfqqCTyPRkEebmpELaiINuQBphCGaG7PlAWIdrn5GOCDz5CQFou9El
Lg/wQtj98pzohAAJVoCCm4whkyJ4YzI7KQIg/sgTCQMlIChHhPfxMQlziaAPOnTFflIKeIpUyfF8
IBhgdOcJvEynRH15rya0UZ7z7KQKQICcGUkQCd7TYBGUh0gHVQhVBdCUseRAk0j4bAj/3oulCWEK
iAA8algOsKV6CFlOPqCABBM9JwlY0FMhzOCYGaUnDDiKhOFVwkL35KYRpJYFBEhgAuB6CEkeZw7+
UCCnSNoYCheIk2nBz0OMsYauqDQACkxAAgMAmJWMWI8GFFUIBmABCyS5AhL4dZ0rEKaakoDUjIpA
BTCYgRBa8AKmFoGUXJyLEVVx05y9wRDIqOovFDclN7TDQUgSAAA6FCmZXs1aAgkEIGq0RC4AQFNG
uOEOFUuE5BBAlwCFQTx3qwIV0MCeQjjBCDCAgRMcwWEjJILBDpDKnLAPs2hZQDQS4ACP7lMB2qFA
ag0hrPdp0Q0NrJrOBiG7yjpgoT2A/20RQqCB9mrABh0IwfVGEQPhEpe4xr3IAESJBAsMqLkeWsBI
MLEAC2iHABJQwAEWjIAFQPU+cMWEUBqwAAcsgL8qsbADCncEjoxIAQ6o6HAc0BEFDNaoNnCvim2w
Q8fqIQEnuO99R/AyfiThtjZmBAg6oOIew9cDLk6DfWVM3Brn+MjiCEGKe9zjDsAAt0p4wXCJjIER
BBnJWB4GDZTM5BVfGQoxmDKRR5DfLJuZHyDQVwjWvGYYpODLToAxlatc5r/cNQoMgLKlGnnmOxBg
BycuQw3GfALLPCcpBk7EBJZkBwQkdxZ1WAAAkOArJ7BkGASgAICRwIMSlABpdsDBCf9O8AIP/MME
N/gAeqATAJlEpQHGGZZ28pyr+/hjPnyrbW96Ut2/yG3SRaC1EPaBiWFrpyEEOPBg/oHjYa8k1k/o
tKd5oF4zpfoDH7jBX0bbI4PUgQIIOEBD2YCAYIAoFxMoQO4+29YBbIPcTUQAAgSTgE5sWEAHsEAC
OEEkYFUqAdMgklPmTRwANMACCxZMBJRRgAZQYMFIG4C8DSzxA5xmAeGmwCMKohNbMsEAng75DhTB
ABRg++SjIUqxAIAbBISiSBHQRgMYwAljOSUUMZcAUZxyYQFMYOYLcoAAhDENWthUwQqzAAAGYIwi
GcA0DUjAgowVgS8wwOWu4EMARDH/rg1lfQgycbkxKFyNg6v7McuyQKujYABpe3oBd4bkybF9A9gS
xdX/cIAXRLnvORjgAF84ACrQMRIHVKvBHRk2AL7gQZgaptcSeK28A9BWYEMHQAMwwOIVrA576B0B
oiwU1y2g94Y3TN0U6nU3LKDgBU/ALQEJ9BH+7PaGoiEB174BCkQMndEqvQgG6h2QOFGpBjsQAKdp
MBsUj45/YPwHva4F0gtQ+c9QKHc545KBtobXrf8A+SRU9xCEToCOSKAn3DkSAyL/+l/AetNMiMAO
duC5O8wgFnBmtQVgLZhMyLtA1McKxtARgycr3Jc7xLEg4LJ0KTUExkJ6k1ZdAwgA8A7wGILxIXF1
bx3RB6+1CSCyD0QReMwwDZEDawrGdFtyCXnCCRwSK4XCZ+KQbFCQAMvyM/gzANLVDxTAdN/EdMSC
GzJBKrxwARUmBnClcfORdiSUCOAiDxRgJQjWVj2ocQQQYtKSg3ywAAsgBhwBdw6yAIlwXjjofhWW
AL6yDxNge2QgAY7Ge7uThpxwAPvhhn1Wh0ZwXsOQKgLQYBPgH74icakVBzBoh4Q4Bd9gClUYiG3x
BVooYNQAB0JCgXFXiJSIFNUVB4EQB+IGf5XYicOQAKx3AGyRWZpIB3rmiajYCAnQAHDFb/L2Be4W
dWUQBAA7
--0016364ee39eb5d80d0464c8c5cc--
--===============1794500715==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
Piranha-list mailing list
[email protected]
https://www.redhat.com/mailman/listinfo/piranha-list
--===============1794500715==--