Re: stunnel-users Digest, Vol 182, Issue 14
"Eric Eberhard" <[email protected]> Fri, 27 Sep 2019 10:03:05 -0700
| Newsgroups | gmane.network.stunnel.user |
|---|---|
| Message-ID | <[email protected]> |
This is a multipart message in MIME format. --===============6515798941259900182== Content-Type: multipart/alternative; boundary="----=_NextPart_000_0CC4_01D5751A.C42E3620" Content-Language: en-us This is a multipart message in MIME format. ------=_NextPart_000_0CC4_01D5751A.C42E3620 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I don=E2=80=99t suggest it as a final solution =E2=80=93 although for me = it works great and we have customers exchanging 2-4 million XML = documents per day with no performance issues =E2=80=93 BUT no matter = what it is a good debugging tool. Inetd gets all the initial = connections and closes them when done. It might or might or might not = be involved with the HSM at all. =20 You might also look at the process table (some form of ps) and grep for = stunnel and relatives and see if they are hanging around. In theory, if = a process dies, it =E2=80=9Cshould=E2=80=9D close it=E2=80=99s = connections. If it is floating in space it will not. =20 Inetd will kill the process =E2=80=93 at least on Centos and AIX and SCO = =E2=80=93 for sure and for certain. =20 E =20 From: stunnel-users [mailto:[email protected]] On Behalf = Of Brent Kimberley Sent: Friday, September 27, 2019 7:29 AM To: [email protected]; [email protected] Subject: Re: [stunnel-users] stunnel-users Digest, Vol 182, Issue 14 =20 >> Over time, after numerous reloads of stunnel (kill -HUP) the HSM = reports that its connection table is full.=20 >> Logging from the engine shows that stunnel is never freeing the keys = and therefore the engine is not closing the associated sessions with the = HSM. Each stunnel reload opens 70 new sessions until eventually the = HSM's configured limit is exceeded. =20 Where does the signal dispatcher free keys on SIG_HUP? https://github.com/mtrojnar/stunnel/blob/master/src/stunnel.c =20 =20 Date: Fri, 27 Sep 2019 07:23:29 +0000 From: "Lynch, Andrew" <[email protected] = <mailto:[email protected]> > To: Eric Eberhard <[email protected] <mailto:[email protected]> > Cc: "[email protected] <mailto:[email protected]> " = <[email protected] <mailto:[email protected]> > Subject: Re: [stunnel-users] stunnel with OpenSSL engine: reload leaks = HSM connections =20 Hi Eric, =20 Thank you for your suggestion. It is certainly worth looking into, = although I suspect it may be impractical in our environment. =20 Now we have a single stunnel.conf with 70 services which would translate = into 70 additional entries in inetd.conf. Each of those entries then = needs to have its own reduced stunnel.conf so that it will only load the = cert and key for its endpoint. =20 The stunnel HOWTO recommends daemon mode over inetd mode due to the = overhead for forking and SSL initialization. We would have additional = overhead for engine init and HSM connection. =20 Regards, Andrew. =20 -----Original Message----- From: Eric Eberhard [mailto:[email protected] <mailto:[email protected]> = ]=20 Sent: Thursday, September 26, 2019 7:20 PM To: Lynch, Andrew; [email protected] = <mailto:[email protected]>=20 Subject: RE: [stunnel-users] stunnel with OpenSSL engine: reload leaks = HSM connections? =20 Try running in inetd mode -- even if you don't like this you will learn = something. Inetd will close connections as needed. E =20 -----Original Message----- From: stunnel-users [mailto:[email protected] = <mailto:[email protected]> ] On Behalf Of Lynch, Andrew Sent: Thursday, September 26, 2019 5:56 AM To: [email protected] <mailto:[email protected]>=20 Subject: [stunnel-users] stunnel with OpenSSL engine: reload leaks HSM = connections? =20 Hi, =20 We are using stunnel as a server to terminate incoming TLS connections. = The config has around 70 services with certificates whose EC private = keys are stored in an HSM and accessed using an OpenSSL engine. =20 Over time, after numerous reloads of stunnel (kill -HUP) the HSM reports = that its connection table is full. Logging from the engine shows that = stunnel is never freeing the keys and therefore the engine is not = closing the associated sessions with the HSM. Each stunnel reload opens = 70 new sessions until eventually the HSM's configured limit is exceeded. =20 This behaviour has been observed on Suse Enterprise Linux 12.3 with the = system-provided stunnel-5.00-4.3.4, but I can reproduce it with my own = build of the current version 5.55. =20 Is this a known issue? It appears that other (ephemeral) keys are being = freed, just not those associated with the service certificates. =20 Currently our workaround is to perform a full restart instead of a = reload. This closes all HSM sessions when the process terminates, but of course = it also kills any open client connections so it can only be done during = the scheduled maintenance windows. =20 Regards, Andrew. =20 _______________________________________________ stunnel-users mailing list [email protected] <mailto:[email protected]>=20 https://www.stunnel.org/cgi-bin/mailman/listinfo/stunnel-users =20 =20 =20 =20 ------------------------------ =20 Subject: Digest Footer =20 _______________________________________________ stunnel-users mailing list [email protected] <mailto:[email protected]>=20 https://www.stunnel.org/cgi-bin/mailman/listinfo/stunnel-users =20 =20 ------------------------------ =20 End of stunnel-users Digest, Vol 182, Issue 14 ********************************************** ------=_NextPart_000_0CC4_01D5751A.C42E3620 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta = http-equiv=3DContent-Type content=3D"text/html; charset=3Dutf-8"><meta = name=3DGenerator content=3D"Microsoft Word 15 (filtered = medium)"><style><!-- /* Font Definitions */ @font-face {font-family:Helvetica; panose-1:2 11 6 4 2 2 2 2 2 4;} @font-face {font-family:"Cambria Math"; panose-1:2 4 5 3 5 4 6 3 2 4;} @font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {margin:0in; margin-bottom:.0001pt; font-size:12.0pt; font-family:"Times New Roman",serif;} a:link, span.MsoHyperlink {mso-style-priority:99; color:blue; text-decoration:underline;} a:visited, span.MsoHyperlinkFollowed {mso-style-priority:99; color:purple; text-decoration:underline;} span.EmailStyle17 {mso-style-type:personal-reply; font-family:"Calibri",sans-serif; color:#1F497D;} .MsoChpDefault {mso-style-type:export-only; font-size:10.0pt;} @page WordSection1 {size:8.5in 11.0in; margin:1.0in 1.0in 1.0in 1.0in;} div.WordSection1 {page:WordSection1;} --></style><!--[if gte mso 9]><xml> <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" /> </xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext=3D"edit"> <o:idmap v:ext=3D"edit" data=3D"1" /> </o:shapelayout></xml><![endif]--></head><body lang=3DEN-US link=3Dblue = vlink=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal><span = style=3D'font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'= >I don=E2=80=99t suggest it as a final solution =E2=80=93 although for = me it works great and we have customers exchanging 2-4 million XML = documents per day with no performance issues =E2=80=93 BUT no matter = what it is a good debugging tool.=C2=A0 Inetd gets all the initial = connections and closes them when done.=C2=A0 It might or might or might = not be involved with the HSM at all.<o:p></o:p></span></p><p = class=3DMsoNormal><span = style=3D'font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'= ><o:p> </o:p></span></p><p class=3DMsoNormal><span = style=3D'font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'= >You might also look at the process table (some form of ps) and grep for = stunnel and relatives and see if they are hanging around.=C2=A0 In = theory, if a process dies, it =E2=80=9Cshould=E2=80=9D close = it=E2=80=99s connections.=C2=A0 If it is floating in space it will = not.<o:p></o:p></span></p><p class=3DMsoNormal><span = style=3D'font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'= ><o:p> </o:p></span></p><p class=3DMsoNormal><span = style=3D'font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'= >Inetd will kill the process =E2=80=93 at least on Centos and AIX and = SCO =E2=80=93 for sure and for certain.<o:p></o:p></span></p><p = class=3DMsoNormal><span = style=3D'font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'= ><o:p> </o:p></span></p><p class=3DMsoNormal><span = style=3D'font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'= >E<o:p></o:p></span></p><p class=3DMsoNormal><span = style=3D'font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'= ><o:p> </o:p></span></p><div><div = style=3D'border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in = 0in 0in'><p class=3DMsoNormal><b><span = style=3D'font-size:11.0pt;font-family:"Calibri",sans-serif'>From:</span><= /b><span style=3D'font-size:11.0pt;font-family:"Calibri",sans-serif'> = stunnel-users [mailto:[email protected]] <b>On Behalf Of = </b>Brent Kimberley<br><b>Sent:</b> Friday, September 27, 2019 7:29 = AM<br><b>To:</b> [email protected]; = [email protected]<br><b>Subject:</b> Re: [stunnel-users] = stunnel-users Digest, Vol 182, Issue = 14<o:p></o:p></span></p></div></div><p = class=3DMsoNormal><o:p> </o:p></p><div><div><p = class=3DMsoNormal><span = style=3D'font-family:"Helvetica",sans-serif'>>> <span = style=3D'color:#26282A'>Over time, after numerous reloads of stunnel = (kill -HUP) the HSM reports that its connection table is = full. </span><o:p></o:p></span></p></div><div><div><div><p = class=3DMsoNormal><span = style=3D'font-family:"Helvetica",sans-serif;color:#26282A'>>> = Logging from the engine shows that stunnel is never freeing the keys = and therefore the engine is not closing the associated sessions with the = HSM. Each stunnel reload opens 70 new sessions until eventually = the HSM's configured limit is = exceeded.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-family:"Helvetica",sans-serif;color:#26282A'><o:p> </o= :p></span></p></div></div><div><p class=3DMsoNormal><span = style=3D'font-family:"Helvetica",sans-serif;color:#26282A'>Where does = the signal dispatcher free keys on = SIG_HUP?<o:p></o:p></span></p></div></div><div><p = class=3DMsoNormal><span style=3D'font-family:"Helvetica",sans-serif'><a = href=3D"https://github.com/mtrojnar/stunnel/blob/master/src/stunnel.c" = target=3D"_blank">https://github.com/mtrojnar/stunnel/blob/master/src/stu= nnel.c</a><o:p></o:p></span></p></div><div><div><p = class=3DMsoNormal><span = style=3D'font-family:"Helvetica",sans-serif'><o:p> </o:p></span></p>= </div><div><p class=3DMsoNormal><span = style=3D'font-family:"Helvetica",sans-serif'><o:p> </o:p></span></p>= </div></div></div><div = id=3D"ydpaf216824yahoo_quoted_0356605184"><div><div><div><p = class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Date: Fri, 27 Sep 2019 07:23:29 = +0000<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>From: "Lynch, Andrew" <<a = href=3D"mailto:[email protected]" = target=3D"_blank">[email protected]</a>><o:p></o:p></span></p></di= v><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>To: Eric Eberhard <<a href=3D"mailto:[email protected]" = target=3D"_blank">[email protected]</a>><o:p></o:p></span></p></div><d= iv><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Cc: "<a href=3D"mailto:[email protected]" = target=3D"_blank">[email protected]</a>" <<a = href=3D"mailto:[email protected]" = target=3D"_blank">[email protected]</a>><o:p></o:p></span></p>= </div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Subject: Re: [stunnel-users] stunnel with OpenSSL engine: reload = leaks HSM connections<o:p></o:p></span></p></div><div><p = class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Hi Eric,<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Thank you for your suggestion. It is certainly worth looking = into, although I suspect it may be impractical in our = environment.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Now we have a single stunnel.conf with 70 services which would = translate into 70 additional entries in inetd.conf. Each of those = entries then needs to have its own reduced stunnel.conf so that it will = only load the cert and key for its = endpoint.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>The stunnel HOWTO recommends daemon mode over inetd mode due to the = overhead for forking and SSL initialization. We would have = additional overhead for engine init and HSM = connection.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Regards,<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Andrew.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>-----Original Message-----<o:p></o:p></span></p></div><div><p = class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>From: Eric Eberhard [mailto:<a href=3D"mailto:[email protected]" = target=3D"_blank">[email protected]</a>] = <o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Sent: Thursday, September 26, 2019 7:20 = PM<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>To: Lynch, Andrew; <a href=3D"mailto:[email protected]" = target=3D"_blank">[email protected]</a><o:p></o:p></span></p></di= v><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Subject: RE: [stunnel-users] stunnel with OpenSSL engine: reload = leaks HSM connections?<o:p></o:p></span></p></div><div><p = class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Try running in inetd mode -- even if you don't like this you will = learn something. Inetd will close connections as needed. = E<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>-----Original Message-----<o:p></o:p></span></p></div><div><p = class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>From: stunnel-users [mailto:<a = href=3D"mailto:[email protected]" = target=3D"_blank">[email protected]</a>] On Behalf Of = Lynch, Andrew<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Sent: Thursday, September 26, 2019 5:56 = AM<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>To: <a href=3D"mailto:[email protected]" = target=3D"_blank">[email protected]</a><o:p></o:p></span></p></di= v><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Subject: [stunnel-users] stunnel with OpenSSL engine: reload leaks = HSM connections?<o:p></o:p></span></p></div><div><p = class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Hi,<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>We are using stunnel as a server to terminate incoming TLS = connections. The config has around 70 services with certificates = whose EC private keys are stored in an HSM and accessed using an OpenSSL = engine.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Over time, after numerous reloads of stunnel (kill -HUP) the HSM = reports that its connection table is full. Logging from the engine = shows that stunnel is never freeing the keys and therefore the engine is = not closing the associated sessions with the HSM. Each stunnel = reload opens 70 new sessions until eventually the HSM's configured limit = is exceeded.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>This behaviour has been observed on Suse Enterprise Linux 12.3 with = the system-provided stunnel-5.00-4.3.4, but I can reproduce it with my = own build of the current version = 5.55.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Is this a known issue? It appears that other (ephemeral) keys = are being freed, just not those associated with the service = certificates.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Currently our workaround is to perform a full restart instead of a = reload.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>This closes all HSM sessions when the process terminates, but of = course it also kills any open client connections so it can only be done = during the scheduled maintenance = windows.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Regards,<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Andrew.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>_______________________________________________<o:p></o:p></span></p><= /div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>stunnel-users mailing list<o:p></o:p></span></p></div><div><p = class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><a href=3D"mailto:[email protected]" = target=3D"_blank">[email protected]</a><o:p></o:p></span></p></di= v><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><a = href=3D"https://www.stunnel.org/cgi-bin/mailman/listinfo/stunnel-users" = target=3D"_blank">https://www.stunnel.org/cgi-bin/mailman/listinfo/stunne= l-users</a><o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>------------------------------<o:p></o:p></span></p></div><div><p = class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>Subject: Digest Footer<o:p></o:p></span></p></div><div><p = class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>_______________________________________________<o:p></o:p></span></p><= /div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>stunnel-users mailing list<o:p></o:p></span></p></div><div><p = class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><a href=3D"mailto:[email protected]" = target=3D"_blank">[email protected]</a><o:p></o:p></span></p></di= v><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><a = href=3D"https://www.stunnel.org/cgi-bin/mailman/listinfo/stunnel-users" = target=3D"_blank">https://www.stunnel.org/cgi-bin/mailman/listinfo/stunne= l-users</a><o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>------------------------------<o:p></o:p></span></p></div><div><p = class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>End of stunnel-users Digest, Vol 182, Issue = 14<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span = style=3D'font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#26282= A'>**********************************************<o:p></o:p></span></p></= div></div></div></div></div></body></html> ------=_NextPart_000_0CC4_01D5751A.C42E3620-- --===============6515798941259900182== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ stunnel-users mailing list [email protected] https://www.stunnel.org/cgi-bin/mailman/listinfo/stunnel-users --===============6515798941259900182==--