Re: Weird epoller bug

Robert DiFalco <[email protected]> Tue, 17 Dec 2019 11:19:42 -0800
Newsgroups gmane.comp.python.twisted
Message-ID <CAAXGW-x06MGZYMV8+JXZv-+AB97RdwPAeyhuYpgwGFm=xFVYPA@mail.gmail.com>
--===============7471068047942619152==
Content-Type: multipart/alternative; boundary="000000000000767a7c0599eb362d"

--000000000000767a7c0599eb362d
Content-Type: text/plain; charset="UTF-8"

I have a theory that since this runs every 20 seconds that it is falling
behind somehow. Ulimits is too low, twisted is maybe eating the too many
file handles exception and then trying to close a handle that doesn't
actually exist. Dunno.

On Tue, Dec 17, 2019 at 10:18 AM Robert DiFalco <[email protected]>
wrote:

> We recently switched from these versions and recently our TLS health check
> using treq seems to be using more and more file handles and getting this
> exception. Additionally our health check gets response time outs at a much
> higher frequency. Any tips on how I would go about debugging this? Or is
> this perhaps a known issue in one of the versions below and I need to
> either bump up or down a release version? Thanks!
>
> twisted 16.6.0 -> 19.19.0
> treq 15.1.0 -> 18.6.0
>
>   File
> "/home/foo/foo/local/lib/python2.7/site-packages/twisted/internet/epollreactor.py",
> line 183, in removeWriter
>     EPOLLOUT, EPOLLIN)
>   File
> "/home/foo/foo/local/lib/python2.7/site-packages/twisted/internet/epollreactor.py",
> line 160, in _remove
>     self._poller.unregister(fd)
> exceptions.IOError: [Errno 2] No such file or directory
>
>
>
>
>

--000000000000767a7c0599eb362d
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I have a theory that since this runs every 20 seconds that=
 it is falling behind somehow. Ulimits is too low, twisted is maybe eating =
the too many file handles exception and then trying to close a handle that =
doesn&#39;t actually exist. Dunno.</div><br><div class=3D"gmail_quote"><div=
 dir=3D"ltr" class=3D"gmail_attr">On Tue, Dec 17, 2019 at 10:18 AM Robert D=
iFalco &lt;<a href=3D"mailto:[email protected]">robert.difalco@gmail=
.com</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote" style=3D"mar=
gin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1=
ex"><div dir=3D"ltr">We recently switched from these versions and recently =
our TLS health check using treq seems to be using more and more file handle=
s and getting this exception. Additionally our health check gets response t=
ime outs at a much higher frequency. Any tips on how I would go about debug=
ging this? Or is this perhaps a known issue in one of the versions below an=
d I need to either bump up or down a release version? Thanks!<div><br></div=
><div>twisted 16.6.0 -&gt; 19.19.0</div><div>treq 15.1.0 -&gt; 18.6.0<div><=
div><br></div><div>=C2=A0 File &quot;/home/foo/foo/local/lib/python2.7/site=
-packages/twisted/internet/epollreactor.py&quot;, line 183, in removeWriter=
<br>=C2=A0 =C2=A0 EPOLLOUT, EPOLLIN)<br>=C2=A0 File &quot;/home/foo/foo/loc=
al/lib/python2.7/site-packages/twisted/internet/epollreactor.py&quot;, line=
 160, in _remove<br>=C2=A0 =C2=A0 self._poller.unregister(fd)<br>exceptions=
.IOError: [Errno 2] No such file or directory<br><br><br><table cellpadding=
=3D"0" style=3D"border-spacing:0px;line-height:20px;color:rgb(0,0,0);font-f=
amily:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px"><tbody>=
<tr><td colspan=3D"2" style=3D"vertical-align:top;width:auto;padding:2px 0p=
x"><span style=3D"vertical-align:top"><br><br></span></td></tr></tbody></ta=
ble></div></div></div></div>
</blockquote></div>

--000000000000767a7c0599eb362d--

--===============7471068047942619152==
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: base64
Content-Disposition: inline

X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KVHdpc3RlZC1Q
eXRob24gbWFpbGluZyBsaXN0ClR3aXN0ZWQtUHl0aG9uQHR3aXN0ZWRtYXRyaXguY29tCmh0dHBz
Oi8vdHdpc3RlZG1hdHJpeC5jb20vY2dpLWJpbi9tYWlsbWFuL2xpc3RpbmZvL3R3aXN0ZWQtcHl0
aG9uCg==

--===============7471068047942619152==--