Re: operational visibility
Glyph <[email protected]> Tue, 12 Nov 2019 08:52:40 -0800
| Newsgroups | gmane.comp.python.twisted |
|---|---|
| Message-ID | <[email protected]> |
--===============6523032452715681950== Content-Type: multipart/alternative; boundary="5dcae440_643c9869_591" --5dcae440_643c9869_591 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline On November 12, 2019 at 5:47:28 AM, Patrick Cloke (patrick=40cloke.us(mai= lto:patrick=40cloke.us)) wrote: > =20 > On 11/12/19 2:12 AM, Glyph wrote: > =20 > =20 > > At twistedmatrix.com(http://twistedmatrix.com), we dogfood a bunch of= Twisted software: our DNS server (primary and secondary=21), our web ser= ver, even a little bit of email stuff here and there. And we have our own= structured logging system to make it, ahem, =22easy=22 to put logs into = some kind of a system that can tell you what Twisted is doing. =20 > > =20 > > But uh=E2=80=A6 we don't get a lot of value from this because the tra= cebacks just go into disk files that nobody ever looks at. =20 > > =20 > > Does anyone know if, say, Sentry supports a free tier for open source= projects, or something like that=3F Or any other error-tracking provider= even vaguely compatible with Twisted might do something like that=3F It = would be nice to surface and fix tracebacks that affect our own infrastru= cture before they hit our users. > > =20 > > -g =20 > =20 > Hi Glyph, > =20 > =20 > Sentry has a free =22developer=22 tier which I'm sure you already found= =5B1=5D. It supports up to 5k events per month, the downside for using i= t for twistedmatrix.com might be that it only supports 1 team member. I d= on't recall hearing if they do any free plans for OSS, but from talking t= o a few of their early employees a while ago I wouldn't be surprised. It = could be worth integrating just to see if it gives you the sort of inform= ation you're looking for=3F Another option would be to self-host the Sent= ry OSS version, but I'm assuming the team wouldn't want to take on more o= ps stuff. > =20 > =20 > =20 > In terms of integration, note that the (new) Sentry Python library does= n't support using Twisted as a transport =5B2=5D (meaning you'd block the= reactor to report the issue), although their old one does =5B3=5D. Integ= rating Sentry+Twisted for the actual error reporting works fairly well vi= a the logging system and I've been doing it for a while with success (>5 = years). Although we sometimes get duplicate errors for an exception and u= nhandled errors in deferreds... it'd be great if the integration was a bi= t more plug and play. > =20 > =20 > Not sure if any of that was useful, but the short version is that I've = been super impressed with the Sentry integration, especially in multi-lan= guage environments. > =20 > =20 > =20 > --Patrick > =20 > =20 > =20 > =20 Thanks for the summary, Patrick. I also use Sentry at work (albeit via a = set of custom integrations that wouldn=E2=80=99t make sense for the way t= wistedmatrix.com is deployed) and I did know about the developer plan, bu= t I wouldn=E2=80=99t want to do a bunch of work just to sidestep their ru= les about accounts by sharing a credential or something and then get shut= off for it :). So I was hoping for something a little more official. > =20 > =5B1=5D https://sentry.io/pricing/ > =5B2=5D https://github.com/getsentry/sentry-python/issues/266 > =5B3=5D https://github.com/getsentry/raven-python/blob/master/raven/tra= nsport/twisted.py > =20 > =20 > =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F > Twisted-Python mailing list > Twisted-Python=40twistedmatrix.com > https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python --5dcae440_643c9869_591 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline <html><head></head><body><br> <p class=3D=22gmail=5Fquote=22 style=3D=22c= olor:=23000;=22>On November 12, 2019 at 5:47:28 AM, Patrick Cloke (<a hre= f=3D=22mailto:patrick=40cloke.us=22>patrick=40cloke.us</a>) wrote:</p> <b= lockquote type=3D=22cite=22 class=3D=22gmail=5Fquote=22><span><div><div><= /div><div> <title></title> <p>On 11/12/19 2:12 AM, Glyph wrote:<br></p> <blockquote type=3D=22cite=22 cite=3D=22mid:9A3E15D4-C9CE-4784-AB4=46-=46= 15DCD1C7754=40twistedmatrix.com=22> At <a href=3D=22http://twistedmatrix.com=22 class=3D=22=22 moz-do-not-sen= d=3D=22true=22>twistedmatrix.com</a>, we dogfood a bunch of Twisted software: our DNS server (primary and secondary=21), our web server, even a little bit of email stuff here and there. And we have our own structured logging system to make it, ahem, =22easy=22 to put logs into some kind of a system that can tell you what Twisted is doing. <div class=3D=22=22><br class=3D=22=22></div> <div class=3D=22=22>But uh=E2=80=A6 we don't get a lot of value from this= because the tracebacks just go into disk files that nobody ever looks at.</div> <div class=3D=22=22><br class=3D=22=22></div> <div class=3D=22=22>Does anyone know if, say, Sentry supports a free tier= for open source projects, or something like that=3F Or any other error-tracking provider even vaguely compatible with Twisted might do something like that=3F It would be nice to surface and fix tracebacks that affect our own infrastructure before they hit our users.<br class=3D=22=22> <div class=3D=22=22> <div class=3D=22=22> <div class=3D=22=22><br class=3D=22=22></div> <div class=3D=22=22>-g</div> </div> </div> </div> <br></blockquote> <p>Hi Glyph,</p> <p>Sentry has a free =22developer=22 tier which I'm sure you already found =5B1=5D. It supports up to 5k events per month, the downside for using it for twistedmatrix.com might be that it only supports 1 team member. I don't recall hearing if they do any free plans for OSS, but from talking to a few of their early employees a while ago I wouldn't be surprised. It could be worth integrating just to see if it gives you the sort of information you're looking for=3F Another option would be to self-host the Sentry OSS version, but I'm assuming the team wouldn't want to take on more ops stuff.<br></p> <p>In terms of integration, note that the (new) Sentry Python library doesn't support using Twisted as a transport =5B2=5D (meaning you'd block the reactor to report the issue), although their old one does =5B3=5D. Integrating Sentry+Twisted for the actual error reporting works fairly well via the logging system and I've been doing it for a while with success (>5 years). Although we sometimes get duplicate errors for an exception and unhandled errors in deferreds... it'd be great if the integration was a bit more plug and play.</p> <p>Not sure if any of that was useful, but the short version is that I've been super impressed with the Sentry integration, especially in multi-language environments.<br></p> <p>--Patrick<br></p> <p></p></div></div></span></blockquote><p>Thanks for the summary, Patrick= . I also use Sentry at work (albeit via a set of custom integrations that= wouldn=E2=80=99t make sense for the way twistedmatrix.com is deployed) a= nd I did know about the developer plan, but I wouldn=E2=80=99t want to do= a bunch of work just to sidestep their rules about accounts by sharing a= credential or something and then get shut off for it :). So I was = hoping for something a little more official.</p><blockquote type=3D=22cit= e=22 class=3D=22gmail=5Fquote=22><span><div><div><p>=5B1=5D <a class=3D=22= moz-txt-link-freetext=22 href=3D=22https://sentry.io/pricing/=22>https://= sentry.io/pricing/</a><br> =5B2=5D <a class=3D=22moz-txt-link-freetext=22 href=3D=22https://github.c= om/getsentry/sentry-python/issues/266=22>https://github.com/getsentry/sen= try-python/issues/266</a><br> =5B3=5D <a class=3D=22moz-txt-link-freetext=22 href=3D=22https://github.c= om/getsentry/raven-python/blob/master/raven/transport/twisted.py=22> https://github.com/getsentry/raven-python/blob/master/raven/transport/twi= sted.py</a><br> </p> =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F<br>Twi= sted-Python mailing list<br>Twisted-Python=40twistedmatrix.com<br>https:/= /twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python<br></div></div= ></span></blockquote> <br></body></html> --5dcae440_643c9869_591-- --===============6523032452715681950== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: inline X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KVHdpc3RlZC1Q eXRob24gbWFpbGluZyBsaXN0ClR3aXN0ZWQtUHl0aG9uQHR3aXN0ZWRtYXRyaXguY29tCmh0dHBz Oi8vdHdpc3RlZG1hdHJpeC5jb20vY2dpLWJpbi9tYWlsbWFuL2xpc3RpbmZvL3R3aXN0ZWQtcHl0 aG9uCg== --===============6523032452715681950==--