Re: [specref] Downtime post-mortem

Shane McCarron <[email protected]> Fri, 4 Mar 2016 08:06:18 -0600
Newsgroups gmane.org.w3c.specifications
Message-ID <CAJdbnOBQ9NnkbJMBETpMfcEMHOwsW4ucdpm85gpw+U0URF7nsA@mail.gmail.com>
In particular since most of us never sleep.

On Fri, Mar 4, 2016 at 7:53 AM, Tobie Langel <[email protected]> wrote:

> As another mitigation strategy for such issues, I've given access to the
> app to Dom, Shane and Marcos.
>
> We should pretty much have all timezones covered with these three.
>
> --tobie
>
> On Fri, 4 Mar 2016, at 12:59, Tobie Langel wrote:
> > Hi all,
> >
> > Sorry Specref was down for a number of hours overnight as I deployed a
> > buggy app refactor and failed to see that the app was crashing despite
> > checking the logs.
> >
> > Lessons learned:
> > - the app needs tests, not only the data,
> > - Papertrail logs don't differentiate enough failed and served requests,
> > so check the app too,
> > - Don't push code late a night.
> >
> > Apologies,
> >
> > --tobie
>
>


-- 
Shane McCarron
Projects Manager, Spec-Ops