Re: [specref] Downtime post-mortem

Tobie Langel <[email protected]> Fri, 04 Mar 2016 14:53:38 +0100
Newsgroups gmane.org.w3c.specifications
Message-ID <1457099618.1452058.539579538.334F0BAD@webmail.messagingengine.com>
As another mitigation strategy for such issues, I've given access to the
app to Dom, Shane and Marcos.

We should pretty much have all timezones covered with these three.

--tobie

On Fri, 4 Mar 2016, at 12:59, Tobie Langel wrote:
> Hi all,
> 
> Sorry Specref was down for a number of hours overnight as I deployed a
> buggy app refactor and failed to see that the app was crashing despite
> checking the logs.
> 
> Lessons learned:
> - the app needs tests, not only the data,
> - Papertrail logs don't differentiate enough failed and served requests,
> so check the app too,
> - Don't push code late a night.
> 
> Apologies,
> 
> --tobie