Re: Data migration from ftp.mozilla.org to S3, 1pm Pacific Tuesday 20th October

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

An update on how this went. We are now transitioned to S3 storage for
firefox, mobile, and thunderbird. calendar will move over in the near
future. There was a long tree closure, sorry for the length of that.

The major issues still in play are:
* data synchronization to S3 is ongoing, and should be complete in the
next few days. There are gaps in firefox/nightly,
firefox/tinderbox-builds, and firefox/try-builds
* to reach older builds you can use
http://ftp-origin-scl3.mozilla.org/pub/mozilla.org/firefox/
* please don't get comfortable with that, we'll just be using
archive.mozilla.org soon
* we apologize for any inconvience this may cause you, it was not the
intention before the migration

* try builds will fail to upload (and run tests!) unless you push your
changes on top of recent tip of inbound, specifically
https://hg.mozilla.org/integration/mozilla-inbound/rev/0ee21e8d5ca6 or
later (bug 1216907)

* the hazard builds aren't uploading their analysis files (bug 1216859)

* spidermonkey builds and logs are invisible until bug 1216859 is comple
te

* if you open a raw log in treeherder it will download instead of
shown in a new tab. This is part of a wider problem with the
Content-Type header not being set (bug 1216804).



On 21/10/15 1:37 am, Nick Thomas wrote:
> Starting today at 1pm a subset of directories will be migrated
> from the FTP server to S3 - firefox, mobile, thunderbird, and
> calendar. The window for this work is two hours long, and the trees
> will stay open (unless things go very badly). This is part of a
> project lead by the Cloud Ops group, assisted by Release
> Engineering .
> 
> Things you should know * existing links to ftp.mozilla.org will 
> continue to work, although archive.mozilla.org is now considered 
> the canonical domain * while the data has been copied over, during 
> the cutover the most recent files may not available on the new 
> system. Synchronization will continue after the cutover to
> backfill them * treeherder will continue to show the results of
> jobs, but the logs may be affected by the previous point.
> Treeherder is designed to retrieve the log again when necessary *
> tests will continue to run because they use a separate storage
> system (except for mozilla-beta, mozilla-release and mozilla-esr38)
> * paths like firefox/tinderbox-builds/*/latest will stop being
> updated, and later will be removed (they were originally added for
> gaia-try, and that is now defunct) * in the near future directories
> like firefox/releases/latest/ will be emptied. README files with 
> alternative options will be provided
> 
> Please contact the sheriff, or #releng, if you want to bring any 
> issues to our attention. bug 1211732 is tracking bug.
> 
> Nick Thomas (Release Engineering)
> 

-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.17 (Darwin)
Comment: GPGTools - http://gpgtools.org

iQEcBAEBCgAGBQJWJ171AAoJENO8WgCvFBJMlt0H/0iS7kJAIdOxqZwjAFnweMaA
aXHVhtcB3GbPWiwd9Yfxy2Q/lV+zVF6mVUFpoRV5kHRGZzCp9IdcRaIyNJ8fVdmo
y9hUZk9qcwEkRyd5SI/AH5gpzOL79e1ubq9Vv2DYtnrLvBBohK2M7zZ1lT4N6PJv
sPzISzwlMj9Kz8CMQKfgngJPqzHbrzKTL/JsR9Oc2JKKgUjYA0RJYCX62+AIpzJp
AuslJ9wruNQRkukyZdsZKWANO4A/XDKx8OsIzl/w7UoAWmcpqWy/ZnFaNs/1N6hW
F5Xcj2ML9BDgm8D9xpDZoPWYbSsET2C/r6Engu1+gmVQWezCJqmjbjH5gj+TZJQ=
=KdrQ
-----END PGP SIGNATURE-----