Re: AcoustID
Joseph Curtin <[email protected]> Mon, 18 May 2015 15:39:12 -0700
| Newsgroups | gmane.comp.audio.musicbrainz.devel |
|---|---|
| Message-ID | <CALmWdSj6E9qf3rOfjqRWpY7n_PZX3VQPReH=6YAS2Sg-KCw3XA@mail.gmail.com> |
--===============0260840940== Content-Type: multipart/alternative; boundary=001a113f3b3eed762a051662dc02 --001a113f3b3eed762a051662dc02 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Having just sourced the database. As a user, it is possible to restore the database using Ubuntu 14.04 and the postgresql-ppa. Would you like me to document the process? You're going to need at least one terabyte, maybe two. Its not a small db at all. All that being said about the current backup process; here is my unsolicited opinion on a better backup process. Setup a replication server for backups. Every nth hour, halt the replication server, tar the datadir, and then restart the replication server. This might cost a pretty penny when it comes to hosting. On May 18, 2015 3:15 PM, "Luk=C3=A1=C5=A1 Lalinsk=C3=BD" <[email protected]= m> wrote: > On Wed, May 13, 2015 at 3:29 AM, Andre Wiethoff < > [email protected]> wrote: > >> If I understood correctly, the AcoustIDs itself are stored on >> Acoustid.org server externally. >> Are there any references from Musicbrainz tables (e.g. a GUID) to the >> data on Acoustid.org, or are they link all from AcoustID.org back to >> Musicbrainz (so that the AcoustId.org API need to be called in order to >> display which fingerprints are assigned to a recording for display on >> the Musicbrainz webpage)? I didn't found any reference for it in the >> CreateTables.sql script... >> > > I generate monthly data files with the MBID-AcoustID links, but > unfortunately they are currently out of date: > > http://data.acoustid.org/fullexport/2015-03-01/ > > (It turns out that generating database dumps that over 100GB compressed i= s > a fairly non-trivial task and > I have been experiment with the best setup for me to do this.) > > Lukas > > > _______________________________________________ > MusicBrainz-devel mailing list > [email protected] > http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-devel > --001a113f3b3eed762a051662dc02 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <p dir=3D"ltr">Having just sourced the database. As a user, it is possible = to restore the database using Ubuntu 14.04 and the postgresql-ppa.</p> <p dir=3D"ltr">Would you like me to document the process?</p> <p dir=3D"ltr">You're going to need at least one terabyte, maybe two. I= ts not a small db at all.</p> <p dir=3D"ltr">All that being said about the current backup process; here i= s my unsolicited opinion on a better backup process.</p> <p dir=3D"ltr">Setup a replication server for backups. Every nth hour, halt= the replication server,=C2=A0 tar the datadir, and then restart the replic= ation server. This might cost a pretty penny when it comes to hosting.</p> <div class=3D"gmail_quote">On May 18, 2015 3:15 PM, "Luk=C3=A1=C5=A1 L= alinsk=C3=BD" <<a href=3D"mailto:[email protected]">lalinsky@gmail= .com</a>> wrote:<br type=3D"attribution"><blockquote class=3D"gmail_quot= e" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">= <div dir=3D"ltr"><div class=3D"gmail_extra"><div class=3D"gmail_quote">On W= ed, May 13, 2015 at 3:29 AM, Andre Wiethoff <span dir=3D"ltr"><<a href= =3D"mailto:[email protected]" target=3D"_blank">brainworks@exact= audiocopy.de</a>></span> wrote:<br><blockquote class=3D"gmail_quote" sty= le=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(= 204,204,204);border-left-style:solid;padding-left:1ex">If I understood corr= ectly, the AcoustIDs itself are stored on<br> Acoustid.org server externally.<br> Are there any references from Musicbrainz tables (e.g. a GUID) to the<br> data on Acoustid.org, or are they link all from AcoustID.org back to<br> Musicbrainz (so that the AcoustId.org API need to be called in order to<br> display which fingerprints are assigned to a recording for display on<br> the Musicbrainz webpage)? I didn't found any reference for it in the<br= > CreateTables.sql script...<br></blockquote><div><br></div><div>I generate m= onthly data files with the MBID-AcoustID links, but unfortunately they are = currently out of date:</div><div><br></div><div><a href=3D"http://data.acou= stid.org/fullexport/2015-03-01/" target=3D"_blank">http://data.acoustid.org= /fullexport/2015-03-01/</a><br></div><div><br></div><div>(It turns out that= generating database dumps that over 100GB compressed is a fairly non-trivi= al task and</div><div>I have been experiment with the best setup for me to = do this.)</div><div><br></div><div>Lukas</div><div><br></div></div></div></= div> <br>_______________________________________________<br> MusicBrainz-devel mailing list<br> <a href=3D"mailto:[email protected]">MusicBrainz-deve= [email protected]</a><br> <a href=3D"http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-devel"= target=3D"_blank">http://lists.musicbrainz.org/mailman/listinfo/musicbrain= z-devel</a><br></blockquote></div> --001a113f3b3eed762a051662dc02-- --===============0260840940== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ MusicBrainz-devel mailing list [email protected] http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-devel --===============0260840940==--