Re: AcoustID

Joseph Curtin <[email protected]> Mon, 18 May 2015 15:39:12 -0700
Newsgroups gmane.comp.audio.musicbrainz.devel
Message-ID <CALmWdSj6E9qf3rOfjqRWpY7n_PZX3VQPReH=6YAS2Sg-KCw3XA@mail.gmail.com>
--===============0260840940==
Content-Type: multipart/alternative; boundary=001a113f3b3eed762a051662dc02

--001a113f3b3eed762a051662dc02
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Having just sourced the database. As a user, it is possible to restore the
database using Ubuntu 14.04 and the postgresql-ppa.

Would you like me to document the process?

You're going to need at least one terabyte, maybe two. Its not a small db
at all.

All that being said about the current backup process; here is my
unsolicited opinion on a better backup process.

Setup a replication server for backups. Every nth hour, halt the
replication server,  tar the datadir, and then restart the replication
server. This might cost a pretty penny when it comes to hosting.
On May 18, 2015 3:15 PM, "Luk=C3=A1=C5=A1 Lalinsk=C3=BD" <[email protected]=
m> wrote:

> On Wed, May 13, 2015 at 3:29 AM, Andre Wiethoff <
> [email protected]> wrote:
>
>> If I understood correctly, the AcoustIDs itself are stored on
>> Acoustid.org server externally.
>> Are there any references from Musicbrainz tables (e.g. a GUID) to the
>> data on Acoustid.org, or are they link all from AcoustID.org back to
>> Musicbrainz (so that the AcoustId.org API need to be called in order to
>> display which fingerprints are assigned to a recording for display on
>> the Musicbrainz webpage)? I didn't found any reference for it in the
>> CreateTables.sql script...
>>
>
> I generate monthly data files with the MBID-AcoustID links, but
> unfortunately they are currently out of date:
>
> http://data.acoustid.org/fullexport/2015-03-01/
>
> (It turns out that generating database dumps that over 100GB compressed i=
s
> a fairly non-trivial task and
> I have been experiment with the best setup for me to do this.)
>
> Lukas
>
>
> _______________________________________________
> MusicBrainz-devel mailing list
> [email protected]
> http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-devel
>

--001a113f3b3eed762a051662dc02
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<p dir=3D"ltr">Having just sourced the database. As a user, it is possible =
to restore the database using Ubuntu 14.04 and the postgresql-ppa.</p>
<p dir=3D"ltr">Would you like me to document the process?</p>
<p dir=3D"ltr">You&#39;re going to need at least one terabyte, maybe two. I=
ts not a small db at all.</p>
<p dir=3D"ltr">All that being said about the current backup process; here i=
s my unsolicited opinion on a better backup process.</p>
<p dir=3D"ltr">Setup a replication server for backups. Every nth hour, halt=
 the replication server,=C2=A0 tar the datadir, and then restart the replic=
ation server. This might cost a pretty penny when it comes to hosting.</p>
<div class=3D"gmail_quote">On May 18, 2015 3:15 PM, &quot;Luk=C3=A1=C5=A1 L=
alinsk=C3=BD&quot; &lt;<a href=3D"mailto:[email protected]">lalinsky@gmail=
.com</a>&gt; wrote:<br type=3D"attribution"><blockquote class=3D"gmail_quot=
e" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">=
<div dir=3D"ltr"><div class=3D"gmail_extra"><div class=3D"gmail_quote">On W=
ed, May 13, 2015 at 3:29 AM, Andre Wiethoff <span dir=3D"ltr">&lt;<a href=
=3D"mailto:[email protected]" target=3D"_blank">brainworks@exact=
audiocopy.de</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" sty=
le=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(=
204,204,204);border-left-style:solid;padding-left:1ex">If I understood corr=
ectly, the AcoustIDs itself are stored on<br>
Acoustid.org server externally.<br>
Are there any references from Musicbrainz tables (e.g. a GUID) to the<br>
data on Acoustid.org, or are they link all from AcoustID.org back to<br>
Musicbrainz (so that the AcoustId.org API need to be called in order to<br>
display which fingerprints are assigned to a recording for display on<br>
the Musicbrainz webpage)? I didn&#39;t found any reference for it in the<br=
>
CreateTables.sql script...<br></blockquote><div><br></div><div>I generate m=
onthly data files with the MBID-AcoustID links, but unfortunately they are =
currently out of date:</div><div><br></div><div><a href=3D"http://data.acou=
stid.org/fullexport/2015-03-01/" target=3D"_blank">http://data.acoustid.org=
/fullexport/2015-03-01/</a><br></div><div><br></div><div>(It turns out that=
 generating database dumps that over 100GB compressed is a fairly non-trivi=
al task and</div><div>I have been experiment with the best setup for me to =
do this.)</div><div><br></div><div>Lukas</div><div><br></div></div></div></=
div>
<br>_______________________________________________<br>
MusicBrainz-devel mailing list<br>
<a href=3D"mailto:[email protected]">MusicBrainz-deve=
[email protected]</a><br>
<a href=3D"http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-devel"=
 target=3D"_blank">http://lists.musicbrainz.org/mailman/listinfo/musicbrain=
z-devel</a><br></blockquote></div>

--001a113f3b3eed762a051662dc02--


--===============0260840940==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
MusicBrainz-devel mailing list
[email protected]
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-devel
--===============0260840940==--