Re: AcoustID

Lukáš Lalinský <[email protected]> Mon, 18 May 2015 16:13:18 -0700
Newsgroups gmane.comp.audio.musicbrainz.devel
Message-ID <CAGUtLj_cOaBKY-dfbbZbVcCAXaOh-ezw8H9d3q3YkjmMZ_G3dA@mail.gmail.com>
--===============2134712406==
Content-Type: multipart/alternative; boundary=001a11c2be96d1a61105166358fb

--001a11c2be96d1a61105166358fb
Content-Type: text/plain; charset=UTF-8

On Mon, May 18, 2015 at 3:39 PM, Joseph Curtin <[email protected]>
wrote:

> Having just sourced the database. As a user, it is possible to restore the
> database using Ubuntu 14.04 and the postgresql-ppa.
>
> Would you like me to document the process?
>

Definitely. I'd also welcome any patches/ideas on how to make the process
easier. My goal so far was only to run the data on acoustid.org. Running a
mirror was not my priority, because you need fairly expensive hardware to
do it right, so not many people would actually do that anyway.


> Setup a replication server for backups. Every nth hour, halt the
> replication server,  tar the datadir, and then restart the replication
> server. This might cost a pretty penny when it comes to hosting.
>

I actually already have a replicated server just for the data export. I
currently do it while the replication is running, which is often causing
problems, due to PostgreSQL running out of transactions (the export is one
giant day-long serialized transaction). I have actually just moved the
server to a completely separate one with the intention to stop replication
during the process, but I need to figure out how to handle that with regard
to monitoring and things like that.

Lukas

--001a11c2be96d1a61105166358fb
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_extra"><div class=3D"gmail_quote">On M=
on, May 18, 2015 at 3:39 PM, Joseph Curtin <span dir=3D"ltr">&lt;<a href=3D=
"mailto:[email protected]" target=3D"_blank">[email protected]</a=
>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 =
0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir=3D"ltr">Having=
 just sourced the database. As a user, it is possible to restore the databa=
se using Ubuntu 14.04 and the postgresql-ppa.</p>
<p dir=3D"ltr">Would you like me to document the process?</p></blockquote><=
div><br></div><div>Definitely. I&#39;d also welcome any patches/ideas on ho=
w to make the process easier. My goal so far was only to run the data on <a=
 href=3D"http://acoustid.org">acoustid.org</a>. Running a mirror was not my=
 priority, because you need fairly expensive hardware to do it right, so no=
t many people would actually do that anyway.</div><div>=C2=A0</div><blockqu=
ote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc s=
olid;padding-left:1ex">
<p dir=3D"ltr">Setup a replication server for backups. Every nth hour, halt=
 the replication server,=C2=A0 tar the datadir, and then restart the replic=
ation server. This might cost a pretty penny when it comes to hosting.<br><=
/p></blockquote><div><br></div><div>I actually already have a replicated se=
rver just for the data export. I currently do it while the replication is r=
unning, which is often causing problems, due to PostgreSQL running out of t=
ransactions (the export is one giant day-long serialized transaction). I ha=
ve actually just moved the server to a completely separate one with the int=
ention to stop replication during the process, but I need to figure out how=
 to handle that with regard to monitoring and things like that.</div><div><=
br></div><div>Lukas</div><div><br></div></div></div></div>

--001a11c2be96d1a61105166358fb--


--===============2134712406==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
MusicBrainz-devel mailing list
[email protected]
http://lists.musicbrainz.org/mailman/listinfo/musicbrainz-devel
--===============2134712406==--