Re: Postgres backup tool recommendations for multi-terabyte database in Google Cloud

--00000000000020e8d80598fb568a
Content-Type: text/plain; charset="UTF-8"

Consider WAL-G. It works well with GCS nowadays. We have a good fresh
experience of using it on GCP, for multi-TB databases.

BTW, what is your opinion on using GCE snapshots in this context? You
mention that you've consider them. Thoughts?

Thanks,
Nik

On Thu, Dec 5, 2019 at 09:48 Craig Jackson <[email protected]>
wrote:

> Hi,
>
> We are in the process of migrating an oracle database to postgres in
> Google Cloud and are investigating backup/recovery tools. The database is
> size is > 20TB. We have an SLA that requires us to be able to complete a
> full restore of the database within 24 hours. We have been testing
> pgbackreset, barman, and GCP snapshots but wanted to see if there are any
> other recommendations we should consider.
>
> *Desirable features*
> - Parallel backup/recovery
> - Incremental backups
> - Backup directly to a GCP bucket
> - Deduplication/Compression
>
> Any suggestions would be appreciated.
>
> Craig Jackson
>

--00000000000020e8d80598fb568a
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div><div><div><div dir=3D"auto">Consider WAL-G. It works well with GCS now=
adays. We have a good fresh experience of using it on GCP, for multi-TB dat=
abases.</div></div><div dir=3D"auto"><br></div><div dir=3D"auto">BTW, what =
is your opinion on using GCE snapshots in this context? You mention that yo=
u&#39;ve consider them. Thoughts?</div><div dir=3D"auto"><br></div><div dir=
=3D"auto">Thanks,</div><div dir=3D"auto">Nik</div></div></div><div><div><di=
v dir=3D"auto"><br></div><div dir=3D"auto">On Thu, Dec 5, 2019 at 09:48 Cra=
ig Jackson &lt;<a href=3D"mailto:[email protected]" target=3D"_bla=
nk">[email protected]</a>&gt; wrote:<br></div><div><div class=3D"g=
mail_quote"><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;bo=
rder-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,<div><br></d=
iv><div>We are in the process of migrating an oracle database to postgres i=
n Google Cloud and are investigating backup/recovery tools. The database is=
 size is &gt; 20TB. We have an SLA that requires us to be able to complete =
a full restore of the database within 24 hours. We have been testing pgback=
reset,=C2=A0barman, and GCP snapshots but wanted to see if there are any ot=
her recommendations we should consider.=C2=A0</div><div><br></div><div><u>D=
esirable=C2=A0features</u></div><div><div>- Parallel backup/recovery<br>- I=
ncremental backups</div><div>- Backup directly to a GCP bucket</div><div>- =
Deduplication/Compression</div><div><br></div><div>Any suggestions would be=
 appreciated.</div></div></div><div dir=3D"ltr"><div><br><div dir=3D"ltr" d=
ata-smartmail=3D"gmail_signature"><div dir=3D"ltr">Craig Jackson</div><div>=
</div></div></div></div>
</blockquote></div></div>
</div>
</div>

--00000000000020e8d80598fb568a--