Re: Compressing CPAN Testers test results for long-term archival storage
[email protected] (Scott Baker) Wed, 14 May 2025 08:32:32 -0700
| Newsgroups | perl.cpan.testers.discuss |
|---|---|
| Message-ID | <[email protected]> |
--------------RqLJIeoMfl0C9c5CZWgkldvL
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
I don't know a lot about ZFS, but I do run several large installations
of TrueNAS scale which is an enterprise grade NAS solution. The backend
and all the "magic" is done with ZFS on Linux. As far as I can tell ZFS
on Linux (if you can get around the licensing) is *pretty* mature.
-- Scottchiefbaker
On 5/14/25 6:57 AM, Doug Bell wrote:
>
> Yeah, that's how Zach Dysktra set up our MySQL database backups: The
> primary MySQL wrote its binlogs to a ZFS volume, and the replica would
> receive them and then use a ZFS snapshot to mark the backup point.
> Then ZFS itself stored the diff between the snapshot point and the
> current data.
>
> Long-term, I suspect that'll be what ends up happening w/ the
> Collector system: ZFS really seems like the ideal solution for this,
> as it has compression like we want, but also snapshotting and
> replication and send/recv and etc... If there's anyone with some
> expertise to lend about setting up some OpenZFS stuff, that'd be
> awesome, because I'm not that up-to-date on it at the moment (I was
> still thinking it was pretty unstable on Linux, but a cursory web
> search I just did makes it seem like that is no longer the case).
--------------RqLJIeoMfl0C9c5CZWgkldvL
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 7bit
<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>I don't know a lot about ZFS, but I do run several large
installations of TrueNAS scale which is an enterprise grade NAS
solution. The backend and all the "magic" is done with ZFS on
Linux. As far as I can tell ZFS on Linux (if you can get around
the licensing) is <b>pretty</b> mature.<br>
</p>
<p>-- Scottchiefbaker<br>
</p>
<div class="moz-cite-prefix">On 5/14/25 6:57 AM, Doug Bell wrote:<br>
</div>
<blockquote type="cite"
cite="mid:[email protected]">
<div><br>
</div>
<div>Yeah, that's how Zach Dysktra set up our MySQL database
backups: The primary MySQL wrote its binlogs to a ZFS volume,
and the replica would receive them and then use a ZFS snapshot
to mark the backup point. Then ZFS itself stored the diff
between the snapshot point and the current data.</div>
<div><br>
</div>
<div>Long-term, I suspect that'll be what ends up happening w/ the
Collector system: ZFS really seems like the ideal solution for
this, as it has compression like we want, but also snapshotting
and replication and send/recv and etc... If there's anyone with
some expertise to lend about setting up some OpenZFS stuff,
that'd be awesome, because I'm not that up-to-date on it at the
moment (I was still thinking it was pretty unstable on Linux,
but a cursory web search I just did makes it seem like that is
no longer the case).</div>
</blockquote>
</body>
</html>
--------------RqLJIeoMfl0C9c5CZWgkldvL--