suggestion: do not keep files in tar archives.

blackie-1tkZHNPFh85/[email protected] (Jesper K. Pedersen)
Newsgroups gmane.comp.sysutils.backup.hdup.general
Message-ID <[email protected]>
Hi.

Yesterday I needed to restore a file from my hdup for the first time, and
that thought me something new, namely that things can only go too slow when
restoring.

Unfortunately it went way to slow for my - at the moment - temper.
That made me start doing a bit of math.

I back up all of my hard disk, which includes all my digital photos etc, so
the total backup is approx 32Gb for the base backup.

I do the backup on a IDE disk connected though a USB wrapper device, which
is not utterly fast, but I don't really care, the priority is that I can
easily detach it from the rest of the system. I measured that the device
could copy in the order of magnitude 1Mb of data per sec.

Thus to simply read though the base file, I need to wait for 32.000 sec = 9
hours. And I do need that, as I understand tar.

9 hours is a looooong time when you accidently deleted a very important
file from say your web server.

My suggestion is to unpack the files on the disk when copying over,
something along those lines:

tar <options for sender> | ssh server '(cd BackUpDir; tar xpf - )'

This would store all the files on the disk, and I could thus access them
very fast (within secs), as I would have random access to them.

Hope you like the idea and soon find time for implementing it.

Cheers
Jesper.
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.