[HELP]: Star+gzip file corruption?
"Chris Bshaw" <[email protected]>
| Newsgroups | gmane.comp.archivers.star.user |
|---|---|
| Message-ID | <[email protected]> |
Hi....
I am trying to use star to create a compressed multivolume archive of a
large amount of data on a remote server, and then download it to another
machine and extract.
However, I have been experiencing file corruption problems. The commands I
am using are at the end of this email.
Before I started using star, I just created a single volume archive using
tar czf. This has always worked (has been in use for 2+ years) and the only
difference between the commands below and the original commands is that I
used tar instead of star (and of course the star specific options).
The problem manifests itself in one of the volumes of the multi volume
archive during decompression when I am downloading....I have discovered that
if I manually try to gunzip the specific multi volume file which gives the
problem I get the following message:
gunzip: dos82.tar.gz: invalid compressed data--format violated
This corruption can only have happened during upload (but I only find out
about it during download). Also, it is random and doesn't always
happen.....most of the time everything works fine.....so far it has happened
approx 4 times in the last 10-15 attempts. I am just starting to try to
debug the upload sequence to see if I can catch any errors during upload,
but if I can't fix this, I will have to abandon star and go back to using
single volume archives with tar.
In the meantime, I was wondering if anyone more knowledgeable than I could
save me a little time and suggest what might be wrong, or what I could do to
prevent this from happening?
Thanx muchly in advance.
Chris Bradshaw.
Upload
----------
#Make named pipe
mkfifo /tmp/archive.tar.gz
# Read data from pipe into ncftpput
ncftpput -u <user> -p <password> <Remote_Server> <Remove_Path>
/tmp/archive.tar.gz &
# Feed data into pipe from star
/opt/schily/bin/star -cMvz H=gnutar tsize=100M \
f=/tmp/${ARCHIVE} new-volume-script=/tmp/rename.sh \
/tmp/archive.tar.gz
Download
--------------
# Download with wget and pipe to star to extract.
wget --output-document=- <Remote_URL>|/opt/schily/bin/star xzmf - -no-fsync
-nochown blocks=2000 fs=10
_________________________________________________________________
Upgrade to Messenger 7.0 - more fun features, still totally FREE!
http://messenger.msn.co.uk