Re: rdump

--===============0365270745==
Content-Type: multipart/signed; micalg=pgp-sha1;
	protocol="application/pgp-signature"; boundary="4VrXvz3cwkc87Wze"
Content-Disposition: inline


--4VrXvz3cwkc87Wze
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline

[On 27 Dec, @12:03, Sven.Hartrumpf@FernUni-Ha wrote in "Re: [hdup-user] rdump ..."]
> Not large, around 20 GB because we have many small files.
> The problem is 'tar': the file list is only 200 MB, but
> 'tar' needs 1 GB RAM for using it :-(

I've reworked rdup, so that it now uses GTree's (binary balanced
tree), the speed increase was impressive :)

To give some numbers: (This one done with a hot diskcache, i.e. first
run du /usr /home)

null dump:
# /usr/bin/time ./rdup ALL /home /usr > /dev/null
1.43user 1.16system 0:02.91elapsed 89%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+2846minor)pagefaults 0swaps

# ls -l ALL
-rw-------  1 root root 5.6M Dec 27 20:26 ALL
# wc ALL
 103311  209328 5815499 ALL

So this is with 103311 files, the resident mem size (according to top)
is about 10M

incremental dump:
# /usr/bin/time ./rdup ALL /home /usr > /dev/null
3.01user 1.25system 0:08.67elapsed 49%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+5441minor)pagefaults 0swaps

The resident mem size was up to 18M, which makes sense.


--
grtz,
  - Miek

 http://www.miek.nl                      http://www.nlnetlabs.nl
  PGP Key ID: 3880 D0F6
 fingerprint: 6A3C F450 6D4E 7C6B C23C  F982 258B 85CF 3880 D0F6

--4VrXvz3cwkc87Wze
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: Digital signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)

iD8DBQFDsZc5JYuFzziA0PYRAjKSAJ44Xp3CAUJwbTbESxpECqlKiCUn0wCg5MBK
dAYXWFUYfZrbjjTCH/00mUQ=
=HUGu
-----END PGP SIGNATURE-----

--4VrXvz3cwkc87Wze--

--===============0365270745==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
hdup-user mailing list
[email protected]
http://atoom.net/cgi-bin/mailman/listinfo/hdup-user

--===============0365270745==--