Perfomance problem backupscript (more details and tests)

"Ruud Baart" <[email protected]>
Newsgroups gmane.comp.archivers.star.user
Organization IT's Prompt or never ...
Message-ID <[email protected]>
Thanks for the comments on my performance problem. I followed some suggestions and 
my conclusion is that star is not performing as it one may expect. I hope someone has 
some suggestions

The reasons:
1. As Thomas suggested I timed the performance of find and compared it to star. This 
shows clearly that star need much more time than find. The results are at the end of this 
mail. The timing on a real production server is even more dramatic:
    time find ... directories ... -ctime 1>/dev/null
    real 7m41.602s, user 0m0.984s, sys 0m28.531s

    time star -c -acl -H=exustar ... directories ..>/dev/null
    ---->>>>> interrupted, takes too long to wait for <<<<----
    real 56m52s, user 9m16s, sys 9m50s  
2. Joerg Schilling suggested that the debian version was old. So I tested with 
star debian versions 1.5a57 (sarge distribution) and 1.5a60 (test distribution) and with 
version 1.5.a65 compiled on the machine. All the same result

3. I tested with XFS and Ext2 filesystems. Same result.

4. I tested on different machines (Xeon and AMD). All systems showed more or less the 
same results.

5. I tested with kernel 2.6.8-2 (debian kernel) and with 2.6.12-3 (own version). Makes no 
difference with any of the tested star versions.

6. I've not tested the tapestreamer(s), but for now I don't see any reason for doing that.

Below the timing results on a testserver.
======================================
These tests were done on: 
/dev/hde5     ext2    963M  586M  327M  65% /tmp

Kernel: 
Linux wyatt 2.6.8-2-386 #1 Thu May 19 17:40:50 JST 2005 i686 GNU/Linux

wyatt:/# time find /tmp -ctime 1 >/dev/null
real    0m1.008s
user    0m0.012s
sys     0m0.083s

Star version 1.5a60 (debian testing version)
------------------------------------------------------
wyatt:/# time star -c -acl -H=exustar /tmp>/dev/null
star: 60272 blocks + 0 bytes (total of 617185280 bytes = 602720.00k).
real    0m30.459s
user    0m0.317s
sys     0m4.836s

time star -c -H=exustar /tmp>/dev/null
real    0m29.743s
user    0m0.290s
sys     0m4.718s

time star -c -no-fifo  /tmp>/dev/null
real    0m30.325s
user    0m0.261s
sys     0m4.396s

gun tar test
----------------------------------------------------------
wyatt:/# time tar -c  /tmp>/dev/null
real    0m1.054s
user    0m0.212s
sys     0m0.110s

Star version 1.5a65 (compiled on this machine)
------------------------------------------------------
time /opt/schily/bin/star -c -no-fifo  /tmp>/dev/null
real    0m28.411s
user    0m0.293s
sys     0m4.148s

wyatt:/# time /opt/schily/bin/star -c -fifo  /tmp>/dev/null
real    0m29.654s
user    0m0.235s
sys     0m4.776s

====================================================

Met vriendelijke groet/Regards,
Ruud Baart

Prompt, Kerkstraat 173
5261 CW Vught, Netherlands
Tel: +31 73 6567041
http://www.prompt.nl
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.