Multiprocess

Anders Bo Rasmussen <[email protected]> Thu, 23 Sep 2010 00:05:46 +0200
Newsgroups gmane.comp.sysutils.backup.dar.general
Message-ID <[email protected]>
Hi.

I'm using dar to backup up my private files and I'm happy about it. 

I however see that when I take backup up of my home directory to a usb
2.0 disk, dar uses on average 50% cpu, but sometimes peaks at 100% cpu
of one core. When it peaks at 100% cpu the backup to the usb is slower
than optimal - this can easily be seen by delays in the blinking LED. I
use both encryption and compression, so this probably happens when there
is data that can be compressed a lot.

If I bought a USB 3.0 drive it would probably wait for the CPU all the
time. 

Of course I could set the compression level lower (it is currently 6),
which would make less cpu usage and at the same time write more data to
the drive.

But wouldn't it be good to have dar multiprocess? I see some possible
benefits:

* Multiple processes that could compress and encrypt (I don't know if
the encryption is possible or it has to be encrypted as one big stream)
would increase the available cpu power.
* Possible buffered output, so there would be e.g. 500MB of unwritten
data, that could be used for when the "hard cpu times" comes.
* Possible buffered input, so small files could be read ahead, and
therefore not make a gab in feeding the compression/encryption.

/Anders

-- 
41 6E 64 65 72 73 

------------------------------------------------------------------------------
Nokia and AT&T present the 2010 Calling All Innovators-North America contest
Create new apps & games for the Nokia N8 for consumers in  U.S. and Canada
$10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing
Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store 
http://p.sf.net/sfu/nokia-dev2dev