Multi-threaded compression/encryption
mannino <[email protected]> Thu, 23 Aug 2018 20:28:08 +0300
| Newsgroups | gmane.comp.sysutils.backup.dar.general |
|---|---|
| Message-ID | <[email protected]> |
dar isn't multi-threaded by itself, as the documentation explains. This is reasonable. However, why dar's compression is not? Even certain encryption algos are multi-threaded in openssl (IIRC AES in CBC mode). Parallel compression (of the same file/data stream, not different dar processes/trees) is particularly one feature I am missing from dar. Example: many *nix system come with gz/xz by default. There are also less used pigz/pixz variants. On a typical server or desktop/high-end laptop with 8 cores (4+HT), gz/xz never use more than 12.5% of total system's power. pigz/pixz use 100%, i.e. all cores. This makes drastic difference in compression speed. Is there any reason why dar isn't compiled against such gz/xz variants? ------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot