Re: slow job with many files?

Hi all,

Am 28.01.2026 um 14:06 schrieb Stefan G. Weichinger via Bacula-users:
> Am 28.01.26 um 08:58 schrieb Stefan G. Weichinger via Bacula-users:
> 
>> The defs are shown in the first posting. *no* signature set. Is that 
>> wrong/problematic?
> 
> added md5 sig for the most jobs on this fd for now

While md5 is IMO still good for bitrot detection (which we also do with 
some CRC, but not at the file level) I'd recommend going for longer and 
more collision resistant hashes.

The downside of them taking up more catalog space is rather minimal, 
given all the other things we keep track of already. The potential 
downside of them slowing down things is a very interesting topic for 
some research :-)

Essentially, Bacula uses the openSSL functions. OpenSSL has built-in 
speed test functions. OpenSSL is also, on many platforms, highly tunded. 
On others, particularly RISC CPUs without crypto acceleration, all 
software tuning will probably be pointless.

Anyway -- try something like

for c in md5 sha1 sha256 sha512; do openssl speed -bytes 65536 \
-seconds 10 -evp $c 2>/dev/null | grep -E '^'$c ; done

on your typival clients and see what you get.

(Also, I try to solve throughput bottlenecks that are due to CPU limits 
by parallelizing backups, but that can be a challenge in itself, and in 
many cases, it's not worth the effort anyway. Most of my backups do not 
depend on particular tight backup windows, and if a backup finishes 
after 15 minutes or 15 hours is not important.)


However, to your first question: I usually very strongly recommend to 
set some signature in all of your file set options blocks. Of course 
it's not wrong to not have any, but not having them does make it more 
likely that certain errors go undetected.

Cheers,

Arno

> 
> _______________________________________________
> Bacula-users mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/bacula-users

-- 
Arno Lehmann

IT-Service Lehmann
Sandstr. 6, 49080 Osnabrück



_______________________________________________
Bacula-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/bacula-users