Re: Performance issues w/ S3
tink via Duplicity-talk <[email protected]>
| Newsgroups | gmane.comp.sysutils.backup.duplicity.general |
|---|---|
| Message-ID | <CAAfwjx7zhzWy9Ed+q78US1CD4q6Ubn41r4_xGcL1VUau6mwidw@mail.gmail.com> |
On Fri, 19 Jul 2024 at 18:49, Thomas Laubrock via Duplicity-talk < [email protected]> wrote: > Hi Tink, > > Then I think duplicity is spending the time on the volume generation side. > > Did you make a test for the local file system? > > Run duplicity in debug mode `-v d` and with `--log-timestamp` could help > to see where duplicity is spending its time. > > Further you can add --no-compression and --no-encryption to reduce extra > cycle on the volume creation side. > > Can you describe what your backup data looks like. Many small files, one > big file, ... > > Bye > Thomas > Hi Thomas, I ran a test to local (2xSSD, RAID1) ... both /tmp (where GPG happens) and the target are on the same SSD, source is on a fat internal RAID-10 of spinning rust (8*7.5G) ... to back up the same 10G test file to local disk also took 7:17 minutes ... Our backed-up data is mostly small text files and a few bigger binary blobs (database dumps). I will be experimenting w/ a separate python install (3.12) and the latest duplicity today in an environment separate from system python. Cheers Tink _______________________________________________ Duplicity-talk mailing list [email protected] https://lists.nongnu.org/mailman/listinfo/duplicity-talk