Re: Performance issues w/ S3

On Fri, 12 Jul 2024 at 23:22, edgar.soldin--- via Duplicity-talk <
[email protected]> wrote:

>
> >      > am seeing horribly slow upload speeds (shuffling 400GB in 24 h,
> so roughly 5 MB/s).
> >      >
> >      > Using aws cli tools on the same server to the same bucket I get
> 80MB/s.
> >      > Looking at a tcpdump during both attempts the latter looks fine
> and swift, the duplicity one is seeing the far end throttling me badly,
> every other second it tells me to back off for 1.5 seconds (setting a
> win-size of 0 for that period of time).
> >
> >     maybe some boto3 issue? do you have the latest version?
> https://pypi.orgo/project/boto3/ <https://pypi.org/project/boto3/>
> >
> > Using the boto3 that comes packaged w/ the distro, 1.34.108, so somewhat
> behind but not drastically ...
>
> how do you know it's not a bug they fixed in between?

I don't ... but as a general rule my company prefers not to stray from
distro packages;


> worth a try.
>
Possibly. But the behaviour was the same with the boto3 that's packaged in
with Ubuntu 18.04 (which we're using
w/ pay-for extended support for reasons) and Debian 12 (Bookworm).


> sunny regards ..ede
>
Kind regards,
Tink

_______________________________________________
Duplicity-talk mailing list
[email protected]
https://lists.nongnu.org/mailman/listinfo/duplicity-talk