Re: Subtle difference of v3 and v4 regarding exclusion performance

--===============8092098886354077622==
Content-Type: multipart/alternative; boundary="001a114a95ce060bb405610f6fbf"

--001a114a95ce060bb405610f6fbf
Content-Type: text/plain; charset="UTF-8"

The excludes should be relative to the share name.  If you share name is
/home, then the exclude should be 'felfert/.m2/repository', not '/home/
felfert/.m2/repository'.

Your manual example works because you used "/home" instead of "/home/".
The more equivalent command for BackupPC is:

rsync -av --exclude=felfert/.m2/repository target:/home/ .


Craig

On Thu, Nov 30, 2017 at 7:14 AM, Fritz Elfert <[email protected]> wrote:

> I just have upgraded my local server to Fedora 26 which included an
> uprade of BackupPC v3 to BackupPC 4.1.3.
>
> Unfortunately, I experience a subtle difference of the file exclusion
> mechanism which hits me hard performancewise.
>
> With old BackupPC (cannot prove anymore) as well as with a
> manual test like
>
> rsync -av --exclude=/home/felfert/.m2/repository target:/home .
>
> On the target (in rsync terms: server), the specified directory is
> simply skipped which takes just millisecs.
>
> With BackupPC 4.3.1, the directory is missing in the resultin backup (as
> expected).
> However: The whole hierarchy below /home/felfert/.m2/repository is still
> recursively read on the target which takes ages (in my case ~2hours) and
> also puts quite some load on the target.
>
> This is a huge performance degradation compared to v3.
>
> Can somebody confirm this or do I have overlooked some necessary change
> (ragading v3 -> v4 migration) in the config?
>
> -Fritz
>
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> BackupPC-devel mailing list
> [email protected]
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-devel
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
>

--001a114a95ce060bb405610f6fbf
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">The excludes should be relative to the share name.=C2=A0 I=
f you share name is /home, then the exclude should be &#39;<span style=3D"f=
ont-size:12.8px">felfert/.m2/</span><wbr style=3D"font-size:12.8px"><span s=
tyle=3D"font-size:12.8px">repository&#39;, not &#39;/home/</span><span styl=
e=3D"font-size:12.8px">felfert/.m2/</span><wbr style=3D"font-size:12.8px"><=
span style=3D"font-size:12.8px">repository&#39;.</span><div><span style=3D"=
font-size:12.8px"><br></span></div><div><span style=3D"font-size:12.8px">Yo=
ur manual example works because you used &quot;/home&quot; instead of &quot=
;/home/&quot;.=C2=A0 The more equivalent command for BackupPC is:</span></d=
iv><div><span style=3D"font-size:12.8px"><br></span></div><blockquote style=
=3D"margin:0 0 0 40px;border:none;padding:0px"><div><span style=3D"font-siz=
e:12.8px">rsync -av --exclude=3Dfelfert/.m2/repository target:/home/ .</spa=
n></div></blockquote><div><div><span style=3D"font-size:12.8px"><br></span>=
</div><div><span style=3D"font-size:12.8px">Craig</span></div></div></div><=
div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Thu, Nov 30, 20=
17 at 7:14 AM, Fritz Elfert <span dir=3D"ltr">&lt;<a href=3D"mailto:fritz@f=
ritz-elfert.de" target=3D"_blank">[email protected]</a>&gt;</span> wrot=
e:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-l=
eft:1px #ccc solid;padding-left:1ex">I just have upgraded my local server t=
o Fedora 26 which included an<br>
uprade of BackupPC v3 to BackupPC 4.1.3.<br>
<br>
Unfortunately, I experience a subtle difference of the file exclusion<br>
mechanism which hits me hard performancewise.<br>
<br>
With old BackupPC (cannot prove anymore) as well as with a<br>
manual test like<br>
<br>
rsync -av --exclude=3D/home/felfert/.m2/<wbr>repository target:/home .<br>
<br>
On the target (in rsync terms: server), the specified directory is<br>
simply skipped which takes just millisecs.<br>
<br>
With BackupPC 4.3.1, the directory is missing in the resultin backup (as<br=
>
expected).<br>
However: The whole hierarchy below /home/felfert/.m2/repository is still<br=
>
recursively read on the target which takes ages (in my case ~2hours) and<br=
>
also puts quite some load on the target.<br>
<br>
This is a huge performance degradation compared to v3.<br>
<br>
Can somebody confirm this or do I have overlooked some necessary change<br>
(ragading v3 -&gt; v4 migration) in the config?<br>
<span class=3D"HOEnZb"><font color=3D"#888888"><br>
-Fritz<br>
<br>
<br>
</font></span><br>------------------------------<wbr>----------------------=
--------<wbr>------------------<br>
Check out the vibrant tech community on one of the world&#39;s most<br>
engaging tech sites, Slashdot.org! <a href=3D"http://sdm.link/slashdot" rel=
=3D"noreferrer" target=3D"_blank">http://sdm.link/slashdot</a><br>_________=
_____________________<wbr>_________________<br>
BackupPC-devel mailing list<br>
<a href=3D"mailto:[email protected]">BackupPC-devel@list=
s.<wbr>sourceforge.net</a><br>
List:=C2=A0 =C2=A0 <a href=3D"https://lists.sourceforge.net/lists/listinfo/=
backuppc-devel" rel=3D"noreferrer" target=3D"_blank">https://lists.sourcefo=
rge.net/<wbr>lists/listinfo/backuppc-devel</a><br>
Wiki:=C2=A0 =C2=A0 <a href=3D"http://backuppc.wiki.sourceforge.net" rel=3D"=
noreferrer" target=3D"_blank">http://backuppc.wiki.<wbr>sourceforge.net</a>=
<br>
Project: <a href=3D"http://backuppc.sourceforge.net/" rel=3D"noreferrer" ta=
rget=3D"_blank">http://backuppc.sourceforge.<wbr>net/</a><br>
<br></blockquote></div><br></div>

--001a114a95ce060bb405610f6fbf--


--===============8092098886354077622==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
--===============8092098886354077622==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
BackupPC-devel mailing list
[email protected]
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-devel
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

--===============8092098886354077622==--