Re: Possible Bug in lftp mirror using mirror:sort-by option
Alexander Lukyanov <[email protected]> Wed, 29 Oct 2014 12:39:28 +0400
| Newsgroups | gmane.network.lftp.user,gmane.network.lftp.devel |
|---|---|
| Message-ID | <CANnoEwo9K0LaNF1qOpBx6yw7r9c72VUxDsAh=ATth2BJia3yQA@mail.gmail.com> |
--===============2257873333704943923== Content-Type: multipart/alternative; boundary=f46d044402b0b8e7ac05068bb30d --f46d044402b0b8e7ac05068bb30d Content-Type: text/plain; charset=UTF-8 Mirror in lftp works directory by directory. It does not build full list of files first, so it cannot sort the whole list. Maybe the mirror algorithm should be redesigned to build the whole recursive list first. What do you think? 2014-10-29 10:07 GMT+03:00 akshay gupta <[email protected]>: > Hi, > > I am trying to mirror files using mirror:sort-by option set to > 'date-desc'. My file structure is like this > > $ ls -l -R > total 3191264 > drwxr-xr-x 3 vikasgoyal biadmin 102 Oct 22 12:35 1 > -rw-r--r-- 1 vikasgoyal biadmin 0 Aug 1 01:00 tmp.txt > -rw-r--r-- 1 vikasgoyal biadmin 0 Aug 1 05:31 tmp1.txt > -rw-r--r-- 1 vikasgoyal biadmin 263940738 Oct 28 13:51 abc.csv > > ./1: > total 0 > drwxr-xr-x 4 vikasgoyal biadmin 136 Oct 28 14:19 2 > > ./1/2: > total 515512 > -rw-r--r-- 1 vikasgoyal biadmin 0 Oct 28 14:19 3 > -rw-r--r-- 1 vikasgoyal biadmin 263940732 Oct 28 14:03 bc.csv > > > I expect the file synch order should be > > ~/tmp.txt > ~/tmp1.txt > ~/abc.csv > ~/1/2/bc.csv > ~/1/2/3 > > > but the synch order is: > ~/tmp.txt > ~/tmp1.txt > ~/1/2/bc.csv > ~/1/2/3 > ~/abc.csv > > > I think its the folder modification time that is causing this issue. Lftp > considers folder synch time to decide the order even though files contained > in the folder are newer then the remaining files in the parent folder. File > synch order should be in order of the modification time irrespective of the > folder structure. Please help. > > Thanks, > Akshay > > > > > > -- Alexander. --f46d044402b0b8e7ac05068bb30d Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr">Mirror in lftp works directory by directory. It does not b= uild full list of files first, so it cannot sort the whole list. Maybe the = mirror algorithm should be redesigned to build the whole recursive list fir= st. What do you think?<br></div><div class=3D"gmail_extra"><br><div class= =3D"gmail_quote">2014-10-29 10:07 GMT+03:00 akshay gupta <span dir=3D"ltr">= <<a href=3D"mailto:[email protected]" target=3D"_blank">akshaygup= [email protected]</a>></span>:<br><blockquote class=3D"gmail_quote" style= =3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir= =3D"ltr">Hi,<div><br></div><div>I am trying to mirror files using mirror:so= rt-by option set to 'date-desc'. My =C2=A0file structure is like th= is=C2=A0</div><div><br></div><div><div>$ ls -l -R</div><div>total 3191264</= div><div>drwxr-xr-x =C2=A03 vikasgoyal =C2=A0biadmin =C2=A0 =C2=A0 =C2=A0 = =C2=A0 102 Oct 22 12:35 1</div><div>-rw-r--r-- =C2=A01 vikasgoyal =C2=A0bia= dmin =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0 Aug =C2=A01 01:00 tmp.txt</div><d= iv>-rw-r--r-- =C2=A01 vikasgoyal =C2=A0biadmin =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 0 Aug =C2=A01 05:31 tmp1.txt</div><div>-rw-r--r-- =C2=A01 vikasgoyal= =C2=A0biadmin =C2=A0 263940738 Oct 28 13:51 abc.csv</div><div><br></div><d= iv>./1:</div><div>total 0</div><div>drwxr-xr-x =C2=A04 vikasgoyal =C2=A0bia= dmin =C2=A0136 Oct 28 14:19 2</div><div><br></div><div>./1/2:</div><div>tot= al 515512</div><div>-rw-r--r-- =C2=A01 vikasgoyal =C2=A0biadmin =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A00 Oct 28 14:19 3</div><div>-rw-r--r-- =C2=A01 vikas= goyal =C2=A0biadmin =C2=A0263940732 Oct 28 14:03 bc.csv</div></div><div><br= ></div><div><br></div><div>I expect the file synch order should be=C2=A0</d= iv><div><br></div><div>~/tmp.txt</div><div>~/tmp1.txt</div><div>~/abc.csv</= div><div>~/1/2/bc.csv</div><div>~/1/2/3</div><div><br></div><div><br></div>= <div>but the synch order is:</div><div><div>~/tmp.txt</div><div>~/tmp1.txt<= /div></div><div>~/1/2/bc.csv</div><div>~/1/2/3</div><div>~/abc.csv</div><di= v><br></div><div><br></div><div>I think its the folder modification time th= at is causing this issue. Lftp considers folder synch time to decide the or= der even though files contained in the folder are newer then the remaining = files in the parent folder. File synch order should be in order of the modi= fication time irrespective of the folder structure. Please help.</div><div>= <br></div><div>Thanks,</div><div>Akshay</div><div><br></div><div><br></div>= <div><br></div><div><br></div><div><br></div></div> </blockquote></div><br><br clear=3D"all"><br>-- <br><div dir=3D"ltr"><div><= /div>=C2=A0=C2=A0 Alexander.<br></div> </div> --f46d044402b0b8e7ac05068bb30d-- --===============2257873333704943923== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ lftp mailing list [email protected] http://univ.uniyar.ac.ru/mailman/listinfo/lftp --===============2257873333704943923==--