Re: Bug in lftp mirror when using xfer:use-temp-file option
Alexander Lukyanov <[email protected]> Mon, 27 Oct 2014 15:20:28 +0400
| Newsgroups | gmane.network.lftp.user,gmane.network.lftp.devel |
|---|---|
| Message-ID | <CANnoEwpMdE+WGSdwwbdgV8ajT1hCV3vCNFZbf+4oEOm6dvz4sw@mail.gmail.com> |
--===============3295083119234683034== Content-Type: multipart/alternative; boundary=f46d043bdf0aca4526050665b7b2 --f46d043bdf0aca4526050665b7b2 Content-Type: text/plain; charset=UTF-8 I have found the bug. As a workaround, use "set xfer:clobber yes". 2014-10-27 13:06 GMT+03:00 akshay gupta <[email protected]>: > no, I am running as a root user. There is some issue with lftp, when file > with same name already exist its not able to rename the temp file to actual > file. > > On Mon, Oct 27, 2014 at 1:44 PM, Alexander V. Lukyanov <[email protected]> > wrote: > >> On Mon, Oct 27, 2014 at 01:30:42PM +0530, akshay gupta wrote: >> > ---> RETR test.txt >> > <--- 150 Opening BINARY mode data connection for 'test.txt' (202 bytes). >> > ---- Got EOF on data connection >> > ---- Closing data socket >> > <--- 226 Transfer complete. >> >> So the file cannot be renamed locally, right? Is there a permissions >> problem? >> >> -- >> Alexander. >> >> > On Mon, Oct 27, 2014 at 1:18 PM, Alexander Lukyanov <[email protected]> >> > wrote: >> > >> > > Can you provide a debug log? Why lftp cannot replace the old file? >> > > >> > > 2014-10-27 10:44 GMT+03:00 akshay gupta <[email protected]>: >> > > >> > >> Hi, >> > >> >> > >> I am trying to mirror files using lftp, I have tested a use case >> where a >> > >> file at the source machine gets modified but the file name remains >> the >> > >> same. After mirroring, lftp is unable to replace the old file and >> also >> > >> leaves a temporary file. >> > >> >> > >> For example. If source have file a.txt and its mirrored successfully >> at >> > >> the destination, now if I update a.txt append some content and save >> it with >> > >> same name. If I run lftp mirror again then its not able to replace >> the >> > >> existing a.txt but it also leaves the temp file a.txt_transit_ >> behind. And >> > >> if i run the mirror multiple times it always downloads the changed >> a.txt, i >> > >> can see this from the lftp logs. >> > >> >> > >> Suggestion: Will it make sense to keep versions of the files as they >> are >> > >> updated at the source. Like if a.txt is changed at source then lftp >> mirror >> > >> will save it as a.txt_{TIMESTAMP}_. Every time a file is updated it >> will be >> > >> saved with a new time stamp. And mirror will consider these file to >> decide >> > >> whether to download or not. >> > >> >> > >> >> > >> Thanks, >> > >> Akshay >> > >> >> > >> >> > >> >> > >> >> > >> >> > > >> > > >> > > -- >> > > Alexander. >> > > >> >> > _______________________________________________ >> > lftp mailing list >> > [email protected] >> > http://univ.uniyar.ac.ru/mailman/listinfo/lftp >> >> > -- Alexander. --f46d043bdf0aca4526050665b7b2 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr">I have found the bug. As a workaround, use "set xfer:= clobber yes".<br></div><div class=3D"gmail_extra"><br><div class=3D"gm= ail_quote">2014-10-27 13:06 GMT+03:00 akshay gupta <span dir=3D"ltr"><<a= href=3D"mailto:[email protected]" target=3D"_blank">akshaygupta202@= gmail.com</a>></span>:<br><blockquote class=3D"gmail_quote" style=3D"mar= gin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr= ">no, I am running as a root user. There is some issue with lftp, when file= with same name already exist its not able to rename the temp file to actua= l file.</div><div class=3D"HOEnZb"><div class=3D"h5"><div class=3D"gmail_ex= tra"><br><div class=3D"gmail_quote">On Mon, Oct 27, 2014 at 1:44 PM, Alexan= der V. Lukyanov <span dir=3D"ltr"><<a href=3D"mailto:[email protected]" targe= t=3D"_blank">[email protected]</a>></span> wrote:<br><blockquote class=3D"gma= il_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-lef= t:1ex"><span>On Mon, Oct 27, 2014 at 01:30:42PM +0530, akshay gupta wrote:<= br> > ---> RETR test.txt<br> > <--- 150 Opening BINARY mode data connection for 'test.txt'= (202 bytes).<br> > ---- Got EOF on data connection<br> > ---- Closing data socket<br> > <--- 226 Transfer complete.<br> <br> </span>So the file cannot be renamed locally, right? Is there a permissions= problem?<br> <br> --<br> =C2=A0 =C2=A0Alexander.<br> <span><br> > On Mon, Oct 27, 2014 at 1:18 PM, Alexander Lukyanov <<a href=3D"mai= lto:[email protected]" target=3D"_blank">[email protected]</a>><br> > wrote:<br> ><br> > > Can you provide a debug log? Why lftp cannot replace the old file= ?<br> > ><br> > > 2014-10-27 10:44 GMT+03:00 akshay gupta <<a href=3D"mailto:aks= [email protected]" target=3D"_blank">[email protected]</a>>:<= br> > ><br> > >> Hi,<br> > >><br> > >> I am trying to mirror files using lftp, I have tested a use c= ase where a<br> > >> file at the source machine gets modified but the file name re= mains the<br> > >> same. After mirroring, lftp is unable to replace the old file= and also<br> > >> leaves a temporary file.<br> > >><br> > >> For example. If source have file a.txt and its mirrored succe= ssfully at<br> > >> the destination, now if I update a.txt append some content an= d save it with<br> > >> same name. If I run lftp mirror again then its not able to re= place the<br> > >> existing a.txt but it also leaves the temp file a.txt_transit= _ behind. And<br> > >> if i run the mirror multiple times it always downloads the ch= anged a.txt, i<br> > >> can see this from the lftp logs.<br> > >><br> > >> Suggestion: Will it make sense to keep versions of the files = as they are<br> > >> updated at the source. Like if a.txt is changed at source the= n lftp mirror<br> > >> will save it as a.txt_{TIMESTAMP}_. Every time a file is upda= ted it will be<br> > >> saved with a new time stamp. And mirror will consider these f= ile to decide<br> > >> whether to download or not.<br> > >><br> > >><br> > >> Thanks,<br> > >> Akshay<br> > >><br> > >><br> > >><br> > >><br> > >><br> > ><br> > ><br> > > --<br> > >=C2=A0 =C2=A0 Alexander.<br> > ><br> <br> </span>> _______________________________________________<br> > lftp mailing list<br> > <a href=3D"mailto:[email protected]" target=3D"_blank">[email protected].= ru</a><br> > <a href=3D"http://univ.uniyar.ac.ru/mailman/listinfo/lftp" target=3D"_= blank">http://univ.uniyar.ac.ru/mailman/listinfo/lftp</a><br> <br> </blockquote></div><br></div> </div></div></blockquote></div><br><br clear=3D"all"><br>-- <br><div dir=3D= "ltr"><div></div>=C2=A0=C2=A0 Alexander.<br></div> </div> --f46d043bdf0aca4526050665b7b2-- --===============3295083119234683034== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ lftp mailing list [email protected] http://univ.uniyar.ac.ru/mailman/listinfo/lftp --===============3295083119234683034==--