Re: possible bug in lftp mirror using xfer:use-temp-file option
Juan Simón <[email protected]> Tue, 30 Sep 2014 21:38:48 +0200
| Newsgroups | gmane.network.lftp.user,gmane.network.lftp.devel |
|---|---|
| Message-ID | <CAMQzBqDcmd6ii=Y+6zFcCJDei0_JTrmJDOgLFcfO3QXEN_q0Gw@mail.gmail.com> |
--===============4911611112674681957== Content-Type: multipart/alternative; boundary=089e0122aece3c290405044d887a --089e0122aece3c290405044d887a Content-Type: text/plain; charset=ISO-8859-1 In which LFTP version exists this option (xfer:use-temp-file)? 2014-09-30 19:05 GMT+02:00 akshay gupta <[email protected]>: > Its causing unpredictable behaviour in case of fuse mounted file system. > Please look into it if it can be resolved. > > Thanks for the quick response. > > ~Akshay > > On Tue, Sep 30, 2014 at 9:15 PM, Alexander Lukyanov <[email protected]> > wrote: > >> In unix it is usually allowed to rename open files, so lftp does that. >> I'll see if it is possible to reverse the order. >> >> 2014-09-30 12:18 GMT+04:00 akshay gupta <[email protected]>: >> >>> Hi, >>> >>> I am trying to mirror files on Fuse mounted hdfs file system ( >>> https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0 >>> byte files. >>> >>> Observations: >>> 1. Files of size larger then 64k are getting transferred properly. >>> Smaller files have 0 byte file size. >>> 2. Debug logs shows that lftp downloaded data for the files correctly. >>> It also renamed them. >>> >>> Additional tests on fuse mounted hdfs. >>> - I created a file with a temp file name, written the data to it, then >>> renamed the file and finally closed the output stream. In this case it >>> creates a 0 byte file. >>> - I created a file with a temp file name, written the data to it, closed >>> the file and then renamed the file. In this case it creates the file >>> correctly. >>> >>> >>> Can someone please look into this issue, it might be possible that >>> stream is closed after the file is renamed. >>> >>> Thanks, >>> Akshay >>> >>> >>> >> >> >> >> -- >> Alexander. >> > > > _______________________________________________ > lftp mailing list > [email protected] > http://univ.uniyar.ac.ru/mailman/listinfo/lftp > > --089e0122aece3c290405044d887a Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div class=3D"gmail_default" style=3D"font-family:verdana,= sans-serif">In which LFTP version exists this option (xfer:use-temp-file)?<= br></div></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">20= 14-09-30 19:05 GMT+02:00 akshay gupta <span dir=3D"ltr"><<a href=3D"mail= to:[email protected]" target=3D"_blank">[email protected]</a>= ></span>:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8e= x;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Its causing= unpredictable behaviour in case of fuse mounted file system. Please look i= nto it if it can be resolved.<div><br></div><div>Thanks for the quick respo= nse.</div><div><br></div><div>~Akshay=A0</div></div><div class=3D"gmail_ext= ra"><br><div class=3D"gmail_quote">On Tue, Sep 30, 2014 at 9:15 PM, Alexand= er Lukyanov <span dir=3D"ltr"><<a href=3D"mailto:[email protected]" targ= et=3D"_blank">[email protected]</a>></span> wrote:<br><blockquote class= =3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padd= ing-left:1ex"><div dir=3D"ltr">In unix it is usually allowed to rename open= files, so lftp does that. I'll see if it is possible to reverse the or= der.<br></div><div class=3D"gmail_extra"><div><div><br><div class=3D"gmail_= quote">2014-09-30 12:18 GMT+04:00 akshay gupta <span dir=3D"ltr"><<a hre= f=3D"mailto:[email protected]" target=3D"_blank">akshaygupta202@gmai= l.com</a>></span>:<br><blockquote class=3D"gmail_quote" style=3D"margin:= 0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi= ,<div><br></div><div><div>I am trying to mirror files on Fuse mounted hdfs = file system (<a href=3D"https://wiki.apache.org/hadoop/MountableHDFS" targe= t=3D"_blank">https://wiki.apache.org/hadoop/MountableHDFS</a>). Lftp is cre= ating some 0 byte files.=A0</div><div><br></div><div>Observations:=A0</div>= <div>1. Files of size larger then 64k are getting transferred properly. Sma= ller files have 0 byte file size.</div><div>2. Debug logs shows that lftp d= ownloaded data for the files correctly. It also renamed them.=A0</div><div>= <br></div><div>Additional tests on fuse mounted hdfs.</div><div>- I created= a file with a temp file name, written the data to it, then renamed the fil= e and finally closed the output stream. In this case it creates a 0 byte fi= le.</div><div>- I created a file with a temp file name, written the data to= it, closed the file and then renamed the file. In this case it creates the= file correctly.</div><div><br></div><div><br></div><div>Can someone please= look into this issue, it might be possible that stream is closed after the= file is renamed.</div><div><br></div><div>Thanks,</div><div>Akshay</div><d= iv>=A0</div><div>=A0<br></div></div></div> </blockquote></div><br><br clear=3D"all"><span class=3D"HOEnZb"><font color= =3D"#888888"><br></font></span></div></div><span class=3D"HOEnZb"><font col= or=3D"#888888"><span><font color=3D"#888888">-- <br><div dir=3D"ltr"><div><= /div>=A0=A0 Alexander.<br></div> </font></span></font></span></div> </blockquote></div><br></div> <br>_______________________________________________<br> lftp mailing list<br> <a href=3D"mailto:[email protected]">[email protected]</a><br> <a href=3D"http://univ.uniyar.ac.ru/mailman/listinfo/lftp" target=3D"_blank= ">http://univ.uniyar.ac.ru/mailman/listinfo/lftp</a><br> <br></blockquote></div><br></div> --089e0122aece3c290405044d887a-- --===============4911611112674681957== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ lftp mailing list [email protected] http://univ.uniyar.ac.ru/mailman/listinfo/lftp --===============4911611112674681957==--