Re: possible bug in lftp mirror using xfer:use-temp-file option
Alexander Lukyanov <[email protected]> Tue, 30 Sep 2014 19:45:17 +0400
| Newsgroups | gmane.network.lftp.user,gmane.network.lftp.devel |
|---|---|
| Message-ID | <CANnoEwqNETj+PjgSEy7uoKcuuNh0bxSF2GrkmnQSEjnpcjwM=w@mail.gmail.com> |
--===============5882516421935782644== Content-Type: multipart/alternative; boundary=047d7b5d436e1d7bd905044a4530 --047d7b5d436e1d7bd905044a4530 Content-Type: text/plain; charset=UTF-8 In unix it is usually allowed to rename open files, so lftp does that. I'll see if it is possible to reverse the order. 2014-09-30 12:18 GMT+04:00 akshay gupta <[email protected]>: > Hi, > > I am trying to mirror files on Fuse mounted hdfs file system ( > https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0 > byte files. > > Observations: > 1. Files of size larger then 64k are getting transferred properly. Smaller > files have 0 byte file size. > 2. Debug logs shows that lftp downloaded data for the files correctly. It > also renamed them. > > Additional tests on fuse mounted hdfs. > - I created a file with a temp file name, written the data to it, then > renamed the file and finally closed the output stream. In this case it > creates a 0 byte file. > - I created a file with a temp file name, written the data to it, closed > the file and then renamed the file. In this case it creates the file > correctly. > > > Can someone please look into this issue, it might be possible that stream > is closed after the file is renamed. > > Thanks, > Akshay > > > -- Alexander. --047d7b5d436e1d7bd905044a4530 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr">In unix it is usually allowed to rename open files, so lft= p does that. I'll see if it is possible to reverse the order.<br></div>= <div class=3D"gmail_extra"><br><div class=3D"gmail_quote">2014-09-30 12:18 = GMT+04:00 akshay gupta <span dir=3D"ltr"><<a href=3D"mailto:akshaygupta2= [email protected]" target=3D"_blank">[email protected]</a>></span>:<br= ><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1= px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,<div><br></div><div><di= v>I am trying to mirror files on Fuse mounted hdfs file system (<a href=3D"= https://wiki.apache.org/hadoop/MountableHDFS" target=3D"_blank">https://wik= i.apache.org/hadoop/MountableHDFS</a>). Lftp is creating some 0 byte files.= =C2=A0</div><div><br></div><div>Observations:=C2=A0</div><div>1. Files of s= ize larger then 64k are getting transferred properly. Smaller files have 0 = byte file size.</div><div>2. Debug logs shows that lftp downloaded data for= the files correctly. It also renamed them.=C2=A0</div><div><br></div><div>= Additional tests on fuse mounted hdfs.</div><div>- I created a file with a = temp file name, written the data to it, then renamed the file and finally c= losed the output stream. In this case it creates a 0 byte file.</div><div>-= I created a file with a temp file name, written the data to it, closed the= file and then renamed the file. In this case it creates the file correctly= .</div><div><br></div><div><br></div><div>Can someone please look into this= issue, it might be possible that stream is closed after the file is rename= d.</div><div><br></div><div>Thanks,</div><div>Akshay</div><div>=C2=A0</div>= <div>=C2=A0<br></div></div></div> </blockquote></div><br><br clear=3D"all"><br>-- <br><div dir=3D"ltr"><div><= /div>=C2=A0=C2=A0 Alexander.<br></div> </div> --047d7b5d436e1d7bd905044a4530-- --===============5882516421935782644== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ lftp mailing list [email protected] http://univ.uniyar.ac.ru/mailman/listinfo/lftp --===============5882516421935782644==--