possible bug in lftp mirror using xfer:use-temp-file option
akshay gupta <[email protected]> Tue, 30 Sep 2014 13:48:15 +0530
| Newsgroups | gmane.network.lftp.user,gmane.network.lftp.devel |
|---|---|
| Message-ID | <CAB_qc73K8fuBsMe027OH7TZkJog0c-AJ+a72aBjp=_YWX5tePQ@mail.gmail.com> |
--===============4183649052996986876== Content-Type: multipart/alternative; boundary=f46d041826189819f905044407fe --f46d041826189819f905044407fe Content-Type: text/plain; charset=UTF-8 Hi, I am trying to mirror files on Fuse mounted hdfs file system ( https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0 byte files. Observations: 1. Files of size larger then 64k are getting transferred properly. Smaller files have 0 byte file size. 2. Debug logs shows that lftp downloaded data for the files correctly. It also renamed them. Additional tests on fuse mounted hdfs. - I created a file with a temp file name, written the data to it, then renamed the file and finally closed the output stream. In this case it creates a 0 byte file. - I created a file with a temp file name, written the data to it, closed the file and then renamed the file. In this case it creates the file correctly. Can someone please look into this issue, it might be possible that stream is closed after the file is renamed. Thanks, Akshay --f46d041826189819f905044407fe Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr">Hi,<div><br></div><div><div>I am trying to mirror files on= Fuse mounted hdfs file system (<a href=3D"https://wiki.apache.org/hadoop/M= ountableHDFS">https://wiki.apache.org/hadoop/MountableHDFS</a>). Lftp is cr= eating some 0 byte files.=C2=A0</div><div><br></div><div>Observations:=C2= =A0</div><div>1. Files of size larger then 64k are getting transferred prop= erly. Smaller files have 0 byte file size.</div><div>2. Debug logs shows th= at lftp downloaded data for the files correctly. It also renamed them.=C2= =A0</div><div><br></div><div>Additional tests on fuse mounted hdfs.</div><d= iv>- I created a file with a temp file name, written the data to it, then r= enamed the file and finally closed the output stream. In this case it creat= es a 0 byte file.</div><div>- I created a file with a temp file name, writt= en the data to it, closed the file and then renamed the file. In this case = it creates the file correctly.</div><div><br></div><div><br></div><div>Can = someone please look into this issue, it might be possible that stream is cl= osed after the file is renamed.</div><div><br></div><div>Thanks,</div><div>= Akshay</div><div>=C2=A0</div><div>=C2=A0<br></div></div></div> --f46d041826189819f905044407fe-- --===============4183649052996986876== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ lftp mailing list [email protected] http://univ.uniyar.ac.ru/mailman/listinfo/lftp --===============4183649052996986876==--