possible bug in lftp mirror using xfer:use-temp-file option

akshay gupta <[email protected]> Tue, 30 Sep 2014 13:48:15 +0530
Newsgroups gmane.network.lftp.user,gmane.network.lftp.devel
Message-ID <CAB_qc73K8fuBsMe027OH7TZkJog0c-AJ+a72aBjp=_YWX5tePQ@mail.gmail.com>
--===============4183649052996986876==
Content-Type: multipart/alternative; boundary=f46d041826189819f905044407fe

--f46d041826189819f905044407fe
Content-Type: text/plain; charset=UTF-8

Hi,

I am trying to mirror files on Fuse mounted hdfs file system (
https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0 byte
files.

Observations:
1. Files of size larger then 64k are getting transferred properly. Smaller
files have 0 byte file size.
2. Debug logs shows that lftp downloaded data for the files correctly. It
also renamed them.

Additional tests on fuse mounted hdfs.
- I created a file with a temp file name, written the data to it, then
renamed the file and finally closed the output stream. In this case it
creates a 0 byte file.
- I created a file with a temp file name, written the data to it, closed
the file and then renamed the file. In this case it creates the file
correctly.


Can someone please look into this issue, it might be possible that stream
is closed after the file is renamed.

Thanks,
Akshay

--f46d041826189819f905044407fe
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,<div><br></div><div><div>I am trying to mirror files on=
 Fuse mounted hdfs file system (<a href=3D"https://wiki.apache.org/hadoop/M=
ountableHDFS">https://wiki.apache.org/hadoop/MountableHDFS</a>). Lftp is cr=
eating some 0 byte files.=C2=A0</div><div><br></div><div>Observations:=C2=
=A0</div><div>1. Files of size larger then 64k are getting transferred prop=
erly. Smaller files have 0 byte file size.</div><div>2. Debug logs shows th=
at lftp downloaded data for the files correctly. It also renamed them.=C2=
=A0</div><div><br></div><div>Additional tests on fuse mounted hdfs.</div><d=
iv>- I created a file with a temp file name, written the data to it, then r=
enamed the file and finally closed the output stream. In this case it creat=
es a 0 byte file.</div><div>- I created a file with a temp file name, writt=
en the data to it, closed the file and then renamed the file. In this case =
it creates the file correctly.</div><div><br></div><div><br></div><div>Can =
someone please look into this issue, it might be possible that stream is cl=
osed after the file is renamed.</div><div><br></div><div>Thanks,</div><div>=
Akshay</div><div>=C2=A0</div><div>=C2=A0<br></div></div></div>

--f46d041826189819f905044407fe--

--===============4183649052996986876==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
lftp mailing list
[email protected]
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

--===============4183649052996986876==--