Re: possible bug in lftp mirror using xfer:use-temp-file option

--===============4340812736801569083==
Content-Type: multipart/alternative; boundary=089e01493c54f956ef05045749a6

--089e01493c54f956ef05045749a6
Content-Type: text/plain; charset=UTF-8

This option (xfer:use-temp-file) is available in development snapshot
http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140919.tar.gz.

On Tue, Sep 30, 2014 at 10:35 PM, akshay gupta <[email protected]>
wrote:

> Its causing unpredictable behaviour in case of fuse mounted file system.
> Please look into it if it can be resolved.
>
> Thanks for the quick response.
>
> ~Akshay
>
> On Tue, Sep 30, 2014 at 9:15 PM, Alexander Lukyanov <[email protected]>
> wrote:
>
>> In unix it is usually allowed to rename open files, so lftp does that.
>> I'll see if it is possible to reverse the order.
>>
>> 2014-09-30 12:18 GMT+04:00 akshay gupta <[email protected]>:
>>
>>> Hi,
>>>
>>> I am trying to mirror files on Fuse mounted hdfs file system (
>>> https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0
>>> byte files.
>>>
>>> Observations:
>>> 1. Files of size larger then 64k are getting transferred properly.
>>> Smaller files have 0 byte file size.
>>> 2. Debug logs shows that lftp downloaded data for the files correctly.
>>> It also renamed them.
>>>
>>> Additional tests on fuse mounted hdfs.
>>> - I created a file with a temp file name, written the data to it, then
>>> renamed the file and finally closed the output stream. In this case it
>>> creates a 0 byte file.
>>> - I created a file with a temp file name, written the data to it, closed
>>> the file and then renamed the file. In this case it creates the file
>>> correctly.
>>>
>>>
>>> Can someone please look into this issue, it might be possible that
>>> stream is closed after the file is renamed.
>>>
>>> Thanks,
>>> Akshay
>>>
>>>
>>>
>>
>>
>>
>> --
>>    Alexander.
>>
>
>

--089e01493c54f956ef05045749a6
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">This=C2=A0<span style=3D"color:rgb(0,0,0);font-family:cour=
ier,&#39;courier new&#39;,monospace;font-size:14px;line-height:19px;white-s=
pace:pre-wrap">option (xfer:use-temp-file)</span>=C2=A0is available in deve=
lopment snapshot=C2=A0<a href=3D"http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20=
140919.tar.gz">http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140919.tar.gz</a>.=
<br></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Tue,=
 Sep 30, 2014 at 10:35 PM, akshay gupta <span dir=3D"ltr">&lt;<a href=3D"ma=
ilto:[email protected]" target=3D"_blank">[email protected]</=
a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0=
 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Its=
 causing unpredictable behaviour in case of fuse mounted file system. Pleas=
e look into it if it can be resolved.<div><br></div><div>Thanks for the qui=
ck response.</div><span class=3D"HOEnZb"><font color=3D"#888888"><div><br><=
/div><div>~Akshay=C2=A0</div></font></span></div><div class=3D"HOEnZb"><div=
 class=3D"h5"><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On =
Tue, Sep 30, 2014 at 9:15 PM, Alexander Lukyanov <span dir=3D"ltr">&lt;<a h=
ref=3D"mailto:[email protected]" target=3D"_blank">[email protected]</a>&gt=
;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">In unix =
it is usually allowed to rename open files, so lftp does that. I&#39;ll see=
 if it is possible to reverse the order.<br></div><div class=3D"gmail_extra=
"><div><div><br><div class=3D"gmail_quote">2014-09-30 12:18 GMT+04:00 aksha=
y gupta <span dir=3D"ltr">&lt;<a href=3D"mailto:[email protected]" t=
arget=3D"_blank">[email protected]</a>&gt;</span>:<br><blockquote cl=
ass=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;p=
adding-left:1ex"><div dir=3D"ltr">Hi,<div><br></div><div><div>I am trying t=
o mirror files on Fuse mounted hdfs file system (<a href=3D"https://wiki.ap=
ache.org/hadoop/MountableHDFS" target=3D"_blank">https://wiki.apache.org/ha=
doop/MountableHDFS</a>). Lftp is creating some 0 byte files.=C2=A0</div><di=
v><br></div><div>Observations:=C2=A0</div><div>1. Files of size larger then=
 64k are getting transferred properly. Smaller files have 0 byte file size.=
</div><div>2. Debug logs shows that lftp downloaded data for the files corr=
ectly. It also renamed them.=C2=A0</div><div><br></div><div>Additional test=
s on fuse mounted hdfs.</div><div>- I created a file with a temp file name,=
 written the data to it, then renamed the file and finally closed the outpu=
t stream. In this case it creates a 0 byte file.</div><div>- I created a fi=
le with a temp file name, written the data to it, closed the file and then =
renamed the file. In this case it creates the file correctly.</div><div><br=
></div><div><br></div><div>Can someone please look into this issue, it migh=
t be possible that stream is closed after the file is renamed.</div><div><b=
r></div><div>Thanks,</div><div>Akshay</div><div>=C2=A0</div><div>=C2=A0<br>=
</div></div></div>
</blockquote></div><br><br clear=3D"all"><br></div></div><span><font color=
=3D"#888888">-- <br><div dir=3D"ltr"><div></div>=C2=A0=C2=A0 Alexander.<br>=
</div>
</font></span></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>

--089e01493c54f956ef05045749a6--

--===============4340812736801569083==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
lftp mailing list
[email protected]
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

--===============4340812736801569083==--