Re: possible bug in lftp mirror using xfer:use-temp-file option

--===============8436277700336841665==
Content-Type: multipart/alternative; boundary=089e01493c54c7c2c405045766f7

--089e01493c54c7c2c405045766f7
Content-Type: text/plain; charset=UTF-8

I am using this feature to know whether a file is completely transferred or
lftp is still downloading this file.

On Wed, Oct 1, 2014 at 12:46 PM, akshay gupta <[email protected]>
wrote:

> This option (xfer:use-temp-file) is available in development snapshot
> http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140919.tar.gz.
>
> On Tue, Sep 30, 2014 at 10:35 PM, akshay gupta <[email protected]>
> wrote:
>
>> Its causing unpredictable behaviour in case of fuse mounted file system.
>> Please look into it if it can be resolved.
>>
>> Thanks for the quick response.
>>
>> ~Akshay
>>
>> On Tue, Sep 30, 2014 at 9:15 PM, Alexander Lukyanov <[email protected]>
>> wrote:
>>
>>> In unix it is usually allowed to rename open files, so lftp does that.
>>> I'll see if it is possible to reverse the order.
>>>
>>> 2014-09-30 12:18 GMT+04:00 akshay gupta <[email protected]>:
>>>
>>>> Hi,
>>>>
>>>> I am trying to mirror files on Fuse mounted hdfs file system (
>>>> https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0
>>>> byte files.
>>>>
>>>> Observations:
>>>> 1. Files of size larger then 64k are getting transferred properly.
>>>> Smaller files have 0 byte file size.
>>>> 2. Debug logs shows that lftp downloaded data for the files correctly.
>>>> It also renamed them.
>>>>
>>>> Additional tests on fuse mounted hdfs.
>>>> - I created a file with a temp file name, written the data to it, then
>>>> renamed the file and finally closed the output stream. In this case it
>>>> creates a 0 byte file.
>>>> - I created a file with a temp file name, written the data to it,
>>>> closed the file and then renamed the file. In this case it creates the file
>>>> correctly.
>>>>
>>>>
>>>> Can someone please look into this issue, it might be possible that
>>>> stream is closed after the file is renamed.
>>>>
>>>> Thanks,
>>>> Akshay
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>>    Alexander.
>>>
>>
>>
>

--089e01493c54c7c2c405045766f7
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I am using this feature to know whether a file is complete=
ly transferred or lftp is still downloading this file. =C2=A0</div><div cla=
ss=3D"gmail_extra"><br><div class=3D"gmail_quote">On Wed, Oct 1, 2014 at 12=
:46 PM, akshay gupta <span dir=3D"ltr">&lt;<a href=3D"mailto:akshaygupta202=
@gmail.com" target=3D"_blank">[email protected]</a>&gt;</span> wrote=
:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-le=
ft:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">This=C2=A0<span style=
=3D"color:rgb(0,0,0);font-family:courier,&#39;courier new&#39;,monospace;fo=
nt-size:14px;line-height:19px;white-space:pre-wrap">option (xfer:use-temp-f=
ile)</span>=C2=A0is available in development snapshot=C2=A0<a href=3D"http:=
//lftp.yar.ru/ftp/devel/lftp-4.5.5.20140919.tar.gz" target=3D"_blank">http:=
//lftp.yar.ru/ftp/devel/lftp-4.5.5.20140919.tar.gz</a>.<br></div><div class=
=3D"HOEnZb"><div class=3D"h5"><div class=3D"gmail_extra"><br><div class=3D"=
gmail_quote">On Tue, Sep 30, 2014 at 10:35 PM, akshay gupta <span dir=3D"lt=
r">&lt;<a href=3D"mailto:[email protected]" target=3D"_blank">akshay=
[email protected]</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quot=
e" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">=
<div dir=3D"ltr">Its causing unpredictable behaviour in case of fuse mounte=
d file system. Please look into it if it can be resolved.<div><br></div><di=
v>Thanks for the quick response.</div><span><font color=3D"#888888"><div><b=
r></div><div>~Akshay=C2=A0</div></font></span></div><div><div><div class=3D=
"gmail_extra"><br><div class=3D"gmail_quote">On Tue, Sep 30, 2014 at 9:15 P=
M, Alexander Lukyanov <span dir=3D"ltr">&lt;<a href=3D"mailto:lavv17f@gmail=
.com" target=3D"_blank">[email protected]</a>&gt;</span> wrote:<br><blockqu=
ote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc s=
olid;padding-left:1ex"><div dir=3D"ltr">In unix it is usually allowed to re=
name open files, so lftp does that. I&#39;ll see if it is possible to rever=
se the order.<br></div><div class=3D"gmail_extra"><div><div><br><div class=
=3D"gmail_quote">2014-09-30 12:18 GMT+04:00 akshay gupta <span dir=3D"ltr">=
&lt;<a href=3D"mailto:[email protected]" target=3D"_blank">akshaygup=
[email protected]</a>&gt;</span>:<br><blockquote class=3D"gmail_quote" style=
=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=
=3D"ltr">Hi,<div><br></div><div><div>I am trying to mirror files on Fuse mo=
unted hdfs file system (<a href=3D"https://wiki.apache.org/hadoop/Mountable=
HDFS" target=3D"_blank">https://wiki.apache.org/hadoop/MountableHDFS</a>). =
Lftp is creating some 0 byte files.=C2=A0</div><div><br></div><div>Observat=
ions:=C2=A0</div><div>1. Files of size larger then 64k are getting transfer=
red properly. Smaller files have 0 byte file size.</div><div>2. Debug logs =
shows that lftp downloaded data for the files correctly. It also renamed th=
em.=C2=A0</div><div><br></div><div>Additional tests on fuse mounted hdfs.</=
div><div>- I created a file with a temp file name, written the data to it, =
then renamed the file and finally closed the output stream. In this case it=
 creates a 0 byte file.</div><div>- I created a file with a temp file name,=
 written the data to it, closed the file and then renamed the file. In this=
 case it creates the file correctly.</div><div><br></div><div><br></div><di=
v>Can someone please look into this issue, it might be possible that stream=
 is closed after the file is renamed.</div><div><br></div><div>Thanks,</div=
><div>Akshay</div><div>=C2=A0</div><div>=C2=A0<br></div></div></div>
</blockquote></div><br><br clear=3D"all"><br></div></div><span><font color=
=3D"#888888">-- <br><div dir=3D"ltr"><div></div>=C2=A0=C2=A0 Alexander.<br>=
</div>
</font></span></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>

--089e01493c54c7c2c405045766f7--

--===============8436277700336841665==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
lftp mailing list
[email protected]
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

--===============8436277700336841665==--