Re: possible bug in lftp mirror using xfer:use-temp-file option

--===============3272564671974960630==
Content-Type: multipart/alternative; boundary=f46d04182618980dea05044b6503

--f46d04182618980dea05044b6503
Content-Type: text/plain; charset=UTF-8

Its causing unpredictable behaviour in case of fuse mounted file system.
Please look into it if it can be resolved.

Thanks for the quick response.

~Akshay

On Tue, Sep 30, 2014 at 9:15 PM, Alexander Lukyanov <[email protected]>
wrote:

> In unix it is usually allowed to rename open files, so lftp does that.
> I'll see if it is possible to reverse the order.
>
> 2014-09-30 12:18 GMT+04:00 akshay gupta <[email protected]>:
>
>> Hi,
>>
>> I am trying to mirror files on Fuse mounted hdfs file system (
>> https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0
>> byte files.
>>
>> Observations:
>> 1. Files of size larger then 64k are getting transferred properly.
>> Smaller files have 0 byte file size.
>> 2. Debug logs shows that lftp downloaded data for the files correctly. It
>> also renamed them.
>>
>> Additional tests on fuse mounted hdfs.
>> - I created a file with a temp file name, written the data to it, then
>> renamed the file and finally closed the output stream. In this case it
>> creates a 0 byte file.
>> - I created a file with a temp file name, written the data to it, closed
>> the file and then renamed the file. In this case it creates the file
>> correctly.
>>
>>
>> Can someone please look into this issue, it might be possible that stream
>> is closed after the file is renamed.
>>
>> Thanks,
>> Akshay
>>
>>
>>
>
>
>
> --
>    Alexander.
>

--f46d04182618980dea05044b6503
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Its causing unpredictable behaviour in case of fuse mounte=
d file system. Please look into it if it can be resolved.<div><br></div><di=
v>Thanks for the quick response.</div><div><br></div><div>~Akshay=C2=A0</di=
v></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Tue, S=
ep 30, 2014 at 9:15 PM, Alexander Lukyanov <span dir=3D"ltr">&lt;<a href=3D=
"mailto:[email protected]" target=3D"_blank">[email protected]</a>&gt;</spa=
n> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;b=
order-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">In unix it is =
usually allowed to rename open files, so lftp does that. I&#39;ll see if it=
 is possible to reverse the order.<br></div><div class=3D"gmail_extra"><div=
><div class=3D"h5"><br><div class=3D"gmail_quote">2014-09-30 12:18 GMT+04:0=
0 akshay gupta <span dir=3D"ltr">&lt;<a href=3D"mailto:akshaygupta202@gmail=
.com" target=3D"_blank">[email protected]</a>&gt;</span>:<br><blockq=
uote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc =
solid;padding-left:1ex"><div dir=3D"ltr">Hi,<div><br></div><div><div>I am t=
rying to mirror files on Fuse mounted hdfs file system (<a href=3D"https://=
wiki.apache.org/hadoop/MountableHDFS" target=3D"_blank">https://wiki.apache=
.org/hadoop/MountableHDFS</a>). Lftp is creating some 0 byte files.=C2=A0</=
div><div><br></div><div>Observations:=C2=A0</div><div>1. Files of size larg=
er then 64k are getting transferred properly. Smaller files have 0 byte fil=
e size.</div><div>2. Debug logs shows that lftp downloaded data for the fil=
es correctly. It also renamed them.=C2=A0</div><div><br></div><div>Addition=
al tests on fuse mounted hdfs.</div><div>- I created a file with a temp fil=
e name, written the data to it, then renamed the file and finally closed th=
e output stream. In this case it creates a 0 byte file.</div><div>- I creat=
ed a file with a temp file name, written the data to it, closed the file an=
d then renamed the file. In this case it creates the file correctly.</div><=
div><br></div><div><br></div><div>Can someone please look into this issue, =
it might be possible that stream is closed after the file is renamed.</div>=
<div><br></div><div>Thanks,</div><div>Akshay</div><div>=C2=A0</div><div>=C2=
=A0<br></div></div></div>
</blockquote></div><br><br clear=3D"all"><br></div></div><span class=3D"HOE=
nZb"><font color=3D"#888888">-- <br><div dir=3D"ltr"><div></div>=C2=A0=C2=
=A0 Alexander.<br></div>
</font></span></div>
</blockquote></div><br></div>

--f46d04182618980dea05044b6503--

--===============3272564671974960630==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
lftp mailing list
[email protected]
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

--===============3272564671974960630==--