Re: possible bug in lftp mirror using xfer:use-temp-file option

Juan Simón <[email protected]> Tue, 30 Sep 2014 21:38:48 +0200
Newsgroups gmane.network.lftp.user,gmane.network.lftp.devel
Message-ID <CAMQzBqDcmd6ii=Y+6zFcCJDei0_JTrmJDOgLFcfO3QXEN_q0Gw@mail.gmail.com>
--===============4911611112674681957==
Content-Type: multipart/alternative; boundary=089e0122aece3c290405044d887a

--089e0122aece3c290405044d887a
Content-Type: text/plain; charset=ISO-8859-1

In which LFTP version exists this option (xfer:use-temp-file)?

2014-09-30 19:05 GMT+02:00 akshay gupta <[email protected]>:

> Its causing unpredictable behaviour in case of fuse mounted file system.
> Please look into it if it can be resolved.
>
> Thanks for the quick response.
>
> ~Akshay
>
> On Tue, Sep 30, 2014 at 9:15 PM, Alexander Lukyanov <[email protected]>
> wrote:
>
>> In unix it is usually allowed to rename open files, so lftp does that.
>> I'll see if it is possible to reverse the order.
>>
>> 2014-09-30 12:18 GMT+04:00 akshay gupta <[email protected]>:
>>
>>> Hi,
>>>
>>> I am trying to mirror files on Fuse mounted hdfs file system (
>>> https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0
>>> byte files.
>>>
>>> Observations:
>>> 1. Files of size larger then 64k are getting transferred properly.
>>> Smaller files have 0 byte file size.
>>> 2. Debug logs shows that lftp downloaded data for the files correctly.
>>> It also renamed them.
>>>
>>> Additional tests on fuse mounted hdfs.
>>> - I created a file with a temp file name, written the data to it, then
>>> renamed the file and finally closed the output stream. In this case it
>>> creates a 0 byte file.
>>> - I created a file with a temp file name, written the data to it, closed
>>> the file and then renamed the file. In this case it creates the file
>>> correctly.
>>>
>>>
>>> Can someone please look into this issue, it might be possible that
>>> stream is closed after the file is renamed.
>>>
>>> Thanks,
>>> Akshay
>>>
>>>
>>>
>>
>>
>>
>> --
>>    Alexander.
>>
>
>
> _______________________________________________
> lftp mailing list
> [email protected]
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
>

--089e0122aece3c290405044d887a
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_default" style=3D"font-family:verdana,=
sans-serif">In which LFTP version exists this option (xfer:use-temp-file)?<=
br></div></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">20=
14-09-30 19:05 GMT+02:00 akshay gupta <span dir=3D"ltr">&lt;<a href=3D"mail=
to:[email protected]" target=3D"_blank">[email protected]</a>=
&gt;</span>:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8e=
x;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Its causing=
 unpredictable behaviour in case of fuse mounted file system. Please look i=
nto it if it can be resolved.<div><br></div><div>Thanks for the quick respo=
nse.</div><div><br></div><div>~Akshay=A0</div></div><div class=3D"gmail_ext=
ra"><br><div class=3D"gmail_quote">On Tue, Sep 30, 2014 at 9:15 PM, Alexand=
er Lukyanov <span dir=3D"ltr">&lt;<a href=3D"mailto:[email protected]" targ=
et=3D"_blank">[email protected]</a>&gt;</span> wrote:<br><blockquote class=
=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padd=
ing-left:1ex"><div dir=3D"ltr">In unix it is usually allowed to rename open=
 files, so lftp does that. I&#39;ll see if it is possible to reverse the or=
der.<br></div><div class=3D"gmail_extra"><div><div><br><div class=3D"gmail_=
quote">2014-09-30 12:18 GMT+04:00 akshay gupta <span dir=3D"ltr">&lt;<a hre=
f=3D"mailto:[email protected]" target=3D"_blank">akshaygupta202@gmai=
l.com</a>&gt;</span>:<br><blockquote class=3D"gmail_quote" style=3D"margin:=
0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi=
,<div><br></div><div><div>I am trying to mirror files on Fuse mounted hdfs =
file system (<a href=3D"https://wiki.apache.org/hadoop/MountableHDFS" targe=
t=3D"_blank">https://wiki.apache.org/hadoop/MountableHDFS</a>). Lftp is cre=
ating some 0 byte files.=A0</div><div><br></div><div>Observations:=A0</div>=
<div>1. Files of size larger then 64k are getting transferred properly. Sma=
ller files have 0 byte file size.</div><div>2. Debug logs shows that lftp d=
ownloaded data for the files correctly. It also renamed them.=A0</div><div>=
<br></div><div>Additional tests on fuse mounted hdfs.</div><div>- I created=
 a file with a temp file name, written the data to it, then renamed the fil=
e and finally closed the output stream. In this case it creates a 0 byte fi=
le.</div><div>- I created a file with a temp file name, written the data to=
 it, closed the file and then renamed the file. In this case it creates the=
 file correctly.</div><div><br></div><div><br></div><div>Can someone please=
 look into this issue, it might be possible that stream is closed after the=
 file is renamed.</div><div><br></div><div>Thanks,</div><div>Akshay</div><d=
iv>=A0</div><div>=A0<br></div></div></div>
</blockquote></div><br><br clear=3D"all"><span class=3D"HOEnZb"><font color=
=3D"#888888"><br></font></span></div></div><span class=3D"HOEnZb"><font col=
or=3D"#888888"><span><font color=3D"#888888">-- <br><div dir=3D"ltr"><div><=
/div>=A0=A0 Alexander.<br></div>
</font></span></font></span></div>
</blockquote></div><br></div>
<br>_______________________________________________<br>
lftp mailing list<br>
<a href=3D"mailto:[email protected]">[email protected]</a><br>
<a href=3D"http://univ.uniyar.ac.ru/mailman/listinfo/lftp" target=3D"_blank=
">http://univ.uniyar.ac.ru/mailman/listinfo/lftp</a><br>
<br></blockquote></div><br></div>

--089e0122aece3c290405044d887a--

--===============4911611112674681957==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
lftp mailing list
[email protected]
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

--===============4911611112674681957==--