Re: possible bug in lftp mirror using xfer:use-temp-file option

Alexander Lukyanov <[email protected]> Tue, 30 Sep 2014 19:45:17 +0400
Newsgroups gmane.network.lftp.user,gmane.network.lftp.devel
Message-ID <CANnoEwqNETj+PjgSEy7uoKcuuNh0bxSF2GrkmnQSEjnpcjwM=w@mail.gmail.com>
--===============5882516421935782644==
Content-Type: multipart/alternative; boundary=047d7b5d436e1d7bd905044a4530

--047d7b5d436e1d7bd905044a4530
Content-Type: text/plain; charset=UTF-8

In unix it is usually allowed to rename open files, so lftp does that. I'll
see if it is possible to reverse the order.

2014-09-30 12:18 GMT+04:00 akshay gupta <[email protected]>:

> Hi,
>
> I am trying to mirror files on Fuse mounted hdfs file system (
> https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0
> byte files.
>
> Observations:
> 1. Files of size larger then 64k are getting transferred properly. Smaller
> files have 0 byte file size.
> 2. Debug logs shows that lftp downloaded data for the files correctly. It
> also renamed them.
>
> Additional tests on fuse mounted hdfs.
> - I created a file with a temp file name, written the data to it, then
> renamed the file and finally closed the output stream. In this case it
> creates a 0 byte file.
> - I created a file with a temp file name, written the data to it, closed
> the file and then renamed the file. In this case it creates the file
> correctly.
>
>
> Can someone please look into this issue, it might be possible that stream
> is closed after the file is renamed.
>
> Thanks,
> Akshay
>
>
>



-- 
   Alexander.

--047d7b5d436e1d7bd905044a4530
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">In unix it is usually allowed to rename open files, so lft=
p does that. I&#39;ll see if it is possible to reverse the order.<br></div>=
<div class=3D"gmail_extra"><br><div class=3D"gmail_quote">2014-09-30 12:18 =
GMT+04:00 akshay gupta <span dir=3D"ltr">&lt;<a href=3D"mailto:akshaygupta2=
[email protected]" target=3D"_blank">[email protected]</a>&gt;</span>:<br=
><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1=
px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,<div><br></div><div><di=
v>I am trying to mirror files on Fuse mounted hdfs file system (<a href=3D"=
https://wiki.apache.org/hadoop/MountableHDFS" target=3D"_blank">https://wik=
i.apache.org/hadoop/MountableHDFS</a>). Lftp is creating some 0 byte files.=
=C2=A0</div><div><br></div><div>Observations:=C2=A0</div><div>1. Files of s=
ize larger then 64k are getting transferred properly. Smaller files have 0 =
byte file size.</div><div>2. Debug logs shows that lftp downloaded data for=
 the files correctly. It also renamed them.=C2=A0</div><div><br></div><div>=
Additional tests on fuse mounted hdfs.</div><div>- I created a file with a =
temp file name, written the data to it, then renamed the file and finally c=
losed the output stream. In this case it creates a 0 byte file.</div><div>-=
 I created a file with a temp file name, written the data to it, closed the=
 file and then renamed the file. In this case it creates the file correctly=
.</div><div><br></div><div><br></div><div>Can someone please look into this=
 issue, it might be possible that stream is closed after the file is rename=
d.</div><div><br></div><div>Thanks,</div><div>Akshay</div><div>=C2=A0</div>=
<div>=C2=A0<br></div></div></div>
</blockquote></div><br><br clear=3D"all"><br>-- <br><div dir=3D"ltr"><div><=
/div>=C2=A0=C2=A0 Alexander.<br></div>
</div>

--047d7b5d436e1d7bd905044a4530--

--===============5882516421935782644==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
lftp mailing list
[email protected]
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

--===============5882516421935782644==--