Re: Bug in lftp mirror when using xfer:use-temp-file option

akshay gupta <[email protected]> Mon, 27 Oct 2014 23:50:15 +0530
Newsgroups gmane.network.lftp.user,gmane.network.lftp.devel
Message-ID <CAB_qc71h6GmYHPFasoL3dr9-Bi9rqApxdxbvCtkeSDRfdQL5LA@mail.gmail.com>
--===============9168347381388626105==
Content-Type: multipart/alternative; boundary=047d7b6d9a863b149405066b96bf

--047d7b6d9a863b149405066b96bf
Content-Type: text/plain; charset=UTF-8

I am using fuse mounted hadoop distributed file system(HDFS). Can you
suggest what changes need to be done to make it work as this is a very
critical requirement for my project. Will deleting file and then renaming
temp file help? how to achieve that?

On Mon, Oct 27, 2014 at 7:38 PM, Alexander V. Lukyanov <[email protected]> wrote:

> On Mon, Oct 27, 2014 at 05:53:19PM +0530, akshay gupta wrote:
> > now its producing 0 byte files and i am also getting input/output error
> > here are the debug logs:
> >
> > copy: renaming `/mount/user/tom/test.txt_tmp_' to `test.txt'
> > mirror: rename(/mount/user/tom/test.txt_tmp_, /mount/user/tom/test.txt):
> > Input/output error
>
> Which filesystem do you use? Maybe it is necessary to unlink target file
> before renaming, although rename should do it automatically.
>
>        If  newpath already exists it will be atomically replaced (subject
> to a
>        few conditions; see ERRORS below), so that there is no point  at
> which
>        another process attempting to access newpath will find it missing.
>
> And man page for rename(2) does not list EIO error.
>
> --
>    Alexander.
>

--047d7b6d9a863b149405066b96bf
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I am using fuse mounted hadoop distributed file system(HDF=
S). Can you suggest what changes need to be done to make it work as this is=
 a very critical requirement for my project. Will deleting file and then re=
naming temp file help? how to achieve that?</div><div class=3D"gmail_extra"=
><br><div class=3D"gmail_quote">On Mon, Oct 27, 2014 at 7:38 PM, Alexander =
V. Lukyanov <span dir=3D"ltr">&lt;<a href=3D"mailto:[email protected]" target=3D=
"_blank">[email protected]</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_q=
uote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1e=
x"><span class=3D"">On Mon, Oct 27, 2014 at 05:53:19PM +0530, akshay gupta =
wrote:<br>
&gt; now its producing 0 byte files and i am also getting input/output erro=
r<br>
&gt; here are the debug logs:<br>
&gt;<br>
</span><span class=3D"">&gt; copy: renaming `/mount/user/tom/test.txt_tmp_&=
#39; to `test.txt&#39;<br>
&gt; mirror: rename(/mount/user/tom/test.txt_tmp_, /mount/user/tom/test.txt=
):<br>
&gt; Input/output error<br>
<br>
</span>Which filesystem do you use? Maybe it is necessary to unlink target =
file<br>
before renaming, although rename should do it automatically.<br>
<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0If=C2=A0 newpath already exists it will be atomi=
cally replaced (subject to a<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0few conditions; see ERRORS below), so that there=
 is no point=C2=A0 at=C2=A0 which<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0another process attempting to access newpath wil=
l find it missing.<br>
<br>
And man page for rename(2) does not list EIO error.<br>
<span class=3D"HOEnZb"><font color=3D"#888888"><br>
--<br>
=C2=A0 =C2=A0Alexander.<br>
</font></span></blockquote></div><br></div>

--047d7b6d9a863b149405066b96bf--

--===============9168347381388626105==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
lftp mailing list
[email protected]
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

--===============9168347381388626105==--