Re: Bug in lftp mirror when using xfer:use-temp-file option
akshay gupta <[email protected]> Mon, 27 Oct 2014 23:50:15 +0530
| Newsgroups | gmane.network.lftp.user,gmane.network.lftp.devel |
|---|---|
| Message-ID | <CAB_qc71h6GmYHPFasoL3dr9-Bi9rqApxdxbvCtkeSDRfdQL5LA@mail.gmail.com> |
--===============9168347381388626105== Content-Type: multipart/alternative; boundary=047d7b6d9a863b149405066b96bf --047d7b6d9a863b149405066b96bf Content-Type: text/plain; charset=UTF-8 I am using fuse mounted hadoop distributed file system(HDFS). Can you suggest what changes need to be done to make it work as this is a very critical requirement for my project. Will deleting file and then renaming temp file help? how to achieve that? On Mon, Oct 27, 2014 at 7:38 PM, Alexander V. Lukyanov <[email protected]> wrote: > On Mon, Oct 27, 2014 at 05:53:19PM +0530, akshay gupta wrote: > > now its producing 0 byte files and i am also getting input/output error > > here are the debug logs: > > > > copy: renaming `/mount/user/tom/test.txt_tmp_' to `test.txt' > > mirror: rename(/mount/user/tom/test.txt_tmp_, /mount/user/tom/test.txt): > > Input/output error > > Which filesystem do you use? Maybe it is necessary to unlink target file > before renaming, although rename should do it automatically. > > If newpath already exists it will be atomically replaced (subject > to a > few conditions; see ERRORS below), so that there is no point at > which > another process attempting to access newpath will find it missing. > > And man page for rename(2) does not list EIO error. > > -- > Alexander. > --047d7b6d9a863b149405066b96bf Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr">I am using fuse mounted hadoop distributed file system(HDF= S). Can you suggest what changes need to be done to make it work as this is= a very critical requirement for my project. Will deleting file and then re= naming temp file help? how to achieve that?</div><div class=3D"gmail_extra"= ><br><div class=3D"gmail_quote">On Mon, Oct 27, 2014 at 7:38 PM, Alexander = V. Lukyanov <span dir=3D"ltr"><<a href=3D"mailto:[email protected]" target=3D= "_blank">[email protected]</a>></span> wrote:<br><blockquote class=3D"gmail_q= uote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1e= x"><span class=3D"">On Mon, Oct 27, 2014 at 05:53:19PM +0530, akshay gupta = wrote:<br> > now its producing 0 byte files and i am also getting input/output erro= r<br> > here are the debug logs:<br> ><br> </span><span class=3D"">> copy: renaming `/mount/user/tom/test.txt_tmp_&= #39; to `test.txt'<br> > mirror: rename(/mount/user/tom/test.txt_tmp_, /mount/user/tom/test.txt= ):<br> > Input/output error<br> <br> </span>Which filesystem do you use? Maybe it is necessary to unlink target = file<br> before renaming, although rename should do it automatically.<br> <br> =C2=A0 =C2=A0 =C2=A0 =C2=A0If=C2=A0 newpath already exists it will be atomi= cally replaced (subject to a<br> =C2=A0 =C2=A0 =C2=A0 =C2=A0few conditions; see ERRORS below), so that there= is no point=C2=A0 at=C2=A0 which<br> =C2=A0 =C2=A0 =C2=A0 =C2=A0another process attempting to access newpath wil= l find it missing.<br> <br> And man page for rename(2) does not list EIO error.<br> <span class=3D"HOEnZb"><font color=3D"#888888"><br> --<br> =C2=A0 =C2=A0Alexander.<br> </font></span></blockquote></div><br></div> --047d7b6d9a863b149405066b96bf-- --===============9168347381388626105== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ lftp mailing list [email protected] http://univ.uniyar.ac.ru/mailman/listinfo/lftp --===============9168347381388626105==--