Re: Bug in lftp mirror when using xfer:use-temp-file option
akshay gupta <[email protected]> Tue, 28 Oct 2014 12:59:40 +0530
| Newsgroups | gmane.network.lftp.user,gmane.network.lftp.devel |
|---|---|
| Message-ID | <CAB_qc71-t0TBZaqPtY82TipjuYf=L0Mm2-v2FUxnXXgQSM9mQg@mail.gmail.com> |
--===============0643897174846796982== Content-Type: multipart/alternative; boundary=047d7b6d9a8666a8ef0506769da1 --047d7b6d9a8666a8ef0506769da1 Content-Type: text/plain; charset=UTF-8 will giving --delete-first option in lftp mirror help in my case? I think its not working in case of use-temp-file option. As per the man page its suppose to delete the old version of the file before it start downloading the new one. Its not doing anything. Please help. On Mon, Oct 27, 2014 at 11:50 PM, akshay gupta <[email protected]> wrote: > I am using fuse mounted hadoop distributed file system(HDFS). Can you > suggest what changes need to be done to make it work as this is a very > critical requirement for my project. Will deleting file and then renaming > temp file help? how to achieve that? > > On Mon, Oct 27, 2014 at 7:38 PM, Alexander V. Lukyanov <[email protected]> > wrote: > >> On Mon, Oct 27, 2014 at 05:53:19PM +0530, akshay gupta wrote: >> > now its producing 0 byte files and i am also getting input/output error >> > here are the debug logs: >> > >> > copy: renaming `/mount/user/tom/test.txt_tmp_' to `test.txt' >> > mirror: rename(/mount/user/tom/test.txt_tmp_, /mount/user/tom/test.txt): >> > Input/output error >> >> Which filesystem do you use? Maybe it is necessary to unlink target file >> before renaming, although rename should do it automatically. >> >> If newpath already exists it will be atomically replaced (subject >> to a >> few conditions; see ERRORS below), so that there is no point at >> which >> another process attempting to access newpath will find it missing. >> >> And man page for rename(2) does not list EIO error. >> >> -- >> Alexander. >> > > --047d7b6d9a8666a8ef0506769da1 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr">will giving --delete-first option in lftp mirror help in m= y case? I think its not working in case of use-temp-file option. As per the= man page its suppose to delete the old version of the file before it start= downloading the new one. Its not doing anything. Please help.<div><br></di= v></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Mon, O= ct 27, 2014 at 11:50 PM, akshay gupta <span dir=3D"ltr"><<a href=3D"mail= to:[email protected]" target=3D"_blank">[email protected]</a>= ></span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0= 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">I am = using fuse mounted hadoop distributed file system(HDFS). Can you suggest wh= at changes need to be done to make it work as this is a very critical requi= rement for my project. Will deleting file and then renaming temp file help?= how to achieve that?</div><div class=3D"HOEnZb"><div class=3D"h5"><div cla= ss=3D"gmail_extra"><br><div class=3D"gmail_quote">On Mon, Oct 27, 2014 at 7= :38 PM, Alexander V. Lukyanov <span dir=3D"ltr"><<a href=3D"mailto:lav@n= etis.ru" target=3D"_blank">[email protected]</a>></span> wrote:<br><blockquot= e class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc sol= id;padding-left:1ex"><span>On Mon, Oct 27, 2014 at 05:53:19PM +0530, akshay= gupta wrote:<br> > now its producing 0 byte files and i am also getting input/output erro= r<br> > here are the debug logs:<br> ><br> </span><span>> copy: renaming `/mount/user/tom/test.txt_tmp_' to `te= st.txt'<br> > mirror: rename(/mount/user/tom/test.txt_tmp_, /mount/user/tom/test.txt= ):<br> > Input/output error<br> <br> </span>Which filesystem do you use? Maybe it is necessary to unlink target = file<br> before renaming, although rename should do it automatically.<br> <br> =C2=A0 =C2=A0 =C2=A0 =C2=A0If=C2=A0 newpath already exists it will be atomi= cally replaced (subject to a<br> =C2=A0 =C2=A0 =C2=A0 =C2=A0few conditions; see ERRORS below), so that there= is no point=C2=A0 at=C2=A0 which<br> =C2=A0 =C2=A0 =C2=A0 =C2=A0another process attempting to access newpath wil= l find it missing.<br> <br> And man page for rename(2) does not list EIO error.<br> <span><font color=3D"#888888"><br> --<br> =C2=A0 =C2=A0Alexander.<br> </font></span></blockquote></div><br></div> </div></div></blockquote></div><br></div> --047d7b6d9a8666a8ef0506769da1-- --===============0643897174846796982== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ lftp mailing list [email protected] http://univ.uniyar.ac.ru/mailman/listinfo/lftp --===============0643897174846796982==--