Fwd: Want to call librsync from Java project (2+ GB file error )

Ankit Patel <[email protected]> Tue, 7 Oct 2014 13:54:48 +0530
Newsgroups gmane.network.librsync.general
Message-ID <CAFSjEnhfACMA2X8jqW5kFzJp11X6XnwcN+3t0CevnqvUP+z0Lg@mail.gmail.com>
--===============4065442985136788409==
Content-Type: multipart/alternative; boundary=001a1133a838f46fc60504d0ef66

--001a1133a838f46fc60504d0ef66
Content-Type: text/plain; charset=UTF-8

https://github.com/librsync/librsync#note-for-windows

The PCbuild directory contains a project and pre-generated config files for
> use with the MSVC++ IDE. This should be enought to compile* rdiff.exe *without
> requiring cygwin
>
 As mention above, I have generated rdiff.exe file any how by adding some
missing dll file.

Now as mention in this doc <http://librsync.sourcefrog.net/doc/rdiff.html> ,
I used command line in window

Reproduce step for failure :
1> Take 5.95 GB file say *aa20.zip*
2> open cmd(command prompt) in window 7(i have used), Reach place where
rdiff.exe exist("D:\Rdiff Sample")
3> Ready for run three command from cmd one by one


rdiff signature "aa20.zip" "a.sig"
> rdiff delta "a.sig" "aa20.zip" "a.del"
> rdiff patch "aa20.zip" "a.del" "Newww.zip"


 - while running third command there is error on cmd

D:\Rdiff Sample>rdiff patch "aa20.zip" "a.del" "Newww.zip"

librsync: ERROR: (librsync) invalid length=-2055907320 on COPY command

librsync: ERROR: (librsync) patch job failed: stream corrupt

librsync: ERROR: stream corrupt


 -  To see more detail step while running third command i have tried (-v)
option



> *rdiff -v patch "aa20.zip" "a.del" "Newww.zip"*



Output:

D:\Rdiff Sample>rdiff *-v* patch "aa20.zip" "a.del" "Newww.zip"

librsync: (librsync) start patch job

librsync: (librsync) got 4 bytes from input buffer

librsync: (librsync) advance over 4 bytes from input buffer

librsync: (librsync) got patch magic 0x72730236

librsync: (librsync) got 1 bytes from input buffer

librsync: (librsync) advance over 1 bytes from input buffer

librsync: (librsync) got command byte 0x47 (COPY), len_1=1

librsync: (librsync) got 5 bytes from input buffer

librsync: (librsync) got 1 bytes from input buffer

librsync: (librsync) advance over 1 bytes from input buffer

librsync: (librsync) got 4 bytes from input buffer

librsync: (librsync) advance over 4 bytes from input buffer

librsync: (librsync) running command 0x47, kind 1003

librsync: (librsync) COPY(where=0, len=-2055907320)

librsync: ERROR: (librsync) invalid length=-2055907320 on COPY command

librsync: ERROR: (librsync) patch job failed: stream corrupt

librsync: ERROR: stream corrupt


NOTE:

   -   This bug also generated with *2.08 GB (2,239,059,976 bytes) *file
   (.zip)


- ankit patel

=========================================================================================
On 6 October 2014 23:12, Martin Pool <[email protected]> wrote:

>
>
> On Mon, Oct 6, 2014 at 7:11 AM, Ankit Patel <[email protected]>
> wrote:
>
>> When i am tested with 5GB file following error comes .. please help!
>> ===============================
>> rdiff.exe signature "aa5.zip" "aT1.sig"
>> TIME : 67s
>> T1: sign created
>>
>> rdiff.exe delta "aT1.sig" "aa5.zip" "aT1.del"
>> TIME : 407s
>> T1: delta created
>>
>>
>>  rdiff.exe patch "aa5.zip" "aT1.del" "T1.zip"
>> TIME : 2s
>>
>> librsync: ERROR: (librsync) invalid where=-886732800 on COPY command
>> librsync: ERROR: (librsync) patch job failed: stream corrupt
>> librsync: ERROR: stream corrupt
>>
>> -Ankit
>>
>
> Please file a bug with complete instructions how to reproduce the failure.
>
>
>
>
> --
> Martin
>

--001a1133a838f46fc60504d0ef66
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_quote"><br><div dir=3D"ltr"><a href=3D=
"https://github.com/librsync/librsync#note-for-windows" target=3D"_blank">h=
ttps://github.com/librsync/librsync#note-for-windows</a></div><div dir=3D"l=
tr"><br><blockquote style=3D"margin:0 0 0 40px;border:none;padding:0px"><di=
v><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;borde=
r-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid=
;padding-left:1ex"><span style=3D"color:rgb(51,51,51);font-family:&#39;Helv=
etica Neue&#39;,Helvetica,&#39;Segoe UI&#39;,Arial,freesans,sans-serif;font=
-size:16.3636360168457px;line-height:23.2727279663086px">The PCbuild direct=
ory contains a project and pre-generated config files for use with the MSVC=
++ IDE. This should be enought to compile</span><b style=3D"color:rgb(51,51=
,51);font-family:&#39;Helvetica Neue&#39;,Helvetica,&#39;Segoe UI&#39;,Aria=
l,freesans,sans-serif;font-size:16.3636360168457px;line-height:23.272727966=
3086px"> rdiff.exe </b><span style=3D"color:rgb(51,51,51);font-family:&#39;=
Helvetica Neue&#39;,Helvetica,&#39;Segoe UI&#39;,Arial,freesans,sans-serif;=
font-size:16.3636360168457px;line-height:23.2727279663086px">without requir=
ing cygwin<br></span></blockquote></div></blockquote><div><div>=C2=A0As men=
tion above, I have generated rdiff.exe file any how by adding some missing =
dll file.</div></div><div><br>Now as mention in <a href=3D"http://librsync.=
sourcefrog.net/doc/rdiff.html" target=3D"_blank">this doc</a>=C2=A0, I used=
 command line in window=C2=A0<br><br>Reproduce step for failure :<br>1&gt; =
Take 5.95 GB file say=C2=A0<b>aa20.zip</b></div><div>2&gt; open cmd(command=
 prompt) in window 7(i have used), Reach place where rdiff.exe exist(&quot;=
D:\Rdiff Sample&quot;)=C2=A0<br>3&gt; Ready for run three command from cmd =
one by one</div><div><blockquote style=3D"margin:0px 0px 0px 40px;border:no=
ne;padding:0px"><div><br></div><div><blockquote class=3D"gmail_quote" style=
=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(20=
4,204,204);border-left-style:solid;padding-left:1ex">rdiff signature &quot;=
aa20.zip&quot; &quot;a.sig&quot;<br>rdiff delta &quot;a.sig&quot; &quot;aa2=
0.zip&quot; &quot;a.del&quot;<br>rdiff patch &quot;aa20.zip&quot; &quot;a.d=
el&quot; &quot;Newww.zip&quot;</blockquote></div></blockquote></div><div><d=
iv><br></div><div>=C2=A0- while running third command there is error on cmd=
=C2=A0<br><br></div></div><blockquote style=3D"margin:0px 0px 0px 40px;bord=
er:none;padding:0px"><div><blockquote class=3D"gmail_quote" style=3D"margin=
:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204)=
;border-left-style:solid;padding-left:1ex">D:\Rdiff Sample&gt;rdiff patch &=
quot;aa20.zip&quot; &quot;a.del&quot; &quot;Newww.zip&quot;</blockquote></d=
iv><div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex=
;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style=
:solid;padding-left:1ex">librsync: ERROR: (librsync) invalid length=3D-2055=
907320 on COPY command</blockquote></div><div><blockquote class=3D"gmail_qu=
ote" style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-co=
lor:rgb(204,204,204);border-left-style:solid;padding-left:1ex">librsync: ER=
ROR: (librsync) patch job failed: stream corrupt</blockquote></div><div><bl=
ockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-lef=
t-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padd=
ing-left:1ex">librsync: ERROR: stream corrupt</blockquote></div></blockquot=
e><div><div><br></div></div><div>=C2=A0- =C2=A0To see more detail step whil=
e running third command i have tried (-v) option<br></div><blockquote style=
=3D"margin:0px 0px 0px 40px;border:none;padding:0px"><div><div>=C2=A0</div>=
<blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-=
left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;p=
adding-left:1ex"><b>rdiff -v patch &quot;aa20.zip&quot; &quot;a.del&quot; &=
quot;Newww.zip&quot;</b></blockquote><div>=C2=A0</div></div></blockquote><b=
lockquote style=3D"margin:0px 0px 0px 40px;border:none;padding:0px"><div>Ou=
tput:<br><br></div></blockquote><blockquote style=3D"margin:0px 0px 0px 40p=
x;border:none;padding:0px"><div><blockquote class=3D"gmail_quote" style=3D"=
margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,20=
4,204);border-left-style:solid;padding-left:1ex">D:\Rdiff Sample&gt;rdiff <=
b>-v</b> patch &quot;aa20.zip&quot; &quot;a.del&quot; &quot;Newww.zip&quot;=
</blockquote></div><div><blockquote class=3D"gmail_quote" style=3D"margin:0=
px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);b=
order-left-style:solid;padding-left:1ex">librsync: (librsync) start patch j=
ob</blockquote></div><div><blockquote class=3D"gmail_quote" style=3D"margin=
:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204)=
;border-left-style:solid;padding-left:1ex">librsync: (librsync) got 4 bytes=
 from input buffer</blockquote></div><div><blockquote class=3D"gmail_quote"=
 style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:=
rgb(204,204,204);border-left-style:solid;padding-left:1ex">librsync: (librs=
ync) advance over 4 bytes from input buffer</blockquote></div><div><blockqu=
ote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left-wid=
th:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-l=
eft:1ex">librsync: (librsync) got patch magic 0x72730236</blockquote></div>=
<div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bo=
rder-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:so=
lid;padding-left:1ex">librsync: (librsync) got 1 bytes from input buffer</b=
lockquote></div><div><blockquote class=3D"gmail_quote" style=3D"margin:0px =
0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);bord=
er-left-style:solid;padding-left:1ex">librsync: (librsync) advance over 1 b=
ytes from input buffer</blockquote></div><div><blockquote class=3D"gmail_qu=
ote" style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-co=
lor:rgb(204,204,204);border-left-style:solid;padding-left:1ex">librsync: (l=
ibrsync) got command byte 0x47 (COPY), len_1=3D1</blockquote></div><div><bl=
ockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-lef=
t-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padd=
ing-left:1ex">librsync: (librsync) got 5 bytes from input buffer</blockquot=
e></div><div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px =
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-=
style:solid;padding-left:1ex">librsync: (librsync) got 1 bytes from input b=
uffer</blockquote></div><div><blockquote class=3D"gmail_quote" style=3D"mar=
gin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,2=
04);border-left-style:solid;padding-left:1ex">librsync: (librsync) advance =
over 1 bytes from input buffer</blockquote></div><div><blockquote class=3D"=
gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border=
-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">libr=
sync: (librsync) got 4 bytes from input buffer</blockquote></div><div><bloc=
kquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left-=
width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;paddin=
g-left:1ex">librsync: (librsync) advance over 4 bytes from input buffer</bl=
ockquote></div><div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0=
px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);borde=
r-left-style:solid;padding-left:1ex">librsync: (librsync) running command 0=
x47, kind 1003</blockquote></div><div><blockquote class=3D"gmail_quote" sty=
le=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(=
204,204,204);border-left-style:solid;padding-left:1ex">librsync: (librsync)=
 COPY(where=3D0, len=3D-2055907320)</blockquote></div><div><blockquote clas=
s=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;b=
order-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"=
>librsync: ERROR: (librsync) invalid length=3D-2055907320 on COPY command</=
blockquote></div><div><blockquote class=3D"gmail_quote" style=3D"margin:0px=
 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);bor=
der-left-style:solid;padding-left:1ex">librsync: ERROR: (librsync) patch jo=
b failed: stream corrupt</blockquote></div><div><blockquote class=3D"gmail_=
quote" style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-=
color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">librsync: =
ERROR: stream corrupt</blockquote></div></blockquote><div class=3D"gmail_ex=
tra"><br>NOTE:</div><div class=3D"gmail_extra"><ul><li>=C2=A0 This bug also=
 generated with=C2=A0<b>2.08 GB (2,239,059,976 bytes) </b>file (.zip)=C2=A0=
<br></li></ul></div><div class=3D"gmail_extra"><br></div><div class=3D"gmai=
l_extra">- ankit patel</div><div class=3D"gmail_extra"><br></div><div class=
=3D"gmail_extra">=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br><div class=
=3D"gmail_quote">On 6 October 2014 23:12, Martin Pool <span dir=3D"ltr">&lt=
;<a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]=
</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin=
:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204)=
;border-left-style:solid;padding-left:1ex"><div dir=3D"ltr"><br><div class=
=3D"gmail_extra"><br><div class=3D"gmail_quote"><div><div>On Mon, Oct 6, 20=
14 at 7:11 AM, Ankit Patel <span dir=3D"ltr">&lt;<a href=3D"mailto:ankit.v.=
[email protected]" target=3D"_blank">[email protected]</a>&gt;</span> w=
rote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8e=
x;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-styl=
e:solid;padding-left:1ex"><div dir=3D"ltr">When i am tested with 5GB file f=
ollowing error comes .. please help!<br>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>rdiff.exe s=
ignature &quot;aa5.zip&quot; &quot;aT1.sig&quot;<div>TIME : 67s<br>T1: sign=
 created=C2=A0<br><br><div>rdiff.exe delta &quot;aT1.sig&quot; &quot;aa5.zi=
p&quot; &quot;aT1.del&quot;<br></div><div>TIME : 407s<br></div><div>T1: del=
ta created=C2=A0<br><br><br>=C2=A0rdiff.exe patch &quot;aa5.zip&quot; &quot=
;aT1.del&quot; &quot;T1.zip&quot;</div><div>TIME : 2s=C2=A0<br><br><font co=
lor=3D"#cc0000">librsync: ERROR: (librsync) invalid where=3D-886732800 on C=
OPY command<br>librsync: ERROR: (librsync) patch job failed: stream corrupt=
<br>librsync: ERROR: stream corrupt</font></div></div><span><font color=3D"=
#888888"><div><font color=3D"#cc0000"><br></font></div><div>-Ankit</div></f=
ont></span></div></blockquote><div><br></div></div></div><div>Please file a=
 bug with complete instructions how to reproduce the failure.</div><span><f=
ont color=3D"#888888"><div>=C2=A0</div></font></span></div><span><font colo=
r=3D"#888888"><br><br clear=3D"all"><span class=3D"HOEnZb"><font color=3D"#=
888888"><div><br></div>-- <br>Martin<br>
</font></span></font></span></div></div>
</blockquote></div><br></div></div>
</div><br></div>

--001a1133a838f46fc60504d0ef66--


--===============4065442985136788409==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
--===============4065442985136788409==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
librsync-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/librsync-users

--===============4065442985136788409==--