Re: ra split dies with a floating point divide error when processing large file
Carter Bullard <[email protected]> Thu, 18 Oct 2018 10:36:35 +0200
| Newsgroups | gmane.network.argus |
|---|---|
| Message-ID | <[email protected]> |
--Apple-Mail-D8BF2D9F-A5A8-4AFC-9156-5209547AC6AE Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable we have found that some VM=E2=80=99s disk buffering strategies could result i= n file corruption for some clients ... maybe an issue here ... using VMWare ?= ?? I=E2=80=99m traveling and will not be back for a week or so ... will con= sult and try to get back ... Carter =09 Carter Bullard =E2=80=A2 CTO 150 E 57th Street Suite 12D New York, New York 10022-2795 Phone +1.212.588.9133 =E2=80=A2 Mobile +1.917.497.9494 > On Oct 16, 2018, at 10:36 PM, Russell Fulton <[email protected]> wro= te: >=20 > another data point I tried running rasplit on the output of an other senso= r file which is a bit smaller with the same result =E2=80=94 it ran for abou= t half an hour and then crashed. >=20 > I am copying the files off onto another machine and will try splitting the= m there. I need to free up the disk anyway! >=20 >> On 17/10/2018, at 8:00 AM, Russell Fulton <[email protected]> wrote= : >>=20 >>=20 >>=20 >>> On 16/10/2018, at 9:23 PM, Carter Bullard <[email protected]> wrote: >>>=20 >>> Yes, I use it all the time for this purpose. How are you splitting, siz= e or date ?? >>=20 >> time and I figured that it was intended to work for cases like this. >>=20 >> I can do this another way as I was running the process in parallel. The o= ne giving trouble was the =E2=80=9Cnew=E2=80=9D one so I have most of the da= ta on the old one. The catch is that we shut down the VM yesterday =E2=80=94= I have logged a call to the VMware team to crank it up again so I can scp t= he files across. >>=20 >>> Can you send the complete commandline ?? >>=20 >>=20 >> rasplit -r /data/argus/data/dmzo.big -t 2018/10/04.16:00-2018/10/16 -M t= ime 1h -w "%Y/%m/%d/dmzo.%y.%m.%d.%H.%M.%S=E2=80=9D=20 >>=20 >> argus@secmgrprd02:~$ ls -lh /data/argus/data/dmzo.big=20 >> -rw-r--r-- 1 argus argus 516G Oct 15 08:59 /data/argus/data/dmzo.big >>=20 >>=20 >> Since the file is so big it really is not feasible to send it to you but w= e can at least compile it with symbols and set things up to get a dump that c= an be analysed. Alternatively we can apply diagnostic patches. >>=20 >> BTW, as you probably know, I am now down to 3 days a week (Mon - Wed) and= next weekend is a long weekend *and* I will be out of town for at least the= next 4 days so it will be next week before I get back to this. >>=20 >> Russell >>=20 >>> Carter >>>=20 >>> =20 >>> Carter Bullard =E2=80=A2 CTO >>> 150 E 57th Street Suite 12D >>> New York, New York 10022-2795 >>> Phone +1.212.588.9133 =E2=80=A2 Mobile +1.917.497.9494 >>>=20 >>>> On Oct 16, 2018, at 6:07 AM, Russell Fulton <[email protected]> w= rote: >>>>=20 >>>> The log rollover process broke and I was left with some large flow file= s so I tried to break them up with rasplit but if died about a third of the w= ay through the file... >>>>=20 >>>> rful011@secmgrprd02:/usr/local/tools/notify-framework$ sudo ls -lh /dat= a/argus/data/dmzo.big >>>> -rw-r--r-- 1 argus argus 516G Oct 15 08:59 /data/argus/data/dmzo.big >>>>=20 >>>> [1]+ Floating point exception(core dumped) rasplit -r /data/argus/data= /dmzo.big -M time 1h -w "%Y/%m/%d/dmzo.%H.%M.%S" >>>>=20 >>>>=20 >>>> Oct 15 18:07:36 secmgrprd02 kernel: [4584251.907460] traps: rasplit[553= 4] trap divide error ip:556d5ebf7bc4 sp:7ffc39708be0 error:0 in rasplit[556d= 5eb89000+b3000] >>>>=20 >>>> I tried re running the job with a -t parameter to start processing at t= he beginning of the hour in which it crashed with the same result, this did o= utput some data. >>>>=20 >>>> Tried again this time starting -t the hour after the point where is cra= shed and it still dies and does not produce an output. >>>>=20 >>>> I conclude it is something to do with the process of reading the file t= hat has the problem not the splitting. >>>>=20 >>>> Has anyone used rasplit on really big files? This one is weeks data a= nd is nearly 500GB. >>>>=20 >>>> Russell >>=20 >=20 >=20 --Apple-Mail-D8BF2D9F-A5A8-4AFC-9156-5209547AC6AE Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><head><meta http-equiv=3D"content-type" content=3D"text/html; charset=3D= utf-8"></head><body dir=3D"auto">we have found that some VM=E2=80=99s disk b= uffering strategies could result in file corruption for some clients ... may= be an issue here ... using VMWare ??? I=E2=80=99m traveling and will n= ot be back for a week or so ... will consult and try to get back ...<div>Car= ter<br><br><div id=3D"AppleMailSignature" dir=3D"ltr"><table id=3D"sig" widt= h=3D"360" cellspacing=3D"0" cellpadding=3D"0" border-spacing=3D"0" class=3D"= " style=3D"font-family: UICTFontTextStyleBody; -webkit-text-size-adjust: aut= o; font-size: 13pt; width: 360px; margin: 0px; padding: 0px;"><tbody class=3D= ""><tr class=3D""><td width=3D"142" class=3D"" style=3D"width: 142px; margin= : 0px; padding: 0px;"><a href=3D"http://qosient.com/" title=3D"QoSient" clas= s=3D"" style=3D"text-decoration: none; border: none; color: rgb(149, 79, 114= );"><img src=3D"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAR8AAABdCAYAAA= CcsGKeAAAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJbWFnZVJlYWR5ccllPAAACy9JREFUeNrsndt140= YShmt85n2RgbERCI5gMBEMNgLBEZiOQHAEtCOgHIFGEZCKgNoIyI2AzMArnGkcy5jqC9DVF4D/dw= 4eRElEo6vr7+oLqokAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMBN8CGTctSaz1= /frivMlJTi7apGn53VBcBixKdW193bVTKNWsfQ2F/eroO6QDixad+uT8pWheFvX9U12OUs2Ebe2/= 4RZgFzaN6u3dt1ebv+EryelJMUqGIRSmUnH5scBWzSjb5zD9OAqb1n34hOwoLDXRflNCWqXczhJW= yynWkTiA/wasiXCKLDXTtEQpM7iWPgjqGB+IAY8zmukc5e9Yyt+r/S8J2NapBPjqLW/80G5rBSWe= x1Ujbi7FMpu2wdxKuD+ICQbCPO0dSOc0h7REHGiOdiEJ12xnyRbpgN8QHJwvZQ8zHDqszJEgVVMN= N3HA228mVsE4gPiB627ynOJHBB9gnTFubSOneoOhpEaKr41Op/hgu2y48yZadeGcL2S6IGU1qiMD= Tib3XE1c02YMeAyHN9beiSKiI1Cc+R0i957yBAk+rmCH8CM6ZZ9ilufqH8J3hbgwA1N9x4ONvV8C= kwo/OKLj4hJypjCdCtTkLXxK9sAeA64km2ELA1RDy50hqGh7e2DN9RvLkesP7Oa5/qxkty4o7iTr= LmyhNhDgwsUHxOmuFLuWDH++vGhl97wnwPyEh8fnCMHDiR+ZmWk9OlL+tVM5QEACTAJj79kOoX5v= Ov6loKvfD8qlHzW+798foJyFZ8NpoG+usCn/WR+CRkDzdiay5KxQZAkC3cXM9uwc9T0+3O/XSEDY= ZAzne853w+Gn7Xb8Yrmc9/W3AF9pHPKyM29+rzGFRMNBkjV/WBifIq1agON+5Y3GsgueYPrxdSTi= umHM59hNOOPuvnef6z8IbWMtFbPyT5d6D79SL+RTXuykEgXlQ9hxDDCyN8/T0/Z+Zc9cg2j8L3KE= d20c19XVX9PCubSDl5Z/l53EHcqzqpLOV8UXV1negPpcPf/TjSg94uf07o+CZ1cNyQaw2vJhQRhl= 4l+eetPpL8PpyOZBJ+xRwe7gPYxSddr8Qk/fi7daKzn1nObkI59xQ+w+ik9lVpvmQtcBW+ERK2Tt= hwJ5JbkTO9m9etXHyk7CKRKdPmV51Qu6lyFp+PBvHhQqe18MI4dH9UzO+eczk7B4NfmSFVbemt96= psvquM/b37PU9PzO8eVB0saf+Wq+A+OQj4wdEm/ff1+8PulD2k51t2lojXtZylip5/tgxbXyfUY2= Vpxzomtacu89BcYl5BcuWnIXN+o536m8IiXhsy5ySSyhywFQzbc458TJk2hxzVlUX4N6RPmjf39S= Jd5LPTlLOzlLNSz6Jrg3UAnwn2esWe1p2KohAcVrYBnLg2hMNS79PZ5j5SiZCU+OiE5zKzI201zn= 0UEp8d+SflKzR2vZBM7vRk4lPTuuAcrvA0iHQK2Y1gg5/iUNzermZh4vOkqTefhYVSI2hbz7bXCE= e4G5LfnxdNfCQcM3eOngJbahxXehOmLnOk1HtpJbmvAA1DgDJz8dkEjBh1k/a1h39dArQfTnzLpY= rP2vCN7vYUb/d3ReGzEE4RoeFZ6wzFhxMH6QwMNfklZjPVqeTUwkXw+yE+mYgPN8/zFLi8vg1+ig= h15L5HSXo/kq/47CjOfCV3n9bDv0I485YRYYjPwsXnxIhAjGFpR3ETgrXkvg/kJFQWH/EpKF6mzd= KjAwoxIexaxgris1zxaSntSuCJ4udhLlUv6nIctu9ku4/4bCjuQgk3r1LM8K8mYnvZ5C4+F+HJqh= w5zXzGPaV9Mzy1+LlEQz5J+n3E5xhZmOfaImbHPhbILhfx0eXzedX0fmuCe56zw/+Me9I/Ipf7kS= nnl8j3/6yug2H4s6e4qUq4N9NDJ7zjvv9TZu38v7mWTyc+15WLzxzhIU0InyKj41eHcoXmoARIl6= K2oHhHZpNG6F4C3/PKtJvcckOdc3XCHxzVsuduReJTzTTSHeOAKXKpPDNimmofVh8J/aSJlocdtz= GoHedkpK+SeWaIj/Cwq16R+Hya2UtWkXtWU9ThIqgxG/hnQ7tpI5ThXxl3bGCC+Oga91p2OTeOz2= wbrqXMIHfNbFh8VQLE1ckDnB6M+WhoSFy60Ybks8ql6Jk4EZkjPq8Jn+N1FI2WGdTtcErIjqm3Kn= J99e30T7j48sSHlOG4XMdLF5975rOvaAqiTv/AiGETWXz+R8hNvchhl84h64WHt4Vm/uEZTUGUJS= xBg4zF56zpOX5Z8PNy55CdEfmI8+wwZAUQHyPcMTktLXPlS3f66pRNgufRzymjwMpStpSk2KQ6Xn= n8Ee69bPE5aKKfJZ5xzp080E+QPnqIT6oGXmgiuFzI4RwpRFoLFx9d9NP3ut2CnrMhfnn9t4mOMi= Xxe0hqx2jjljhkYhsgKD69Ubk5kQdaxuTzcKoE56xTT6t4Yb47RQ/7hXmWnE6tTLEf7FXT6YAFi0= +P7v2dPeW98bAg/UFvc46hOWTSwBuHcqUWfIpcRm6v1j1cfPniM5z3xDl3rgJkerP695nOcGWiwN= irfy1T37ltpuOGPOcI931mRLqEm68DXY5fqeTcksJzNJTV17FSnWnWP9eJ0uYTcoHLldQ6/m9Hfp= kMLxQp6ZUHMfP51EL1UedQryanzqGXKQ1llEokvie55FlT2JJfGtUYZWzJL01oR/I5nDcQn3WIT2= Fx7jpxuG86ObQKZNAY0R/n1FMbwCWwIxaaqGdKWg1f8dEdbRNDeCvH+6xBfE6pnNwkQCmOVi7Ifg= SwdOPbRhSgRuiZpA81tEWEc6LNjsKc2xU6Ot1M6HzXID5J87rbBOgUKQpqyZzYPFSj0z2/tAC1mu= dqZ3wX10lIHaS3E+qIOiFn0Qmh9OpkObrXLYlPmVqAbNni9hRmOdomOhLH47o0vEug4acpmpubHT= DEmeymObY5DV1KfEyd41ZAdAvizzdbq/gUFPfYptkNRhcJbT2dslGO53KgnUQDcx3nXwzOV88wcm= v4Tp+0pLYTJ7YTxLq0DHXnRoBS4mPqHN6fM1bMsPfW8L1rFR8ifqW1cLRDRwHnGyvLMIxzzK0qVK= Mq6f3VqN/tyP3guqFC6sjia3v2QXgbjXPXyhFswrqNZKOTKks3skmrPjs62GCu8EuKjy0yG0R3R/= oXpoe26HJumatzLVV8OtKfWFsy992MRkZdaEd0GQ6FuKROzAw5BJ17Sc9VtOR+HPLUa+cZcUqLT2= jbDGWcMrxfqvjY5nltVxfLGVvPgrpeT5TXOzy1sPj6OrOpIW0Ey3oSskMI8Xk/bJe0zXHmMy9VfG= zTDNmIz3iMfBIWnA3lvXW+nThc5IYCsZ6v8YgMTsQnactRfCQ6xsE2PkP7JYvPnEjyRMyixofIDl= nS3xuxPhF/yuSY/m3lM307S+xAy8vLWyjnvnv37AXzjP17Yy8ZPGNjsc97e3wl+VQe5Uh0rxQuXU= j5zjalRlAOqgyS7a9m7hGy/VWB6rP/3nv6Pr3yWV0vgdqIKNtIcx0AAMD2uKYl6xJVBAAIOSwzjc= Vj7d0BANwoHZkn/DqIEAAgZBRkWy3qVx18Xp9oIGIAAJNA2Jbph6W8Ka8GDC9CdqhiAOLzYUFlbY= k/hnfMsJT4Qt8vKw5LyMMKWv+7z5RX8nUAQMYiJLFzekp2PQAA+EcU4/qGe+zEUgCAG2FIteH6Ck= eLKgMAhIiINkqMuOFZhyoCID0fbuQ5a/o2v1PS9FNKAQAAAAAAAAAAAAAAAAAAAAAAAAAASM3/BR= gAaVGndQa4eeAAAAAASUVORK5CYII=3D" alt=3D"QoSient" class=3D"" style=3D"border= : none; height: 48px; line-height: 48px; font-size: 48px; font-family: 'Gill= Sans', sans-serif; color: rgb(0, 0, 0);"></a></td><td width=3D"20" class=3D= "" style=3D"width: 16px; min-width: 16px; max-width: 16px; margin: 0px; padd= ing: 0px;"> </td><td class=3D"" style=3D"margin: 0px; padding: 0px; bor= der-collapse: collapse;"><table id=3D"sig2" cellspacing=3D"0" cellpadding=3D= "0" border-spacing=3D"0" class=3D""><tbody class=3D""><tr class=3D""><td cla= ss=3D"" style=3D"white-space: nowrap; font-family: 'Gill Sans Light', sans-s= erif;"><a href=3D"mailto:[email protected]" class=3D"" style=3D"text-decora= tion: none; border: none; color: rgb(149, 79, 114);"><span class=3D"" style=3D= "line-height: 16px; font-size: 16px; color: rgb(0, 0, 176);">Carter Bullard<= /span> </a><span class=3D"" style=3D"line-height: 14px; font-size: 12px= ;">=E2=80=A2</span> <span class=3D"" style=3D"line-height: 14px; font-s= ize: 12px;">CTO</span></td></tr><tr class=3D""><td class=3D"" style=3D"white= -space: nowrap; font-family: 'Gill Sans Light', sans-serif;"><span class=3D"= " style=3D"line-height: 14px; font-size: 12px;">150 E 57th Street Suite = ;12D</span></td></tr><tr class=3D""><td class=3D"" style=3D"white-space: now= rap; font-family: 'Gill Sans Light', sans-serif;"><span class=3D"" style=3D"= line-height: 14px; font-size: 12px;">New York, New York 10022-2795</span></t= d></tr><tr class=3D""><td class=3D"" style=3D"white-space: nowrap; font-fami= ly: 'Gill Sans Light', sans-serif;"><span class=3D"" style=3D"line-height: 1= 2px; font-size: 12px;">Phone +1.212.588.9133 =E2=80=A2 Mobile +1.917.49= 7.9494<br></span></td></tr></tbody></table></td></tr></tbody></table></div><= div dir=3D"ltr"><br>On Oct 16, 2018, at 10:36 PM, Russell Fulton <<a href= =3D"mailto:[email protected]">[email protected]</a>> wrote:<b= r><br></div><blockquote type=3D"cite"><div dir=3D"ltr"><span>another data po= int I tried running rasplit on the output of an other sensor file which is a= bit smaller with the same result =E2=80=94 it ran for about half an hour an= d then crashed.</span><br><span></span><br><span>I am copying the files off o= nto another machine and will try splitting them there. I need to free u= p the disk anyway!</span><br><span></span><br><blockquote type=3D"cite"><spa= n>On 17/10/2018, at 8:00 AM, Russell Fulton <<a href=3D"mailto:r.fulton@a= uckland.ac.nz">[email protected]</a>> wrote:</span><br></blockquote= ><blockquote type=3D"cite"><span></span><br></blockquote><blockquote type=3D= "cite"><span></span><br></blockquote><blockquote type=3D"cite"><span></span>= <br></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><span>O= n 16/10/2018, at 9:23 PM, Carter Bullard <<a href=3D"mailto:carter@qosien= t.com">[email protected]</a>> wrote:</span><br></blockquote></blockquote= ><blockquote type=3D"cite"><blockquote type=3D"cite"><span></span><br></bloc= kquote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><spa= n>Yes, I use it all the time for this purpose. How are you splitting, s= ize or date ??</span><br></blockquote></blockquote><blockquote type=3D"cite"= ><span></span><br></blockquote><blockquote type=3D"cite"><span>time and I fi= gured that it was intended to work for cases like this.</span><br></blockquo= te><blockquote type=3D"cite"><span></span><br></blockquote><blockquote type=3D= "cite"><span>I can do this another way as I was running the process in paral= lel. The one giving trouble was the =E2=80=9Cnew=E2=80=9D one so I hav= e most of the data on the old one. The catch is that we shut down the V= M yesterday =E2=80=94 I have logged a call to the VMware team to crank it up= again so I can scp the files across.</span><br></blockquote><blockquote typ= e=3D"cite"><span></span><br></blockquote><blockquote type=3D"cite"><blockquo= te type=3D"cite"><span>Can you send the complete commandline ??</span><br></= blockquote></blockquote><blockquote type=3D"cite"><span></span><br></blockqu= ote><blockquote type=3D"cite"><span></span><br></blockquote><blockquote type= =3D"cite"><span>rasplit -r /data/argus/data/dmzo.big -t 2018/10/04.16:00-201= 8/10/16 -M time 1h -w "%Y/%m/%d/dmzo.%y.%m.%d.%H.%M.%S=E2=80=9D </span= ><br></blockquote><blockquote type=3D"cite"><span></span><br></blockquote><b= lockquote type=3D"cite"><span>argus@secmgrprd02:~$ ls -lh /data/argus/data/d= mzo.big </span><br></blockquote><blockquote type=3D"cite"><span>-rw-r--r-- 1= argus argus 516G Oct 15 08:59 /data/argus/data/dmzo.big</span><br></blockqu= ote><blockquote type=3D"cite"><span></span><br></blockquote><blockquote type= =3D"cite"><span></span><br></blockquote><blockquote type=3D"cite"><span>Sinc= e the file is so big it really is not feasible to send it to you but we can a= t least compile it with symbols and set things up to get a dump that can be a= nalysed. Alternatively we can apply diagnostic patches.</span><br></bl= ockquote><blockquote type=3D"cite"><span></span><br></blockquote><blockquote= type=3D"cite"><span>BTW, as you probably know, I am now down to 3 days a we= ek (Mon - Wed) and next weekend is a long weekend *and* I will be out of tow= n for at least the next 4 days so it will be next week before I get back to t= his.</span><br></blockquote><blockquote type=3D"cite"><span></span><br></blo= ckquote><blockquote type=3D"cite"><span>Russell</span><br></blockquote><bloc= kquote type=3D"cite"><span></span><br></blockquote><blockquote type=3D"cite"= ><blockquote type=3D"cite"><span>Carter</span><br></blockquote></blockquote>= <blockquote type=3D"cite"><blockquote type=3D"cite"><span></span><br></block= quote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><span= > </span><br></blockquote></blockquote><blockquo= te type=3D"cite"><blockquote type=3D"cite"><span>Carter Bullard =E2=80=A2 CT= O</span><br></blockquote></blockquote><blockquote type=3D"cite"><blockquote t= ype=3D"cite"><span>150 E 57th Street Suite 12D</span><br></blockquote></bloc= kquote><blockquote type=3D"cite"><blockquote type=3D"cite"><span>New York, N= ew York 10022-2795</span><br></blockquote></blockquote><blockquote type=3D"c= ite"><blockquote type=3D"cite"><span>Phone +1.212.588.9133 =E2=80=A2 Mobile += 1.917.497.9494</span><br></blockquote></blockquote><blockquote type=3D"cite"= ><blockquote type=3D"cite"><span></span><br></blockquote></blockquote><block= quote type=3D"cite"><blockquote type=3D"cite"><span>On Oct 16, 2018, at 6:07= AM, Russell Fulton <<a href=3D"mailto:[email protected]">r.fulton@= auckland.ac.nz</a>> wrote:</span><br></blockquote></blockquote><blockquot= e type=3D"cite"><blockquote type=3D"cite"><span></span><br></blockquote></bl= ockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote typ= e=3D"cite"><span>The log rollover process broke and I was left with some lar= ge flow files so I tried to break them up with rasplit but if died about a t= hird of the way through the file...</span><br></blockquote></blockquote></bl= ockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote typ= e=3D"cite"><span></span><br></blockquote></blockquote></blockquote><blockquo= te type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>r= ful011@secmgrprd02:/usr/local/tools/notify-framework$ sudo ls -lh /data/argu= s/data/dmzo.big</span><br></blockquote></blockquote></blockquote><blockquote= type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>-rw= -r--r-- 1 argus argus 516G Oct 15 08:59 /data/argus/data/dmzo.big</span><br>= </blockquote></blockquote></blockquote><blockquote type=3D"cite"><blockquote= type=3D"cite"><blockquote type=3D"cite"><span></span><br></blockquote></blo= ckquote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><bl= ockquote type=3D"cite"><span>[1]+ Floating point exception(core dumped= ) rasplit -r /data/argus/data/dmzo.big -M time 1h -w "%Y/%m/%d/dmzo.%H.%M.%S= "</span><br></blockquote></blockquote></blockquote><blockquote type=3D"cite"= ><blockquote type=3D"cite"><blockquote type=3D"cite"><span></span><br></bloc= kquote></blockquote></blockquote><blockquote type=3D"cite"><blockquote type=3D= "cite"><blockquote type=3D"cite"><span></span><br></blockquote></blockquote>= </blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote= type=3D"cite"><span>Oct 15 18:07:36 secmgrprd02 kernel: [4584251.907460] tr= aps: rasplit[5534] trap divide error ip:556d5ebf7bc4 sp:7ffc39708be0 error:0= in rasplit[556d5eb89000+b3000]</span><br></blockquote></blockquote></blockq= uote><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D= "cite"><span></span><br></blockquote></blockquote></blockquote><blockquote t= ype=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>I tri= ed re running the job with a -t parameter to start processing at the beginni= ng of the hour in which it crashed with the same result, this did output som= e data.</span><br></blockquote></blockquote></blockquote><blockquote type=3D= "cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span></span><br>= </blockquote></blockquote></blockquote><blockquote type=3D"cite"><blockquote= type=3D"cite"><blockquote type=3D"cite"><span>Tried again this time startin= g -t the hour after the point where is crashed and it still dies and does no= t produce an output.</span><br></blockquote></blockquote></blockquote><block= quote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><spa= n></span><br></blockquote></blockquote></blockquote><blockquote type=3D"cite= "><blockquote type=3D"cite"><blockquote type=3D"cite"><span>I conclude it is= something to do with the process of reading the file that has the problem n= ot the splitting.</span><br></blockquote></blockquote></blockquote><blockquo= te type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span><= /span><br></blockquote></blockquote></blockquote><blockquote type=3D"cite"><= blockquote type=3D"cite"><blockquote type=3D"cite"><span>Has anyone used ras= plit on really big files? This one is weeks data and is nearly 5= 00GB.</span><br></blockquote></blockquote></blockquote><blockquote type=3D"c= ite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span></span><br></= blockquote></blockquote></blockquote><blockquote type=3D"cite"><blockquote t= ype=3D"cite"><blockquote type=3D"cite"><span>Russell</span><br></blockquote>= </blockquote></blockquote><blockquote type=3D"cite"><span></span><br></block= quote><span></span><br><span></span><br></div></blockquote></div></body></ht= ml>= --Apple-Mail-D8BF2D9F-A5A8-4AFC-9156-5209547AC6AE--