Re: ra not reading a 1GB radium.out file

Carter Bullard <[email protected]> Sun, 7 Oct 2018 10:02:03 -0400
Newsgroups gmane.network.argus
Message-ID <[email protected]> 
--Apple-Mail=_EE10904A-AA89-4ECE-A153-1D7E8F72D465
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=utf-8

Hey Monah,
You want to use rastream.1.   Have it connect to radium to write out the =
files, don=E2=80=99t have radium do that.  Think of radium as an argus =
record distribution node.  Have rastream.1 split on time, not on size, =
as that organizes the data in a more natural scope.  But if that is not =
possible, rastream.1 can easily split based on file size, and after the =
file is closed, it will run a script against the file.  Checkout the man =
page for rastream.

Carter
         <http://qosient.com/>     	 =09
Carter Bullard  <mailto:[email protected]>=E2=80=A2 CTO
150 E 57th Street, Suite 12D
New York, New York 10022-2795
Phone +1.212.588.9133 =E2=80=A2 Mobile +1.917.497.9494

=20

> On Oct 7, 2018, at 9:57 AM, Monah Baki <[email protected]> wrote:
>=20
> Thanks Carter I was able to break it up. Question though, is there a =
file somewhere where I can configure to say after every 10M of =
radium.out size tar and start collecting logs from the start.
>=20
>=20
> Thanks
> Monah
>=20
> On Sun, Oct 7, 2018 at 9:13 AM Carter Bullard <[email protected] =
<mailto:[email protected]>> wrote:
> Hey Monah,
> Look at your system log and your system configuration.  The log should =
have some explanation, such as system file size exceeded. The size of =
the file is close to 0x3D000000.  This isn=E2=80=99t particularly =
magical to me, but seems like a curious binary number, so its magical =
for your machine.  32-bit Linux =E2=80=A6 Windows???
>=20
> If there are hard limits on file size, rasplit.1 is designed to handle =
this.  I would suggest using rasplit.1 to create smaller files, say 5min =
files, so you can avoid this type of problem.
>=20
> Carter
>          <http://qosient.com/>     	 =09
> Carter Bullard  <mailto:[email protected]>=E2=80=A2 CTO
> 150 E 57th Street, Suite 12D
> New York, New York 10022-2795
> Phone +1.212.588.9133 =E2=80=A2 Mobile +1.917.497.9494
>=20
> =20
>=20
>> On Oct 5, 2018, at 1:42 PM, Monah Baki <[email protected] =
<mailto:[email protected]>> wrote:
>>=20
>> -rw-------.  1 root    root    1023339245 Oct  5 13:40 radium.out
>>=20
>>=20
>> ra -r radium.out drops me to a shell but if I were to move the file =
and have it start all over again, I get output.
>>=20
>>=20
>> Thanks
>> Monah
>=20


--Apple-Mail=_EE10904A-AA89-4ECE-A153-1D7E8F72D465
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
	charset=utf-8

<html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; line-break: after-white-space;" class=3D"">Hey =
Monah,<div class=3D"">You want to use rastream.1. &nbsp; Have it connect =
to radium to write out the files, don=E2=80=99t have radium do that. =
&nbsp;Think of radium as an argus record distribution node. &nbsp;Have =
rastream.1 split on time, not on size, as that organizes the data in a =
more natural scope. &nbsp;But if that is not possible, rastream.1 can =
easily split based on file size, and after the file is closed, it will =
run a script against the file. &nbsp;Checkout the man page for =
rastream.</div><div class=3D""><br class=3D""><div class=3D"">Carter<br =
class=3D""><div class=3D"">
<style type=3D"text/css" class=3D"">
  <a href=3D"http://a.link" =
class=3D"">a.link</a>{margin:0;padding:0;border:none;text-decoration:none;=
}
</style>

<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dutf-8" =
class=3D"">
<meta name=3D"format-detection" content=3D"telephone=3Dno" class=3D"">

<table id=3D"sig" width=3D"360" cellspacing=3D"0" cellpadding=3D"0" =
border-spacing=3D"0" style=3D"width:360px;margin:0;padding:0;" class=3D"">=

  <tbody class=3D""><tr class=3D"">
    <td width=3D"142" style=3D"width:142px;margin:0;padding:0;" =
class=3D"">
      <a href=3D"http://qosient.com" title=3D"QoSient" =
style=3D"border:none;text-decoration:none;" class=3D"">        <img =
src=3D"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAR8AAABdCAYAAACcsGKeA=
AAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJbWFnZVJlYWR5ccllPAAACy9JREFUeNrsndt140YShmt=
85n2RgbERCI5gMBEMNgLBEZiOQHAEtCOgHIFGEZCKgNoIyI2AzMArnGkcy5jqC9DVF4D/dw4eR=
ElEo6vr7+oLqokAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMBN8CGTctSaz1/=
frivMlJTi7apGn53VBcBixKdW193bVTKNWsfQ2F/eroO6QDixad+uT8pWheFvX9U12OUs2Ebe2=
/4RZgFzaN6u3dt1ebv+EryelJMUqGIRSmUnH5scBWzSjb5zD9OAqb1n34hOwoLDXRflNCWqXcz=
hJWyynWkTiA/wasiXCKLDXTtEQpM7iWPgjqGB+IAY8zmukc5e9Yyt+r/S8J2NapBPjqLW/80G5=
rBSWex1Ujbi7FMpu2wdxKuD+ICQbCPO0dSOc0h7REHGiOdiEJ12xnyRbpgN8QHJwvZQ8zHDqsz=
JEgVVMNN3HA228mVsE4gPiB627ynOJHBB9gnTFubSOneoOhpEaKr41Op/hgu2y48yZadeGcL2S=
6IGU1qiMDTib3XE1c02YMeAyHN9beiSKiI1Cc+R0i957yBAk+rmCH8CM6ZZ9ilufqH8J3hbgwA=
1N9x4ONvV8Ckwo/OKLj4hJypjCdCtTkLXxK9sAeA64km2ELA1RDy50hqGh7e2DN9RvLkesP7Oa=
5/qxkty4o7iTrLmyhNhDgwsUHxOmuFLuWDH++vGhl97wnwPyEh8fnCMHDiR+ZmWk9OlL+tVM5Q=
EACTAJj79kOoX5vOv6loKvfD8qlHzW+798foJyFZ8NpoG+usCn/WR+CRkDzdiay5KxQZAkC3cX=
M9uwc9T0+3O/XSEDYZAzne853w+Gn7Xb8Yrmc9/W3AF9pHPKyM29+rzGFRMNBkjV/WBifIq1ag=
ON+5Y3GsgueYPrxdSTiumHM59hNOOPuvnef6z8IbWMtFbPyT5d6D79SL+RTXuykEgXlQ9hxDDC=
yN8/T0/Z+Zc9cg2j8L3KEd20c19XVX9PCubSDl5Z/l53EHcqzqpLOV8UXV1negPpcPf/TjSg94=
uf07o+CZ1cNyQaw2vJhQRhl4l+eetPpL8PpyOZBJ+xRwe7gPYxSddr8Qk/fi7daKzn1nObkI59=
xQ+w+ik9lVpvmQtcBW+ERK2TthwJ5JbkTO9m9etXHyk7CKRKdPmV51Qu6lyFp+PBvHhQqe18MI=
4dH9UzO+eczk7B4NfmSFVbemt96psvquM/b37PU9PzO8eVB0saf+Wq+A+OQj4wdEm/ff1+8Pul=
D2k51t2lojXtZylip5/tgxbXyfUY2Vpxzomtacu89BcYl5BcuWnIXN+o536m8IiXhsy5ySSyhy=
wFQzbc458TJk2hxzVlUX4N6RPmjf39SJd5LPTlLOzlLNSz6Jrg3UAnwn2esWe1p2KohAcVrYBn=
Lg2hMNS79PZ5j5SiZCU+OiE5zKzI201zn0UEp8d+SflKzR2vZBM7vRk4lPTuuAcrvA0iHQK2Y1=
gg5/iUNzermZh4vOkqTefhYVSI2hbz7bXCEe4G5LfnxdNfCQcM3eOngJbahxXehOmLnOk1HtpJ=
bmvAA1DgDJz8dkEjBh1k/a1h39dArQfTnzLpYrP2vCN7vYUb/d3ReGzEE4RoeFZ6wzFhxMH6Qw=
MNfklZjPVqeTUwkXw+yE+mYgPN8/zFLi8vg1+igh15L5HSXo/kq/47CjOfCV3n9bDv0I485YRY=
YjPwsXnxIhAjGFpR3ETgrXkvg/kJFQWH/EpKF6mzdKjAwoxIexaxgris1zxaSntSuCJ4udhLlU=
v6nIctu9ku4/4bCjuQgk3r1LM8K8mYnvZ5C4+F+HJqhw5zXzGPaV9Mzy1+LlEQz5J+n3E5xhZm=
OfaImbHPhbILhfx0eXzedX0fmuCe56zw/+Me9I/Ipf7kSnnl8j3/6yug2H4s6e4qUq4N9NDJ7z=
jvv9TZu38v7mWTyc+15WLzxzhIU0InyKj41eHcoXmoARIl6K2oHhHZpNG6F4C3/PKtJvcckOdc=
3XCHxzVsuduReJTzTTSHeOAKXKpPDNimmofVh8J/aSJlocdtzGoHedkpK+SeWaIj/Cwq16R+Hy=
a2UtWkXtWU9ThIqgxG/hnQ7tpI5ThXxl3bGCC+Oga91p2OTeOz2wbrqXMIHfNbFh8VQLE1ckDn=
B6M+WhoSFy60Ybks8ql6Jk4EZkjPq8Jn+N1FI2WGdTtcErIjqm3KnJ99e30T7j48sSHlOG4XMd=
LF5975rOvaAqiTv/AiGETWXz+R8hNvchhl84h64WHt4Vm/uEZTUGUJSxBg4zF56zpOX5Z8PNy5=
5CdEfmI8+wwZAUQHyPcMTktLXPlS3f66pRNgufRzymjwMpStpSk2KQ6Xnn8Ee69bPE5aKKfJZ5=
xzp080E+QPnqIT6oGXmgiuFzI4RwpRFoLFx9d9NP3ut2CnrMhfnn9t4mOMiXxe0hqx2jjljhkY=
hsgKD69Ubk5kQdaxuTzcKoE56xTT6t4Yb47RQ/7hXmWnE6tTLEf7FXT6YAFi0+P7v2dPeW98bA=
g/UFvc46hOWTSwBuHcqUWfIpcRm6v1j1cfPniM5z3xDl3rgJkerP695nOcGWiwNirfy1T37ltp=
uOGPOcI931mRLqEm68DXY5fqeTcksJzNJTV17FSnWnWP9eJ0uYTcoHLldQ6/m9HfpkMLxQp6ZU=
HMfP51EL1UedQryanzqGXKQ1llEokvie55FlT2JJfGtUYZWzJL01oR/I5nDcQn3WIT2Fx7jpxu=
G86ObQKZNAY0R/n1FMbwCWwIxaaqGdKWg1f8dEdbRNDeCvH+6xBfE6pnNwkQCmOVi7IfgSwdOP=
bRhSgRuiZpA81tEWEc6LNjsKc2xU6Ot1M6HzXID5J87rbBOgUKQpqyZzYPFSj0z2/tAC1mudqZ=
3wX10lIHaS3E+qIOiFn0Qmh9OpkObrXLYlPmVqAbNni9hRmOdomOhLH47o0vEug4acpmpubHTD=
EmeymObY5DV1KfEyd41ZAdAvizzdbq/gUFPfYptkNRhcJbT2dslGO53KgnUQDcx3nXwzOV88wc=
mv4Tp+0pLYTJ7YTxLq0DHXnRoBS4mPqHN6fM1bMsPfW8L1rFR8ifqW1cLRDRwHnGyvLMIxzzK0=
qVKMq6f3VqN/tyP3guqFC6sjia3v2QXgbjXPXyhFswrqNZKOTKks3skmrPjs62GCu8EuKjy0yG=
0R3R/oXpoe26HJumatzLVV8OtKfWFsy992MRkZdaEd0GQ6FuKROzAw5BJ17Sc9VtOR+HPLUa+c=
ZcUqLT2jbDGWcMrxfqvjY5nltVxfLGVvPgrpeT5TXOzy1sPj6OrOpIW0Ey3oSskMI8Xk/bJe0z=
XHmMy9VfGzTDNmIz3iMfBIWnA3lvXW+nThc5IYCsZ6v8YgMTsQnactRfCQ6xsE2PkP7JYvPnEj=
yRMyixofIDlnS3xuxPhF/yuSY/m3lM307S+xAy8vLWyjnvnv37AXzjP17Yy8ZPGNjsc97e3wl+=
VQe5Uh0rxQuXUj5zjalRlAOqgyS7a9m7hGy/VWB6rP/3nv6Pr3yWV0vgdqIKNtIcx0AAMD2uKY=
l6xJVBAAIOSwzjcVj7d0BANwoHZkn/DqIEAAgZBRkWy3qVx18Xp9oIGIAAJNA2Jbph6W8Ka8GD=
C9CdqhiAOLzYUFlbYk/hnfMsJT4Qt8vKw5LyMMKWv+7z5RX8nUAQMYiJLFzekp2PQAA+EcU4/q=
Ge+zEUgCAG2FIteH6CkeLKgMAhIiINkqMuOFZhyoCID0fbuQ5a/o2v1PS9FNKAQAAAAAAAAAAA=
AAAAAAAAAAAAAAASM3/BRgAaVGndQa4eeAAAAAASUVORK5CYII=3D" alt=3D"QoSient" =
style=3D"border:none;height:48px;font-family:'Gill =
Sans',sans-serif;font-weight:100;font-size:48px;line-height:48px;color:#00=
0000" class=3D"">
      </a>
    </td>

    <td width=3D"20" =
style=3D"width:16px;min-width:16px;max-width:16px;margin:0;padding:0;" =
class=3D"">&nbsp;</td>

    <td =
style=3D"margin:0;padding:0;border-collapse:collapse;-webkit-text-size-adj=
ust:none;" class=3D"">
      <table id=3D"sig2" cellspacing=3D"0" cellpadding=3D"0" =
border-spacing=3D"0" class=3D"">
        <tbody class=3D""><tr class=3D"">
          <td style=3D"font-family:'Gill Sans =
Light',sans-serif;white-space:nowrap;" class=3D"">
            <a href=3D"mailto:[email protected] " =
style=3D"border:none;text-decoration:none;" class=3D"">
               <span =
style=3D"font-size:16px;line-height:16px;color:#0000b0" class=3D"">Carter =
Bullard</span>
            </a>
            <span style=3D"font-size:12px;line-height:14px;color:#000000" =
class=3D"">=E2=80=A2</span>
            <span style=3D"font-size:12px;line-height:14px;color:#000000" =
class=3D"">CTO</span>
          </td>
        </tr>
        <tr class=3D"">
          <td style=3D"font-family:'Gill Sans =
Light',sans-serif;white-space:nowrap;" class=3D"">
            <span style=3D"font-size:12px;line-height:14px;color:#000000" =
class=3D"">150 E 57th Street, Suite 12D</span> </td>
        </tr>
        <tr class=3D"">
          <td style=3D"font-family:'Gill Sans =
Light',sans-serif;white-space:nowrap;" class=3D"">
            <span style=3D"font-size:12px;line-height:14px;color:#000000" =
class=3D"">New York, New York 10022-2795</span> </td>
        </tr>
        <tr class=3D"">
          <td style=3D"font-family:'Gill Sans =
Light',sans-serif;white-space:nowrap;" class=3D"">
            <span style=3D"font-size:12px;line-height:12px;color:#000000" =
class=3D"">Phone +1.212.588.9133 =E2=80=A2 Mobile +1.917.497.9494</span>
          </td>
        </tr>
      </tbody></table>
    </td>
  </tr><tr class=3D"">
</tr></tbody></table>
<br class=3D"">
&nbsp;

</div>
<div><br class=3D""><blockquote type=3D"cite" class=3D""><div =
class=3D"">On Oct 7, 2018, at 9:57 AM, Monah Baki &lt;<a =
href=3D"mailto:[email protected]" class=3D"">[email protected]</a>&gt;=
 wrote:</div><br class=3D"Apple-interchange-newline"><div class=3D""><div =
dir=3D"ltr" class=3D"">Thanks Carter I was able to break it up. Question =
though, is there a file somewhere where I can configure to say after =
every 10M of radium.out size tar and start collecting logs from the =
start.<div class=3D""><br class=3D""></div><div class=3D""><br =
class=3D""></div><div class=3D"">Thanks</div><div =
class=3D"">Monah</div></div><br class=3D""><div class=3D"gmail_quote"><div=
 dir=3D"ltr" class=3D"">On Sun, Oct 7, 2018 at 9:13 AM Carter Bullard =
&lt;<a href=3D"mailto:[email protected]" =
class=3D"">[email protected]</a>&gt; wrote:<br =
class=3D""></div><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex"><div =
style=3D"word-wrap:break-word;line-break:after-white-space" class=3D"">Hey=
 Monah,<div class=3D""><div class=3D"">Look at your system log and your =
system configuration.&nbsp; The log should have some explanation, such =
as system file size exceeded. The size of the file is close to =
0x3D000000.&nbsp; This isn=E2=80=99t particularly magical to me, but =
seems like a curious binary number, so its magical for your machine. =
&nbsp;32-bit Linux =E2=80=A6 Windows???</div><div class=3D""><br =
class=3D""></div><div class=3D"">If there are hard limits on file size, =
rasplit.1 is designed to handle this.&nbsp; I would suggest using =
rasplit.1 to create smaller files, say 5min files, so you can avoid this =
type of problem.</div><div class=3D""><br class=3D""><div =
class=3D"">Carter<br class=3D""><div class=3D"">





<table id=3D"m_-3679764090253240920sig" width=3D"360" cellspacing=3D"0" =
cellpadding=3D"0" style=3D"width:360px;margin:0;padding:0" class=3D"">
  <tbody class=3D""><tr class=3D"">
    <td width=3D"142" style=3D"width:142px;margin:0;padding:0" class=3D"">=

      <a href=3D"http://qosient.com/" title=3D"QoSient" =
style=3D"border:none;text-decoration:none" target=3D"_blank" class=3D""> =
       <img alt=3D"QoSient" style=3D"border: none; height: 48px; =
font-family: &quot;Gill Sans&quot;, sans-serif; font-weight: 100; =
font-size: 48px; line-height: 48px;" class=3D"">
      </a>
    </td>

    <td width=3D"20" =
style=3D"width:16px;min-width:16px;max-width:16px;margin:0;padding:0" =
class=3D"">&nbsp;</td>

    <td style=3D"margin:0;padding:0;border-collapse:collapse" class=3D"">
      <table id=3D"m_-3679764090253240920sig2" cellspacing=3D"0" =
cellpadding=3D"0" class=3D"">
        <tbody class=3D""><tr class=3D"">
          <td style=3D"font-family:'Gill Sans =
Light',sans-serif;white-space:nowrap" class=3D"">
            <a href=3D"mailto:[email protected]" =
style=3D"border:none;text-decoration:none" target=3D"_blank" class=3D"">
               <span =
style=3D"font-size:16px;line-height:16px;color:#0000b0" class=3D"">Carter =
Bullard</span>
            </a>
            <span style=3D"font-size: 12px; line-height: 14px;" =
class=3D"">=E2=80=A2</span>
            <span style=3D"font-size: 12px; line-height: 14px;" =
class=3D"">CTO</span>
          </td>
        </tr>
        <tr class=3D"">
          <td style=3D"font-family:'Gill Sans =
Light',sans-serif;white-space:nowrap" class=3D"">
            <span style=3D"font-size: 12px; line-height: 14px;" =
class=3D"">150 E 57th Street, Suite 12D</span> </td>
        </tr>
        <tr class=3D"">
          <td style=3D"font-family:'Gill Sans =
Light',sans-serif;white-space:nowrap" class=3D"">
            <span style=3D"font-size: 12px; line-height: 14px;" =
class=3D"">New York, New York 10022-2795</span> </td>
        </tr>
        <tr class=3D"">
          <td style=3D"font-family:'Gill Sans =
Light',sans-serif;white-space:nowrap" class=3D"">
            <span style=3D"font-size: 12px; line-height: 12px;" =
class=3D"">Phone +1.212.588.9133 =E2=80=A2 Mobile +1.917.497.9494</span>
          </td>
        </tr>
      </tbody></table>
    </td>
  </tr><tr class=3D"">
</tr></tbody></table>
<br class=3D"">
&nbsp;

</div>
<div class=3D""><br class=3D""><blockquote type=3D"cite" class=3D""><div =
class=3D"">On Oct 5, 2018, at 1:42 PM, Monah Baki &lt;<a =
href=3D"mailto:[email protected]" target=3D"_blank" =
class=3D"">[email protected]</a>&gt; wrote:</div><br =
class=3D"m_-3679764090253240920Apple-interchange-newline"><div =
class=3D""><div dir=3D"ltr" class=3D""><div dir=3D"ltr" =
class=3D"">-rw-------.&nbsp; 1 root&nbsp; &nbsp; root&nbsp; &nbsp; =
1023339245 Oct&nbsp; 5 13:40 radium.out<br class=3D""></div><div =
dir=3D"ltr" class=3D""><br class=3D""></div><div class=3D""><br =
class=3D""></div><div class=3D"">ra -r radium.out drops me to a shell =
but if I were to move the file and have it start all over again, I get =
output.</div><div class=3D""><br class=3D""></div><div class=3D""><br =
class=3D""></div><div class=3D"">Thanks</div><div =
class=3D"">Monah</div></div>
</div></blockquote></div><br =
class=3D""></div></div></div></div></blockquote></div>
</div></blockquote></div><br class=3D""></div></div></body></html>=

--Apple-Mail=_EE10904A-AA89-4ECE-A153-1D7E8F72D465--