ra split dies with a floating point divide error when processing large file
Russell Fulton <[email protected]> Tue, 16 Oct 2018 17:07:14 +1300
| Newsgroups | gmane.network.argus |
|---|---|
| Message-ID | <[email protected]> |
The log rollover process broke and I was left with some large flow files = so I tried to break them up with rasplit but if died about a third of = the way through the file... rful011@secmgrprd02:/usr/local/tools/notify-framework$ sudo ls -lh = /data/argus/data/dmzo.big -rw-r--r-- 1 argus argus 516G Oct 15 08:59 /data/argus/data/dmzo.big [1]+ Floating point exception(core dumped) rasplit -r = /data/argus/data/dmzo.big -M time 1h -w "%Y/%m/%d/dmzo.%H.%M.%S" Oct 15 18:07:36 secmgrprd02 kernel: [4584251.907460] traps: = rasplit[5534] trap divide error ip:556d5ebf7bc4 sp:7ffc39708be0 error:0 = in rasplit[556d5eb89000+b3000] I tried re running the job with a -t parameter to start processing at = the beginning of the hour in which it crashed with the same result, this = did output some data. Tried again this time starting -t the hour after the point where is = crashed and it still dies and does not produce an output. I conclude it is something to do with the process of reading the file = that has the problem not the splitting. Has anyone used rasplit on really big files? This one is weeks data = and is nearly 500GB. Russell=