RE: Tail Module + DBI Module, can't keep up!

On September 15, 2011 9:44 AM, Brandon Phelps wrote:
>
> Hello!
[...]
> My problem here is that the logs are coming in extremely fast and
> while the script does work, it progressively gets further and
> further behind.  It's currently Sep 15, 10AM yet the script is still
> dealing with lines from Sep 14 at 8am.  This is obviously due to the
> fact that the Tail module, and more likely the DBI module simply
> can't INSERT/UPDATE the database as fast as the logs are coming in.

Have you benchmarked/profiled your program yet?  You can't tell what
parts are slow, and what would benefit from a rework, without that.

-- Eric