Re: cassandra pool is busy

The problem is CassandraSessionImpl at newts-cassandra-common package (part of newts project).

I've checked the latest commit and it's still does not handle request pooling config while creating Cassandra session. 

A Time Series database that should handle some millions insert in collecting interval, also should consider using pooling options, something like this is required:



PoolingOptions options = new PoolingOptions();

options.setConnectionsPerHost(HostDistance.LOCAL, 1, 4)

 .setConnectionsPerHost(HostDistance.REMOTE, 1, 4)

 .setMaxRequestsPerConnection(HostDistance.LOCAL, 32768)

 .setMaxRequestsPerConnection(HostDistance.REMOTE, 32768)

 .setCoreConnectionsPerHost(HostDistance.LOCAL, 1)

 .setCoreConnectionsPerHost(HostDistance.REMOTE, 1)

 .setNewConnectionThreshold(HostDistance.LOCAL, 30000)

 .setNewConnectionThreshold(HostDistance.REMOTE, 30000)

 .setPoolTimeoutMillis(5000);

Builder builder = Cluster

 .builder()

 .withPort(port)

 .addContactPoints(hostname.split(","))

 .withPoolingOptions(options)



Sent using Zoho Mail






---- On Tue, 01 May 2018 18:03:28 +0430 onmstester onmstester <[email protected]> wrote ----





Hi,

I'm using opennms 21.0.5 with newts, while trying to collect 1.5 Millions of snmp metrics. i see a lot of this logs in collectd.log

Pool is busy (no available connection and the queue has reached its max size 256)



and there is no point in most of graphs.

I checked cassandra performance with jvisualvm, there is no high pressure on memory and cpu.

Increasing the batch size and ring buffer did not help.

Sent using Zoho Mail

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot

_______________________________________________
Please read the OpenNMS Mailing List FAQ:
http://www.opennms.org/index.php/Mailing_List_FAQ

opennms-discuss mailing list

To *unsubscribe* or change your subscription options, see the bottom of this page:
https://lists.sourceforge.net/lists/listinfo/opennms-discuss