Hi all,
I've noticed increased latency on our tomcat REST-service (average 30ms,
max > 2sec). We are using Cassandra 1.2.16 with official DataStax Java
driver v1.0.3.
Our setup:
* 2 DCs
* each DC: 7 nodes
* RF=5
* Leveled compaction
After cassandra restart on all nodes, the latencies are alrigh
Hi all,
I've noticed increased latency on our tomcat REST-service (average 30ms,
max > 2sec). We are using Cassandra 1.2.16 with official DataStax Java
driver v1.0.3.
Our setup:
* 2 DCs
* each DC: 7 nodes
* RF=5
* Leveled compaction
After cassandra restart on all nodes, the latencies are alrigh
Hi all,
I've noticed increased latency on our tomcat REST-service (average 30ms,
max > 2sec). We are using Cassandra 1.2.16 with official DataStax Java
driver v1.0.3.
Our setup:
* 2 DCs
* each DC: 7 nodes
* RF=5
* Leveled compaction
After cassandra restart on all nodes, the latencies are alrigh
Is compaction keeping up? Those replication settings are high - for every
write, 10 nodes are doing something).
What other monitoring stats do you have - what is IO, CPU and network
traffic like? Is the JVM GC activity growing?
Anything else stick out like growing number of network connections to
It looks like a memory leak to me. All Cassandra processes are with the
following JVM settings configured: -Xms10240M -Xmx10240M -Xmn2400M. The
OldGen reaches nearly the maximum and it looks like the oldgen objects not
being garbage collected.
Alexey
On Fri, May 23, 2014 at 3:56 PM, Nate McCall
You’ll need to provide some more information such as:
* Do you have monitoring on the cassandra cluster that shows the request
latency ? Data Stax OpsCentre is good starting point.
* Is compaction keeping up ? Check with nodetool compactionstats
* Is the GCInspector logging about long runnin
Also using the latest version of the driver (1.0.7) is always a good idea
just to make sure you are not hitting issues that have already been
addressed.
On Thu, May 29, 2014 at 12:33 AM, Aaron Morton
wrote:
> You’ll need to provide some more information such as:
>
> * Do you have monitoring on
