[jira] [Commented] (CASSANDRA-11677) Incredibly slow jolokia response times
[
https://issues.apache.org/jira/browse/CASSANDRA-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264356#comment-15264356
]
Andrew Jorgensen commented on CASSANDRA-11677:
--
Not great, much slower than the jolokia 1.2.3 client. So i think there must
have been a performance degradation in jolokia. I have a ticket open on the
jolokia github repository to talk about the issue. We ended up being able to
work around the issue by upgrading to the master version of the diamond jolokia
collector and kept the updated jolokia agent which seems to have resolved to
issue.
Thanks so much for your help.
> Incredibly slow jolokia response times
> --
>
> Key: CASSANDRA-11677
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11677
> Project: Cassandra
> Issue Type: Bug
>Reporter: Andrew Jorgensen
>
> I am seeing some very slow jolokia request times on my Cassandra 3.0 cluster.
> Specifically when running the following:
> {code}
> curl 127.0.0.1:8778/jolokia/list
> {code}
> on a slightly loaded cluster I am seeing request times around 30-40 seconds
> and on a more heavily loaded cluster I am seeing request times in the 2
> minute mark. We are currently using jolokia 1.3.2 and v4 of the diamond
> collector. I also have a Cassandra 1.1 cluster that has the same load and
> number of nodes and running the same curl command comes back in about 1
> second.
> Is there anything I can do to help diagnose this issue to see what is causing
> the slowdown or has anyone else experience this?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-11677) Incredibly slow jolokia response times
[
https://issues.apache.org/jira/browse/CASSANDRA-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264234#comment-15264234
]
Joshua McKenzie commented on CASSANDRA-11677:
-
So how does it look w/jolokia 1.3.0+ against the cassandra-1.1 cluster?
> Incredibly slow jolokia response times
> --
>
> Key: CASSANDRA-11677
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11677
> Project: Cassandra
> Issue Type: Bug
>Reporter: Andrew Jorgensen
>
> I am seeing some very slow jolokia request times on my Cassandra 3.0 cluster.
> Specifically when running the following:
> {code}
> curl 127.0.0.1:8778/jolokia/list
> {code}
> on a slightly loaded cluster I am seeing request times around 30-40 seconds
> and on a more heavily loaded cluster I am seeing request times in the 2
> minute mark. We are currently using jolokia 1.3.2 and v4 of the diamond
> collector. I also have a Cassandra 1.1 cluster that has the same load and
> number of nodes and running the same curl command comes back in about 1
> second.
> Is there anything I can do to help diagnose this issue to see what is causing
> the slowdown or has anyone else experience this?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-11677) Incredibly slow jolokia response times
[
https://issues.apache.org/jira/browse/CASSANDRA-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15262044#comment-15262044
]
Andrew Jorgensen commented on CASSANDRA-11677:
--
Sorry my previous comment is actually not quite true, while it does improve the
query time jolokia 1.2.3 has a default setting of only truncating the results
at 1000 keys which is why the requests are faster. This is fixed in jolokia
1.3.0 (https://jolokia.org/changes-report.html#a1.3.0) but as I've seen it
makes the query times much longer.
> Incredibly slow jolokia response times
> --
>
> Key: CASSANDRA-11677
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11677
> Project: Cassandra
> Issue Type: Bug
>Reporter: Andrew Jorgensen
>
> I am seeing some very slow jolokia request times on my Cassandra 3.0 cluster.
> Specifically when running the following:
> {code}
> curl 127.0.0.1:8778/jolokia/list
> {code}
> on a slightly loaded cluster I am seeing request times around 30-40 seconds
> and on a more heavily loaded cluster I am seeing request times in the 2
> minute mark. We are currently using jolokia 1.3.2 and v4 of the diamond
> collector. I also have a Cassandra 1.1 cluster that has the same load and
> number of nodes and running the same curl command comes back in about 1
> second.
> Is there anything I can do to help diagnose this issue to see what is causing
> the slowdown or has anyone else experience this?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-11677) Incredibly slow jolokia response times
[
https://issues.apache.org/jira/browse/CASSANDRA-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15261231#comment-15261231
]
Andrew Jorgensen commented on CASSANDRA-11677:
--
So this appears to actually be a jolokia problem. I was able to downgrade to
jolokia 1.2.3 and now metrics are coming in fine and the requests to that
endpoint are down to only a couple seconds. I am not sure what changed between
jolokia 1.2.3 and 1.3.3 but it appears to be causing an issue.
> Incredibly slow jolokia response times
> --
>
> Key: CASSANDRA-11677
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11677
> Project: Cassandra
> Issue Type: Bug
>Reporter: Andrew Jorgensen
>
> I am seeing some very slow jolokia request times on my Cassandra 3.0 cluster.
> Specifically when running the following:
> {code}
> curl 127.0.0.1:8778/jolokia/list
> {code}
> on a slightly loaded cluster I am seeing request times around 30-40 seconds
> and on a more heavily loaded cluster I am seeing request times in the 2
> minute mark. We are currently using jolokia 1.3.2 and v4 of the diamond
> collector. I also have a Cassandra 1.1 cluster that has the same load and
> number of nodes and running the same curl command comes back in about 1
> second.
> Is there anything I can do to help diagnose this issue to see what is causing
> the slowdown or has anyone else experience this?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
