[ 
https://issues.apache.org/jira/browse/CASSANDRA-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17074619#comment-17074619
 ] 

Stephen Mallette commented on CASSANDRA-15582:
----------------------------------------------

Going up further in the comments here there was mention of a desire to do:

> 1) diff metrics names (did we remove something? Change name is a remove)
> 2) diff metric signature (Used to return long but now string, used to take no 
> arguments but now takes string, etc)

I've experimented a bit with a Groovy script (because it has nice syntax to 
interact with jmx) to connect to cassandra's jmx port and pull all the MBeans. 
I could further this script to do some automated analysis to determine items 1 
and 2 above as mentioned in an earlier comment: 

> we should have some automated way of pulling all the metrics out so we can 
> detect changes in the list of published metrics in an automated way. Since we 
> publish all metrics via JMX, I think it is doable. 

Analysis of that fashion through my experimental script is more of a one-time 
test however and I wasn't sure if there was some intent based on these comments 
to more fully automate this sort of testing going forward to help avoid 
breaking metric changes as part of the standard and ongoing testing process. 
I'd be curious what the direction is in this area and I'm happy to try to help.


> 4.0 quality testing: metrics
> ----------------------------
>
>                 Key: CASSANDRA-15582
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-15582
>             Project: Cassandra
>          Issue Type: Task
>          Components: Test/dtest
>            Reporter: Josh McKenzie
>            Assignee: Romain Hardouin
>            Priority: Normal
>             Fix For: 4.0-rc
>
>
> In past releases we've unknowingly broken metrics integrations and introduced 
> performance regressions in metrics collection and reporting. We strive in 4.0 
> to not do that. Metrics should work well!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

Reply via email to