Re: Jmx_exporter CPU spike

[Rahul Singh]

Nice find, Ben. I added this to my list of c* monitoring tools.

--
Rahul Singh
rahul.si...@anant.us

Anant Corporation
On Jul 9, 2018, 8:20 PM -0500, rajpal reddy , wrote:
> Thanks Ben!. will look into it
> > On Jul 9, 2018, at 10:42 AM, Ben Bromhead  wrote:
> >
> > Hi Rajpal
> >
> > I'd invite you to have a look at 
> > https://github.com/zegelin/cassandra-exporter
> >
> > Significantly faster (bypasses JMX rpc stuff, 10ms to collect metrics for 
> > 300 tables vs 2-3 seconds via JMX), plus the naming/tagging fits far better 
> > into the Prometheus world. Still missing a few stats like GC etc, but feel 
> > free to submit a PR!
> >
> > Ben
> >
> >
> >
> > > On Mon, Jul 9, 2018 at 12:03 AM Rahul Singh 
> > >  wrote:
> > > > How often are you polling the JMX? How much of a spike are you seeing 
> > > > in CPU?
> > > >
> > > > --
> > > > Rahul Singh
> > > > rahul.si...@anant.us
> > > >
> > > > Anant Corporation
> > > > On Jul 5, 2018, 2:45 PM -0500, rajpal reddy , 
> > > > wrote:
> > > > >
> > > > > we have Qualys security scan running causing the cpu spike. We are 
> > > > > seeing the CPU spike only when Jmx metrics are exposed using 
> > > > > Jmx_exporter. tried setting up imx authentication still see cpu 
> > > > > spike. if i stop using jmx exporter we don’t see any cpu spike. is 
> > > > > there any thing we have to tune to make work with Jmx_exporter?
> > > > >
> > > > >
> > > > > -
> > > > > To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
> > > > > For additional commands, e-mail: user-h...@cassandra.apache.org
> > > > >
> > --
> > Ben Bromhead
> > CTO | Instaclustr
> > +1 650 284 9692
> > Reliability at Scale
> > Cassandra, Spark, Elasticsearch on AWS, Azure, GCP and Softlayer
>

Re: Jmx_exporter CPU spike

[rajpal reddy]

Thanks Ben!. will look into it
> On Jul 9, 2018, at 10:42 AM, Ben Bromhead  wrote:
> 
> Hi Rajpal
> 
> I'd invite you to have a look at 
> https://github.com/zegelin/cassandra-exporter 
>  
> 
> Significantly faster (bypasses JMX rpc stuff, 10ms to collect metrics for 300 
> tables vs 2-3 seconds via JMX), plus the naming/tagging fits far better into 
> the Prometheus world. Still missing a few stats like GC etc, but feel free to 
> submit a PR!
> 
> Ben
> 
> 
> 
> On Mon, Jul 9, 2018 at 12:03 AM Rahul Singh  > wrote:
> How often are you polling the JMX? How much of a spike are you seeing in CPU?
> 
> --
> Rahul Singh
> rahul.si...@anant.us 
> 
> Anant Corporation
> On Jul 5, 2018, 2:45 PM -0500, rajpal reddy  >, wrote:
>> 
>> we have Qualys security scan running causing the cpu spike. We are seeing 
>> the CPU spike only when Jmx metrics are exposed using Jmx_exporter. tried 
>> setting up imx authentication still see cpu spike. if i stop using jmx 
>> exporter we don’t see any cpu spike. is there any thing we have to tune to 
>> make work with Jmx_exporter?
>> 
>> 
>> -
>> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org 
>> 
>> For additional commands, e-mail: user-h...@cassandra.apache.org 
>> 
>> 
> -- 
> Ben Bromhead
> CTO | Instaclustr 
> +1 650 284 9692
> Reliability at Scale
> Cassandra, Spark, Elasticsearch on AWS, Azure, GCP and Softlayer

Re: Jmx_exporter CPU spike

[rajpal reddy]

Hi Rahul,

we use prometheus to pull the metrics every 30 secs. cpu is spiking up to 100%. 
when a qualys scan runs net stat shows 100’s connections from the qualys 
server. if i don’t have imx_exporter it doesn’t open soma connections.
> On Jul 9, 2018, at 12:02 AM, Rahul Singh  wrote:
> 
> How often are you polling the JMX? How much of a spike are you seeing in CPU?
> 
> --
> Rahul Singh
> rahul.si...@anant.us
> 
> Anant Corporation
> On Jul 5, 2018, 2:45 PM -0500, rajpal reddy , wrote:
>> 
>> we have Qualys security scan running causing the cpu spike. We are seeing 
>> the CPU spike only when Jmx metrics are exposed using Jmx_exporter. tried 
>> setting up imx authentication still see cpu spike. if i stop using jmx 
>> exporter we don’t see any cpu spike. is there any thing we have to tune to 
>> make work with Jmx_exporter?
>> 
>> 
>> -
>> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
>> For additional commands, e-mail: user-h...@cassandra.apache.org
>> 

Re: Jmx_exporter CPU spike

[Ben Bromhead]

Hi Rajpal

I'd invite you to have a look at
https://github.com/zegelin/cassandra-exporter

Significantly faster (bypasses JMX rpc stuff, 10ms to collect metrics for
300 tables vs 2-3 seconds via JMX), plus the naming/tagging fits far better
into the Prometheus world. Still missing a few stats like GC etc, but feel
free to submit a PR!

Ben



On Mon, Jul 9, 2018 at 12:03 AM Rahul Singh 
wrote:

> How often are you polling the JMX? How much of a spike are you seeing in
> CPU?
>
> --
> Rahul Singh
> rahul.si...@anant.us
>
> Anant Corporation
> On Jul 5, 2018, 2:45 PM -0500, rajpal reddy ,
> wrote:
>
>
> we have Qualys security scan running causing the cpu spike. We are seeing
> the CPU spike only when Jmx metrics are exposed using Jmx_exporter. tried
> setting up imx authentication still see cpu spike. if i stop using jmx
> exporter we don’t see any cpu spike. is there any thing we have to tune to
> make work with Jmx_exporter?
>
>
> -
> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
> For additional commands, e-mail: user-h...@cassandra.apache.org
>
> --
Ben Bromhead
CTO | Instaclustr 
+1 650 284 9692
Reliability at Scale
Cassandra, Spark, Elasticsearch on AWS, Azure, GCP and Softlayer

Re: Jmx_exporter CPU spike

[Rahul Singh]

How often are you polling the JMX? How much of a spike are you seeing in CPU?

--
Rahul Singh
rahul.si...@anant.us

Anant Corporation
On Jul 5, 2018, 2:45 PM -0500, rajpal reddy , wrote:
>
> we have Qualys security scan running causing the cpu spike. We are seeing the 
> CPU spike only when Jmx metrics are exposed using Jmx_exporter. tried setting 
> up imx authentication still see cpu spike. if i stop using jmx exporter we 
> don’t see any cpu spike. is there any thing we have to tune to make work with 
> Jmx_exporter?
>
>
> -
> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
> For additional commands, e-mail: user-h...@cassandra.apache.org
>