Re: Zookeeper latency calculation

2019-07-21 Thread Patrick Hunt
High max latency is typically due to gc, slow disk, or issues with vm oversubscription. Turn on gc logging and verify. I've used strace in the past to troubleshoot disk issues (fsync - although now a days it's in the log). Patrick On Thu, Jul 18, 2019 at 8:40 AM rammohan ganapavarapu <

Re: Zookeeper latency calculation

2019-07-18 Thread rammohan ganapavarapu
I do have a busy system total packet processed by zk is like 60k/s (30k send and 30k received) and how about the max latencies? is ti always constant ? for me avg latency is 0 but max latency is showing 40s how is it possible? On Wed, Jul 17, 2019 at 8:46 PM Michael Han wrote: > Typing send

Re: Zookeeper latency calculation

2019-07-17 Thread Michael Han
Typing send too soon... >> always give avg_latency "0" The latency metrics depends on workloads. Try hit your cluster hard with some artificially generated heavy read / write workloads, you will see the number deviates from 0. >> If I recall correctly avg_latency is an int, not float This is

Re: Zookeeper latency calculation

2019-07-17 Thread Michael Han
>> always give avg_latency "0" The latency metrics depends on workloads. On Wed, Jul 17, 2019 at 1:34 AM Enrico Olivelli wrote: > Il mar 16 lug 2019, 19:05 rammohan ganapavarapu > ha scritto: > > > Hi, > > > > I am trying to understand how zookeeper latency calculated, mntr command > > always

Re: Zookeeper latency calculation

2019-07-17 Thread Enrico Olivelli
Il mar 16 lug 2019, 19:05 rammohan ganapavarapu ha scritto: > Hi, > > I am trying to understand how zookeeper latency calculated, mntr command > always give avg_latency "0", can some one help how to calculate avg request > latency in zookeeper? > Are you also taking metrics on the client?

Re: Zookeeper latency calculation

2019-07-17 Thread Andor Molnar
If I recall correctly avg_latency is an int, not float.I remember someone wanted to replace it with a float sometime recently. Correct me if I'm wrong. Andor -Original Message-From: Norbert Kalmar < nkal...@cloudera.com.INVALID>Reply-To: user@zookeeper.apache.orgTo:

Re: Zookeeper latency calculation

2019-07-17 Thread Norbert Kalmar
Hi Ram, ZooKeeper is very fast if deployed according to recommendations (nodes on the same network, directly connected). It's possible it gives 0 latency on avg, although usually it's a bit higher. I can recommend Patrick's smoke test if you wan't to test performance. Especially zk-smoketest and