[
https://issues.apache.org/jira/browse/ZOOKEEPER-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903146#action_12903146
]
Patrick Hunt commented on ZOOKEEPER-856:
----------------------------------------
Have you monitored the jvms for gc activity? Are you using CMS/incremental gc
rather than the default GC setup? I'm all for adding balancing, but it would be
good to rule GC/swap/IO out as an issue.
> Connection imbalance leads to overloaded ZK instances
> -----------------------------------------------------
>
> Key: ZOOKEEPER-856
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-856
> Project: Zookeeper
> Issue Type: Bug
> Reporter: Travis Crawford
> Fix For: 3.4.0
>
> Attachments: zk_open_file_descriptor_count_members.gif,
> zk_open_file_descriptor_count_total.gif
>
>
> We've experienced a number of issues lately where "ruok" requests would take
> upwards of 10 seconds to return, and ZooKeeper instances were extremely
> sluggish. The sluggish instance requires a restart to make it responsive
> again.
> I believe the issue is connections are very imbalanced, leading to certain
> instances having many thousands of connections, while other instances are
> largely idle.
> A potential solution is periodically disconnecting/reconnecting to balance
> connections over time; this seems fine because sessions should not be
> affected, and therefore ephemaral nodes and watches should not be affected.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.