+1 to resuming https://github.com/apache/zookeeper/pull/1716
Thanks for the heads up Enrico Il giorno lun 19 ago 2024 alle ore 13:37 Damien Diederen < [email protected]> ha scritto: > > Hi Ken, David, Enrico, Li Wang, > > Ken wrote: > > >>> We run a load test (just a few connections) that generates about > >>> 300,000 ephemeral nodes. We drop these connections simultaneously so > >>> those ephemeral nodes expire around the same time. At this point we > >>> see a crash in LearnerHandler: > >> > >> After running a few more tests, it also happens with 75K > >> simultaneously expiring ephemeral nodes. > > I believe this is the ZOOKEEPER-4306 issue, "CloseSessionTxn contains > too many ephemal nodes cause cluster crash": > > https://issues.apache.org/jira/browse/ZOOKEEPER-4306 > > It is due to the Jute-limited size of "CloseSession" transactions. The > crash can be worked around by setting: > > closeSessionTxn.enabled = false > > but that disables the fix for another potential issue: > > https://issues.apache.org/jira/browse/ZOOKEEPER-3145 > > HTH, -D > > P.-S. — Enrico, I still don't have a better solution than the one in > this PR: > > https://github.com/apache/zookeeper/pull/1716 > > Li Wang also looked into it and seems to have reached the same > conclusion: > > > https://issues.apache.org/jira/browse/ZOOKEEPER-4306?focusedCommentId=17685644&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17685644 > > Thoughts? > > > > > ----- Original Message ----- > > David Smiley <[email protected]> writes: > > I'm interested in the same... we're thinking of using ephemeral nodes > > to indicate the presence of data that this node can be searched for. > > The numbers will reach hundreds of thousands on the high end. > > > > On Mon, Jun 17, 2024 at 9:08 PM Ken Mamitsuka <[email protected]> > wrote: > >> > >> After running a few more tests, it also happens with 75K simultaneously > >> expiring ephemeral nodes. > >> > >> I guess a more fundamental question is whether Zookeeper is meant to > handle > >> something like this or is this huge simultaneous expiration something > >> unsupported. > >> > >> Thank you! > >> > >> On Wed, Jun 12, 2024 at 10:24 AM Ken Mamitsuka <[email protected]> wrote: > >> > >> > We are running a 5 node Zookeeper cluster on version 3.8.4 (it had the > >> > same issue with 3.7.1). We run a load test (just a few connections) > that > >> > generates about 300,000 ephemeral nodes. We drop these connections > >> > simultaneously so those ephemeral nodes expire around the same time. > At > >> > this point we see a crash in LearnerHandler: > >> > > >> > Jun 10 17:39:12 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:12,764 [myid:] - INFO > >> > [Snapshot Thread:o.a.z.s.p.FileTxnSnapLog@479] - Snapshotting: > >> > 0x100093f83 to /var/lib/zookeeper/version-2/ > >> > snapshot.100093f83 > >> > Jun 10 17:39:12 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:12,765 [myid:] - INFO > >> > [SyncThread:5:o.a.z.s.p.FileTxnLog@285] - Creating new log file: > >> > log.100093f85 > >> > Jun 10 17:39:13 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:13,520 [myid:] - INFO > >> > [Snapshot Thread:o.a.z.s.ZooKeeperServer@558] - Snapshot taken in > >> > 756 ms > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:16,903 [myid:] - ERROR > >> > [LearnerHandler-/10.1.67.28:51888:o.a.z.s.q.LearnerHandler@719] - > >> > Unexpected exception in LearnerHandler: > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: java.io.EOFException: null > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > java.io.DataInputStream.readInt(DataInputStream.java:392) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:96) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:86) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:134) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:656) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:16,903 [myid:] - ERROR > >> > [Sender-/10.1.67.28:51888:o.a.z.s.q.LearnerHandler@372] - > >> > Exception while sending packets in LearnerHandler > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: java.net.SocketException: Connection > >> > reset > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:115) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > java.net.SocketOutputStream.write(SocketOutputStream.java:155) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > java.io.BufferedOutputStream.write(BufferedOutputStream.java:122) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > java.io.DataOutputStream.write(DataOutputStream.java:107) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > java.io.FilterOutputStream.write(FilterOutputStream.java:97) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.jute.BinaryOutputArchive.writeBuffer(BinaryOutputArchive.java:122) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.quorum.QuorumPacket.serialize(QuorumPacket.java:71) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.jute.BinaryOutputArchive.writeRecord(BinaryOutputArchive.java:126) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.quorum.LearnerHandler.sendPackets(LearnerHandler.java:368) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.quorum.LearnerHandler.access$200(LearnerHandler.java:65) > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.quorum.LearnerHandler$1.run(LearnerHandler.java:751) > >> > > >> > Then connections to learners drop: > >> > > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:16,903 [myid:] - INFO > >> > [LearnerHandler-/10.1.79.102:35670:o.a.z.s.q.LearnerHandler@1159] > >> > - Synchronously closing socket to learner 2. > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:16,903 [myid:] - INFO > >> > [LearnerHandler-/10.1.72.1:54384:o.a.z.s.q.LearnerHandler@1159] - > >> > Synchronously closing socket to learner 3. > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:16,903 [myid:] - INFO > >> > [LearnerHandler-/10.1.71.8:40626:o.a.z.s.q.LearnerHandler@1159] - > >> > Synchronously closing socket to learner 4. > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:16,903 [myid:] - WARN > >> > [LearnerHandler-/10.1.67.28:51888:o.a.z.s.q.LearnerHandler@735] - > >> > ******* GOODBYE /10.1.67.28:51888 ******** > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:16,904 [myid:] - WARN > >> > [LearnerHandler-/10.1.71.8:40626:o.a.z.s.q.LearnerHandler@735] - > >> > ******* GOODBYE /10.1.71.8:40626 ******** > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:16,904 [myid:] - WARN > >> > [LearnerHandler-/10.1.79.102:35670:o.a.z.s.q.LearnerHandler@735] - > >> > ******* GOODBYE /10.1.79.102:35670 ******** > >> > Jun 10 17:39:16 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:16,904 [myid:] - WARN > >> > [LearnerHandler-/10.1.72.1:54384:o.a.z.s.q.LearnerHandler@735] - > >> > ******* GOODBYE /10.1.72.1:54384 ******** > >> > > >> > Then it seems like it can't load (or update) the database? > >> > > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: 2024-06-10 17:39:18,146 [myid:] - ERROR > >> > > [QuorumPeer[myid=5](plain=[0:0:0:0:0:0:0:0]:2181)(secure=[0:0:0:0:0:0:0:0]:3181):o.a.z.s.ZooKeeperServer@892 > ] > >> > - Error updating DB > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: java.io.IOException: Unreasonable length > >> > = 8010890 > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.jute.BinaryInputArchive.checkLength(BinaryInputArchive.java:166) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.jute.BinaryInputArchive.readBuffer(BinaryInputArchive.java:127) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.persistence.Util.readTxnBytes(Util.java:159) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.persistence.FileTxnLog$FileTxnIterator.next(FileTxnLog.java:750) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.persistence.FileTxnLog$FileTxnIterator.<init>(FileTxnLog.java:632) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.persistence.FileTxnLog.read(FileTxnLog.java:448) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.persistence.FileTxnLog.read(FileTxnLog.java:435) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.persistence.FileTxnSnapLog.fastForwardFromEdits(FileTxnSnapLog.java:330) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.ZKDatabase.fastForwardDataBase(ZKDatabase.java:300) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.ZooKeeperServer.shutdown(ZooKeeperServer.java:890) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.ZooKeeperServer.shutdown(ZooKeeperServer.java:838) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.quorum.LeaderZooKeeperServer.shutdown(LeaderZooKeeperServer.java:162) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > org.apache.zookeeper.server.quorum.Leader.shutdown(Leader.java:837) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > org.apache.zookeeper.server.quorum.Leader.lead(Leader.java:803) > >> > Jun 10 17:39:18 zookeeper-5-automation99999 > >> > zookeeper-server[19472]: at > >> > > org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1552) > >> > > >> > After this, zookeeper-4 appears to be elected leader and then hits the > >> > same LearnerHandler crash: > >> > > >> > Jun 10 17:39:17 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: 2024-06-10 17:39:17,208 [myid:] - INFO > >> > > [QuorumPeer[myid=4](plain=[0:0:0:0:0:0:0:0]:2181)(secure=[0:0:0:0:0:0:0:0]:3181):o.a.z.s.q.QuorumPeer@1549 > ] > >> > - LEADING > >> > > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: 2024-06-10 17:39:24,125 [myid:] - ERROR > >> > [LearnerHandler-/10.1.67.28:35566:o.a.z.s.q.LearnerHandler@719] - > >> > Unexpected exception in LearnerHandler: > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: java.io.EOFException: null > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > java.io.DataInputStream.readInt(DataInputStream.java:392) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:96) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > > org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:86) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > > org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:134) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > > org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:656) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: 2024-06-10 17:39:24,125 [myid:] - ERROR > >> > [Sender-/10.1.67.28:35566:o.a.z.s.q.LearnerHandler@372] - > >> > Exception while sending packets in LearnerHandler > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: java.net.SocketException: Connection > >> > reset > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:115) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > java.net.SocketOutputStream.write(SocketOutputStream.java:155) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > java.io.BufferedOutputStream.write(BufferedOutputStream.java:122) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > java.io.DataOutputStream.write(DataOutputStream.java:107) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > java.io.FilterOutputStream.write(FilterOutputStream.java:97) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > > org.apache.jute.BinaryOutputArchive.writeBuffer(BinaryOutputArchive.java:122) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > > org.apache.zookeeper.server.quorum.QuorumPacket.serialize(QuorumPacket.java:71) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > > org.apache.jute.BinaryOutputArchive.writeRecord(BinaryOutputArchive.java:126) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > > org.apache.zookeeper.server.quorum.LearnerHandler.sendPackets(LearnerHandler.java:368) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > > org.apache.zookeeper.server.quorum.LearnerHandler.access$200(LearnerHandler.java:65) > >> > Jun 10 17:39:24 zookeeper-4-automation99999 > >> > zookeeper-server[19461]: at > >> > > org.apache.zookeeper.server.quorum.LearnerHandler$1.run(LearnerHandler.java:751) > >> > > >> > The same thing happens to zookeeper-3, at which point there is no > quorum > >> > so no new leader is elected. I apologize if anything I posted is > wrong and > >> > I'm not intimately familiar with Zookeeper config. Our java process > args > >> > look like > >> > > >> > java -Dzookeeper.log.dir=/var/log/zookeeper > >> > > -Dzookeeper.log.file=zookeeper-zookeeper-server-zookeeper-1-automation99999.log > >> > -XX:+HeapDumpOnOutOfMemoryError -XX:OnOutOfMemoryError=kill -9 %p -cp > >> > > /opt/zookeeper-3.8.4/bin/../zookeeper-server/target/classes:/opt/zookeeper-3.8.4/bin/../build/classes:/opt/zookeeper-3.8.4/bin/../zookeeper-server/target/lib/*.jar:/opt/zookeeper-3.8.4/bin/../build/lib/*.jar:/opt/zookeeper-3.8.4/bin/../lib/zookeeper-prometheus-metrics-3.8.4.jar:/opt/zookeeper-3.8.4/bin/../lib/zookeeper-jute-3.8.4.jar:/opt/zookeeper-3.8.4/bin/../lib/zookeeper-3.8.4.jar:/opt/zookeeper-3.8.4/bin/../lib/snappy-java-1.1.10.5.jar:/opt/zookeeper-3.8.4/bin/../lib/slf4j-api-1.7.30.jar:/opt/zookeeper-3.8.4/bin/../lib/simpleclient_servlet-0.9.0.jar:/opt/zookeeper-3.8.4/bin/../lib/simpleclient_hotspot-0.9.0.jar:/opt/zookeeper-3.8.4/bin/../lib/simpleclient_common-0.9.0.jar:/opt/zookeeper-3.8.4/bin/../lib/simpleclient-0.9.0.jar:/opt/zookeeper-3.8.4/bin/../lib/netty-transport-native-unix-common-4.1.105.Final.jar:/opt/zookeeper-3.8.4/bin/../lib/netty-transport-native-epoll-4.1.105.Final.jar:/opt/zookeeper-3.8.4/bin/../lib/netty-transport-classes-epoll-4.1.105.Final.jar:/opt/zookeeper-3.8.4/bin/../lib/netty-transport-4.1.105.Final.jar:/opt/zookeeper-3.8.4/bin/../lib/netty-resolver-4.1.105.Final.jar:/opt/zookeeper-3.8.4/bin/../lib/netty-handler-4.1.105.Final.jar:/opt/zookeeper-3.8.4/bin/../lib/netty-common-4.1.105.Final.jar:/opt/zookeeper-3.8.4/bin/../lib/netty-codec-4.1.105.Final.jar:/opt/zookeeper-3.8.4/bin/../lib/netty-buffer-4.1.105.Final.jar:/opt/zookeeper-3.8.4/bin/../lib/metrics-core-4.1.12.1.jar:/opt/zookeeper-3.8.4/bin/../lib/logback-core-1.2.13.jar:/opt/zookeeper-3.8.4/bin/../lib/logback-classic-1.2.13.jar:/opt/zookeeper-3.8.4/bin/../lib/jline-2.14.6.jar:/opt/zookeeper-3.8.4/bin/../lib/jetty-util-ajax-9.4.53.v20231009.jar:/opt/zookeeper-3.8.4/bin/../lib/jetty-util-9.4.53.v20231009.jar:/opt/zookeeper-3.8.4/bin/../lib/jetty-servlet-9.4.53.v20231009.jar:/opt/zookeeper-3.8.4/bin/../lib/jetty-server-9.4.53.v20231009.jar:/opt/zookeeper-3.8.4/bin/../lib/jetty-security-9.4.53.v20231009.jar:/opt/zookeeper-3.8.4/bin/../lib/jetty-io-9.4.53.v20231009.jar:/opt/zookeeper-3.8.4/bin/../lib/jetty-http-9.4.53.v20231009.jar:/opt/zookeeper-3.8.4/bin/../lib/javax.servlet-api-3.1.0.jar:/opt/zookeeper-3.8.4/bin/../lib/jackson-databind-2.15.2.jar:/opt/zookeeper-3.8.4/bin/../lib/jackson-core-2.15.2.jar:/opt/zookeeper-3.8.4/bin/../lib/jackson-annotations-2.15.2.jar:/opt/zookeeper-3.8.4/bin/../lib/commons-io-2.11.0.jar:/opt/zookeeper-3.8.4/bin/../lib/commons-cli-1.5.0.jar:/opt/zookeeper-3.8.4/bin/../lib/audience-annotations-0.12.0.jar:/opt/zookeeper-3.8.4/bin/../zookeeper-*.jar:/opt/zookeeper-3.8.4/bin/../zookeeper-server/src/main/resources/lib/*.jar:/opt/zookeeper-3.8.4/conf::/opt/zookeeper-3.8.4/conf:/opt/zookeeper-3.8.4/*:/opt/zookeeper-3.8.4/lib/* > >> > -Xmx1000m > >> > > -Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory > >> > -Dzookeeper.ssl.keyStore.location=<XXXX> > >> > -Dzookeeper.ssl.keyStore.password=<XXXX> > >> > -Dzookeeper.ssl.trustStore.location=<XXXX> > >> > -Dzookeeper.ssl.trustStore.password=<XXXX> -Xms12g -Xmx12g -Xmn8g > >> > -Dfsync.warningthresholdms=200 -Dzookeeper.log.threshold=INFO > >> > -XX:+UseParNewGC -XX:+CMSClassUnloadingEnabled -XX:+UseConcMarkSweepGC > >> > -XX:+CMSIncrementalMode -XX:CMSIncrementalDutyCycle=100 > >> > -XX:-CMSIncrementalPacing -XX:PermSize=160m -XX:MaxPermSize=160m > >> > -XX:SurvivorRatio=4 -Dcom.sun.management.jmxremote > >> > -Dcom.sun.management.jmxremote.local.only=false > >> > org.apache.zookeeper.server.quorum.QuorumPeerMain > >> > /opt/zookeeper-3.8.4/conf/zoo.cfg > >> > > >> > Our zoo.cfg (not including server config looks like: > >> > > >> > tickTime=2000 > >> > peerType=participant > >> > dataDir=/var/lib/zookeeper > >> > dataLogDir=/zookeeper/data > >> > clientPort=2181 > >> > secureClientPort=3181 > >> > maxClientCnxns=20000 > >> > initLimit=5 > >> > syncLimit=2 > >> > > >> > >> > >> -- > >> Ken Mamitsuka > >> Staff Software Engineer, Cantina > >> [email protected] | cantina.com >
