Hi All, Hope you are doing well!
I am stuck with an issue while running the reconfig command from zookeeper-shell to add a new node into an existing ensemble of 3 nodes. And here are the steps I followed so far: 1.Added the below 2 parameters in zookeeper.properties file in all 3 nodes of the current ensemble and restarted the zookeeper service in a rolling fashion- reconfigEnabled=true dynamicConfigFile=/etc/zookeeper/zoo_replicated100.cfg.dynamic where 100 is 200 and 1000 in node 2 and node 3 2.Created a zookeeper superuser using superdigest like below - java -cp $ZK_CLASSPATH org.apache.zookeeper.server.auth.DigestAuthenticationProvider super:password 3. Run the zookeeper-shell like below - SERVER_JVMFLAGS=-Dzookeeper.DigestAuthenticationProvider.superDigest=super:htjTSxY4gyCGgswgQC3SbCS9xrI= zookeeper-shell db-zk-test2-2:2181 Connecting to db-zk-test2-2:2181 Welcome to ZooKeeper! JLine support is disabled WATCHER:: WatchedEvent state:SyncConnected type:None path:null addauth digest super:password reconfig -add server.7=db-zk-test3-1:2888:3888:participant;2181 Insufficient permission : quit [2023-02-27 18:00:08,379] WARN An exception was thrown while closing send thread for session 0x2001572b1770001. (org.apache.zookeeper.ClientCnxn) EndOfStreamException: Unable to read additional data from server sessionid 0x2001572b1770001, likely server has closed socket at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) WATCHER:: WatchedEvent state:Closed type:None path:null [2023-02-27 18:00:08,492] ERROR Exiting JVM with code 1 (org.apache.zookeeper.util.ServiceUtils) The zookeeper version is 3.6.3--6401e4ad2087061bc6b9f80dec2d69f2e3c8660a, built on 04/08/2021 16:35 GMT The ensemble is used as quorum for a kafka cluster and I am trying to avoid downtime when moving to new ensemble and a new set of brokers. The plan to migrate to a new ensemble is by adding 4 more nodes using the reconfig cmds one by one to expand the current ensemble of 3 nodes to 7 nodes so that I can just remove the old 3 nodes using the same reconfig cmd. Appreciate your valuable time in going through the issue. Please let me know if you need any further details. Thanks, Rijo Roy
