Thank you for the update steps！I've successfully expanded my zookeeper。But
what should I do with Kafka clusters that can't connect to zookeeper，Now the
Kafka cluster can work normally, but it cannot be operated。
Thanks for your help!!
________________________________
发件人: manoj.agraw...@cognizant.com <manoj.agraw...@cognizant.com>
发送时间: 2020年8月30日 11:03
收件人: users@kafka.apache.org <users@kafka.apache.org>
主题: Re: 回复: Kafka cluster cannot connect to zookeeper
Try below
1. Update conf/ zoo.cfg Configure the configuration of exiting one and new
one. server nodes
2. Add myid under dataDir
3. Restart the existing zookeeper node
4. Start the other one zookeeper nodes
5. Update conf/ zoo.cfg Configure the configuration of existing (2
zookeeper) and new one server nodes
6. Add myid under dataDir
7. Restart the existing zookeeper node
8. Start the other one zookeeper nodes
On 8/29/20, 3:52 AM, "Li,Dingqun" <liding...@agora.io> wrote:
[External]
I updated zookeeper's process
1. Update conf/ zoo.cfg Configure the configuration of two new server nodes
2. Add myid under dataDir
3. Restart the existing zookeeper node
4. Start the other two zookeeper nodes
5. The existing zookeeper node is changed from stand-alone to leader
zookeeper version 3.4.14-4
kafka version 2.3.0
This is part of the log：
[2020-08-28 08:43:23,872] INFO Got user-level KeeperException when
processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x5 zxid:0x2000005e0
txnt ype:-1 reqpath:n/a Error Path:/brokers/topics Error:KeeperErrorCode =
NodeExists for /brokers/topics (org.apache.zookeeper.server.PrepRequestProcesso
r)
181 [2020-08-28 08:43:23,945] INFO Got user-level KeeperException when
processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x6 zxid:0x2000005e1
txnt ype:-1 reqpath:n/a Error Path:/config/changes Error:KeeperErrorCode =
NodeExists for /config/changes (org.apache.zookeeper.server.PrepRequestProcesso
r)
182 [2020-08-28 08:43:24,018] INFO Got user-level KeeperException when
processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x7 zxid:0x2000005e2
txnt ype:-1 reqpath:n/a Error Path:/admin/delete_topics
Error:KeeperErrorCode = NodeExists for /admin/delete_topics
(org.apache.zookeeper.server.PrepReque stProcessor)
183 [2020-08-28 08:43:24,092] INFO Got user-level KeeperException when
processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x8 zxid:0x2000005e3
txnt ype:-1 reqpath:n/a Error Path:/brokers/seqid Error:KeeperErrorCode =
NodeExists for /brokers/seqid (org.apache.zookeeper.server.PrepRequestProcessor)
184 [2020-08-28 08:43:24,166] INFO Got user-level KeeperException when
processing sessionid:0x7d0679e7c0a90004 type:create cxid:0x9 zxid:0x2000005e4
txnt ype:-1 reqpath:n/a Error Path:/isr_change_notification
Error:KeeperErrorCode = NodeExists for /isr_change_notification
(org.apache.zookeeper.server.P repRequestProcessor)
185 [2020-08-28 08:43:24,240] INFO Got user-level KeeperException when
processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xa zxid:0x2000005e5
txnt ype:-1 reqpath:n/a Error Path:/latest_producer_id_block
Error:KeeperErrorCode = NodeExists for /latest_producer_id_block
(org.apache.zookeeper.server .PrepRequestProcessor)
186 [2020-08-28 08:43:24,313] INFO Got user-level KeeperException when
processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xb zxid:0x2000005e6
txnt ype:-1 reqpath:n/a Error Path:/log_dir_event_notification
Error:KeeperErrorCode = NodeExists for /log_dir_event_notification
(org.apache.zookeeper.se rver.PrepRequestProcessor)
187 [2020-08-28 08:43:24,388] INFO Got user-level KeeperException when
processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xc zxid:0x2000005e7
txnt ype:-1 reqpath:n/a Error Path:/config/topics Error:KeeperErrorCode =
NodeExists for /config/topics (org.apache.zookeeper.server.PrepRequestProcessor)
188 [2020-08-28 08:43:24,461] INFO Got user-level KeeperException when
processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xd zxid:0x2000005e8
txnt ype:-1 reqpath:n/a Error Path:/config/clients Error:KeeperErrorCode =
NodeExists for /config/clients (org.apache.zookeeper.server.PrepRequestProcesso
r)
189 [2020-08-28 08:43:24,534] INFO Got user-level KeeperException when
processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xe zxid:0x2000005e9
txnt ype:-1 reqpath:n/a Error Path:/config/users Error:KeeperErrorCode =
NodeExists for /config/users (org.apache.zookeeper.server.PrepRequestProcessor)
190 [2020-08-28 08:43:24,607] INFO Got user-level KeeperException when
processing sessionid:0x7d0679e7c0a90004 type:create cxid:0xf zxid:0x2000005ea
txnt ype:-1 reqpath:n/a Error Path:/config/brokers Error:KeeperErrorCode =
NodeExists for /config/brokers (org.apache.zookeeper.server.PrepRequestProcesso
r)
191 [2020-08-28 08:45:03,991] WARN Connection broken for id 74, my id =
185, error = (org.apache.zookeeper.server.quorum.QuorumCnxManager)
192 java.io.EOFException
193 at java.io.DataInputStream.readInt(DataInputStream.java:392)
194 at
org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:1010)
195 [2020-08-28 08:45:03,991] WARN Interrupting SendWorker
(org.apache.zookeeper.server.quorum.QuorumCnxManager)
196 [2020-08-28 08:45:03,991] WARN Interrupted while waiting for message on
queue (org.apache.zookeeper.server.quorum.QuorumCnxManager)
197 java.lang.InterruptedException
198 at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
Thanks for your help!
________________________________
发件人: manoj.agraw...@cognizant.com <manoj.agraw...@cognizant.com>
发送时间: 2020年8月29日 0:01
收件人: users@kafka.apache.org <users@kafka.apache.org>
主题: Re: Kafka cluster cannot connect to zookeeper
You have'nt describe how you are adding zookeeper .
Right way to add zookeeper
One host at a time
1. update the existing zookeeper node conf/zoo.cfg by adding new host
2. restart the zk process on existing host
3. start the zk process in new node
On 8/28/20, 8:20 AM, "Li,Dingqun" <liding...@agora.io> wrote:
[External]
We have one zookeeper node and two Kafka nodes. After that, we expand
the capacity of zookeeper: change the configuration of zookeeper node, restart
it, and add two zookeeper nodes. After that, my Kafka cluster could not connect
to the zookeeper cluster, and there was no information available in the log.
What should we do? Thank you
This e-mail and any files transmitted with it are for the sole use of the
intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient(s), please reply to the sender and
destroy all copies of the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email,
and/or any action taken in reliance on the contents of this e-mail is strictly
prohibited and may be unlawful. Where permitted by applicable law, this e-mail
and other e-mail communications sent to and from Cognizant e-mail addresses may
be monitored.
This e-mail and any files transmitted with it are for the sole use of the
intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient(s), please reply to the sender and
destroy all copies of the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email,
and/or any action taken in reliance on the contents of this e-mail is strictly
prohibited and may be unlawful. Where permitted by applicable law, this e-mail
and other e-mail communications sent to and from Cognizant e-mail addresses may
be monitored.
This e-mail and any files transmitted with it are for the sole use of the
intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient(s), please reply to the sender and
destroy all copies of the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email,
and/or any action taken in reliance on the contents of this e-mail is strictly
prohibited and may be unlawful. Where permitted by applicable law, this e-mail
and other e-mail communications sent to and from Cognizant e-mail addresses may
be monitored.
This e-mail and any files transmitted with it are for the sole use of the
intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient(s), please reply to the sender and
destroy all copies of the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email,
and/or any action taken in reliance on the contents of this e-mail is strictly
prohibited and may be unlawful. Where permitted by applicable law, this e-mail
and other e-mail communications sent to and from Cognizant e-mail addresses may
be monitored.
