I have been doing more investigation, and I have discovered that my follower servers are not listening on port 2888. The leader is listening. I am using zookeeper 3.9.2
TLDR; Is it expected that only the leader would listen on the peer port (2888). Here is my zoo.cfg *tickTime=2000* *dataDir=/hadoop/data/zookeeper* *clientPort=2181* *initLimit=10* *syncLimit=20* *server.1=dn1:2888:3888* *server.2=dn2:2888:3888* *server.3=dn3:2888:3888* *4lw.commands.whitelist=** I am using 3 separate physical machines (not docker) And on all 3 servers return *echo ruok | nc localhost 2181* *imok* Status shows that I have 1 leader and 2 followers *echo status | nc localhost 2181* *Zookeeper version: 3.9.2-e454e8c7283100c7caec6dcae2bc82aaecb63023, built on 2024-02-12 20:59 UTC* *Clients:* * /192.168.1.199:38052[1](queued=0,recved=44,sent=53)* * /127.0.0.1:54040[0](queued=0,recved=1,sent=0)* * /192.168.1.108:41238[1](queued=0,recved=40,sent=47)* *Latency min/avg/max: 0/1.3493/8* *Received: 151* *Sent: 186* *Connections: 3* *Outstanding: 0* *Zxid: 0x1700000039* *Mode: leader* *Node count: 28* *Proposal sizes last/min/max: 36/36/438* Netstat shows that the leader only is listening on port 2888, the followers are not listening at all. *netstat -tuln | grep 2888* *tcp6 0 0 192.168.1.108 <http://192.168.1.108>:2888 :::* LISTEN * On the leader I see the following when I grep for 2888 /logs/zootmp/zoo2.txt:2024-11-15 21:07:45,424 [myid:] - INFO [LearnerCnxAcceptorHandler-dn2/192.168.1.109:*2888* :o.a.z.s.q.LearnerHandler@76] - zookeeper.leader.closeSocketAsync = false /logs/zootmp/zoo2.txt:2024-11-15 21:07:45,426 [myid:] - INFO [LearnerHandler-/192.168.1.199:56042:o.a.z.s.q.LearnerHandler@511] - Follower sid: 1 : info : dn1:*2888*:3888:participant /logs/zootmp/zoo2.txt:2024-11-15 21:07:47,905 [myid:] - INFO [LearnerHandler-/192.168.1.108:36870:o.a.z.s.q.LearnerHandler@511] - Follower sid: 3 : info : dn3:*2888*:3888:participant /logs/zootmp/zoo2.txt:2024-11-15 21:07:53,157 [myid:] - INFO [LearnerHandler-/192.168.1.108:36880:o.a.z.s.q.LearnerHandler@511] - Follower sid: 3 : info : dn3:*2888*:3888:participant On the followers I see /logs/zootmp/zoo3.txt:21:07:53.155 [LeaderConnector-dn2/192.168.1.109:*2888*] INFO org.apache.zookeeper.server.quorum.Learner - Successfully connected to leader, using address: dn2/192.168.1.109:*2888*
