Hi,
I have 2 Kafka Connect instances runs in 2 boxes which forms a Kafka
Connect Cluster. One of the instance seems doing the re-balance repeatedly
in a dead loop without running the actual Sink task, the other works fine.
The following is the output message in the console.
May I ask if you have ever encountered similar issue before ?
Thank you so much !
[2018-03-21 14:53:15,671] WARN Catching up to assignment's config offset.
> (org.apache.kafka.connect.runtime.distributed.DistributedHerder:762)
> [2018-03-21 14:53:15,671] INFO Current config state offset 119 is behind
> group assignment 169, reading to end of config log
> (org.apache.kafka.connect.runtime.distributed.DistributedHerder:807)
> [2018-03-21 14:53:16,046] INFO Finished reading to end of log and updated
> config snapshot, new config log offset: 119
> (org.apache.kafka.connect.runtime.distributed.DistributedHerder:811)
> [2018-03-21 14:53:16,046] INFO Current config state offset 119 does not
> match group assignment 169. Forcing rebalance.
> (org.apache.kafka.connect.runtime.distributed.DistributedHerder:786)
> [2018-03-21 14:53:16,046] INFO Rebalance started
> (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1214)
> [2018-03-21 14:53:16,046] INFO Wasn't unable to resume work after last
> rebalance, can skip stopping connectors and tasks
> (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1246)
> [2018-03-21 14:53:16,046] INFO [Worker clientId=connect-1,
> groupId=kafka-connect-NA-sink] (Re-)joining group
> (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:336)
> [2018-03-21 14:53:16,172] INFO [Worker clientId=connect-1,
> groupId=kafka-connect-NA-sink] Successfully joined group with generation 14
> (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:341)
> [2018-03-21 14:53:16,173] INFO Joined group and got assignment:
> Assignment{error=0,
> leader='connect-1-3b12c02b-070e-431b-9ec9-924cffd2b6dc', leaderUrl='
> http://1.1.1.1:8083/', offset=169, connectorIds=[Send_To_NA],
> taskIds=[Send_To_NA-1, Send_To_NA-3, Send_To_NA-5, Send_To_NA-7,
> Send_To_NA-9, Send_To_NA-11, Send_To_NA-13, Send_To_NA-15, Send_To_NA-17,
> Send_To_NA-19, Send_To_NA-21]}
> (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1192
--
Regards, Zi-Liang
Mail:zlchen....@gmail.com
