[jira] [Commented] (KAFKA-16657) KIP-848 does not work well on Zookeeper Mode
[ https://issues.apache.org/jira/browse/KAFKA-16657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843244#comment-17843244 ] sanghyeok An commented on KAFKA-16657: -- Thanks for your comments. I totally understood (y) > KIP-848 does not work well on Zookeeper Mode > > > Key: KAFKA-16657 > URL: https://issues.apache.org/jira/browse/KAFKA-16657 > Project: Kafka > Issue Type: Bug >Reporter: sanghyeok An >Priority: Major > > Hi, Kafka Team. > I am testing the new rebalance protocol of KIP-848. It seems that the KIP-848 > protocol works well in KRaft mode. However, KIP-848 protocol does not work > well in `Zookeeper` mode. > > I have created two versions of docker-compose files for Zookeeper Mode and > KRaft Mode. And I tested KIP-848 using the same consumer code and settings. > > In KRaft Mode, the consumer received the assignment correctly. However, an > error occurred in Zookeeper Mode. > > *Is KIP-848 supported in Zookeeper mode? or only KRaft is supported?* > > FYI, This is the code I used. > * ZK docker-compose: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose2/docker-compose.yaml > * ZK Result: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose2/README.md > * KRaft docker-compose: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose3/docker-compose.yaml > * KRaft Result: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose3/README.md > * Consumer code: > https://github.com/chickenchickenlove/kraft-test/blob/main/src/main/java/org/example/Main.java > > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KAFKA-16657) KIP-848 does not work well on Zookeeper Mode
[ https://issues.apache.org/jira/browse/KAFKA-16657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843236#comment-17843236 ] Andrew Schofield commented on KAFKA-16657: -- Ah, sorry for the jargon :) Apache Kafka = AK. The latest release is Apache Kafka 3.7. This release supports KRaft and ZooKeeper. The release under development is Apache Kafka 3.8. This release supports KRaft and ZooKeeper, but it's the final release that supports ZooKeeper. The following one is Apache Kafka 4.0. This release only has KRaft. This is why some features only work with KRaft. Soon, Kafka will be KRaft only. > KIP-848 does not work well on Zookeeper Mode > > > Key: KAFKA-16657 > URL: https://issues.apache.org/jira/browse/KAFKA-16657 > Project: Kafka > Issue Type: Bug >Reporter: sanghyeok An >Priority: Major > > Hi, Kafka Team. > I am testing the new rebalance protocol of KIP-848. It seems that the KIP-848 > protocol works well in KRaft mode. However, KIP-848 protocol does not work > well in `Zookeeper` mode. > > I have created two versions of docker-compose files for Zookeeper Mode and > KRaft Mode. And I tested KIP-848 using the same consumer code and settings. > > In KRaft Mode, the consumer received the assignment correctly. However, an > error occurred in Zookeeper Mode. > > *Is KIP-848 supported in Zookeeper mode? or only KRaft is supported?* > > FYI, This is the code I used. > * ZK docker-compose: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose2/docker-compose.yaml > * ZK Result: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose2/README.md > * KRaft docker-compose: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose3/docker-compose.yaml > * KRaft Result: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose3/README.md > * Consumer code: > https://github.com/chickenchickenlove/kraft-test/blob/main/src/main/java/org/example/Main.java > > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KAFKA-16657) KIP-848 does not work well on Zookeeper Mode
[ https://issues.apache.org/jira/browse/KAFKA-16657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843231#comment-17843231 ] sanghyeok An commented on KAFKA-16657: -- Thanks for conforming it!! Sorry to say, i'm not familiar with AK 4.0. Could you give more context about AK? (A... Kafka?) > KIP-848 does not work well on Zookeeper Mode > > > Key: KAFKA-16657 > URL: https://issues.apache.org/jira/browse/KAFKA-16657 > Project: Kafka > Issue Type: Bug >Reporter: sanghyeok An >Priority: Major > > Hi, Kafka Team. > I am testing the new rebalance protocol of KIP-848. It seems that the KIP-848 > protocol works well in KRaft mode. However, KIP-848 protocol does not work > well in `Zookeeper` mode. > > I have created two versions of docker-compose files for Zookeeper Mode and > KRaft Mode. And I tested KIP-848 using the same consumer code and settings. > > In KRaft Mode, the consumer received the assignment correctly. However, an > error occurred in Zookeeper Mode. > > *Is KIP-848 supported in Zookeeper mode? or only KRaft is supported?* > > FYI, This is the code I used. > * ZK docker-compose: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose2/docker-compose.yaml > * ZK Result: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose2/README.md > * KRaft docker-compose: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose3/docker-compose.yaml > * KRaft Result: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose3/README.md > * Consumer code: > https://github.com/chickenchickenlove/kraft-test/blob/main/src/main/java/org/example/Main.java > > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KAFKA-16657) KIP-848 does not work well on Zookeeper Mode
[ https://issues.apache.org/jira/browse/KAFKA-16657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843227#comment-17843227 ] Andrew Schofield commented on KAFKA-16657: -- I just checked the KIP and I don't think it says explicitly. However, I worked on the client for this KIP and it was certainly necessary to enable KRaft for all of the tests. Having just created a ZK broker, I can confirm that a consumer which tries to connect with the new protocol fails with `org.apache.kafka.common.errors.UnsupportedVersionException`. For one thing, this KIP is expected to reach production readiness in AK 4.0 and that's KRaft only. > KIP-848 does not work well on Zookeeper Mode > > > Key: KAFKA-16657 > URL: https://issues.apache.org/jira/browse/KAFKA-16657 > Project: Kafka > Issue Type: Bug >Reporter: sanghyeok An >Priority: Major > > Hi, Kafka Team. > I am testing the new rebalance protocol of KIP-848. It seems that the KIP-848 > protocol works well in KRaft mode. However, KIP-848 protocol does not work > well in `Zookeeper` mode. > > I have created two versions of docker-compose files for Zookeeper Mode and > KRaft Mode. And I tested KIP-848 using the same consumer code and settings. > > In KRaft Mode, the consumer received the assignment correctly. However, an > error occurred in Zookeeper Mode. > > *Is KIP-848 supported in Zookeeper mode? or only KRaft is supported?* > > FYI, This is the code I used. > * ZK docker-compose: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose2/docker-compose.yaml > * ZK Result: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose2/README.md > * KRaft docker-compose: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose3/docker-compose.yaml > * KRaft Result: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose3/README.md > * Consumer code: > https://github.com/chickenchickenlove/kraft-test/blob/main/src/main/java/org/example/Main.java > > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KAFKA-16657) KIP-848 does not work well on Zookeeper Mode
[ https://issues.apache.org/jira/browse/KAFKA-16657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843212#comment-17843212 ] sanghyeok An commented on KAFKA-16657: -- [~schofielaj] Thanks for your comments. Is there a document where that is specified? I tried looking for it in this document, but it wasn't there https://cwiki.apache.org/confluence/display/KAFKA/KIP-848%3A+The+Next+Generation+of+the+Consumer+Rebalance+Protocol > KIP-848 does not work well on Zookeeper Mode > > > Key: KAFKA-16657 > URL: https://issues.apache.org/jira/browse/KAFKA-16657 > Project: Kafka > Issue Type: Bug >Reporter: sanghyeok An >Priority: Major > > Hi, Kafka Team. > I am testing the new rebalance protocol of KIP-848. It seems that the KIP-848 > protocol works well in KRaft mode. However, KIP-848 protocol does not work > well in `Zookeeper` mode. > > I have created two versions of docker-compose files for Zookeeper Mode and > KRaft Mode. And I tested KIP-848 using the same consumer code and settings. > > In KRaft Mode, the consumer received the assignment correctly. However, an > error occurred in Zookeeper Mode. > > *Is KIP-848 supported in Zookeeper mode? or only KRaft is supported?* > > FYI, This is the code I used. > * ZK docker-compose: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose2/docker-compose.yaml > * ZK Result: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose2/README.md > * KRaft docker-compose: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose3/docker-compose.yaml > * KRaft Result: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose3/README.md > * Consumer code: > https://github.com/chickenchickenlove/kraft-test/blob/main/src/main/java/org/example/Main.java > > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KAFKA-16657) KIP-848 does not work well on Zookeeper Mode
[ https://issues.apache.org/jira/browse/KAFKA-16657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843119#comment-17843119 ] Andrew Schofield commented on KAFKA-16657: -- My understanding is that the new consumer group protocol is only available in KRaft mode. > KIP-848 does not work well on Zookeeper Mode > > > Key: KAFKA-16657 > URL: https://issues.apache.org/jira/browse/KAFKA-16657 > Project: Kafka > Issue Type: Bug >Reporter: sanghyeok An >Priority: Major > > Hi, Kafka Team. > I am testing the new rebalance protocol of KIP-848. It seems that the KIP-848 > protocol works well in KRaft mode. However, KIP-848 protocol does not work > well in `Zookeeper` mode. > > I have created two versions of docker-compose files for Zookeeper Mode and > KRaft Mode. And I tested KIP-848 using the same consumer code and settings. > > In KRaft Mode, the consumer received the assignment correctly. However, an > error occurred in Zookeeper Mode. > > *Is KIP-848 supported in Zookeeper mode? or only KRaft is supported?* > > FYI, This is the code I used. > * ZK docker-compose: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose2/docker-compose.yaml > * ZK Result: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose2/README.md > * KRaft docker-compose: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose3/docker-compose.yaml > * KRaft Result: > https://github.com/chickenchickenlove/kraft-test/blob/main/docker-compose3/README.md > * Consumer code: > https://github.com/chickenchickenlove/kraft-test/blob/main/src/main/java/org/example/Main.java > > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
