[DISCUSS] KafkaConsumer pause(Collection partitions)

Hi Kafka devs, For the existing KafkaConsumer pause method, I think it needs to be improved. At the same time, KafkaConsumer should be able to support the pause method that is not affected by groupRebalance. I give some suggestions on this, I hope you can actively participate in the discussion.

Re: [DISCUSS] KIP-796: Interactive Query v2

Ah, sorry, Guozhang, It seem I was a bit too eager with starting the vote thread. 13: I think that makes perfect sense. I've updated the KIP. 14: Oof, I can't believe I overlooked those newer exceptions. Some of them will become exceptions in IQv2, whereas others will beceome individual

[jira] [Created] (KAFKA-13463) Improvement: KafkaConsumer pause(Collection partitions)

RivenSun created KAFKA-13463: Summary: Improvement: KafkaConsumer pause(Collection partitions) Key: KAFKA-13463 URL: https://issues.apache.org/jira/browse/KAFKA-13463 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-13462) KRaft server does not return internal topics on list topics RPC

dengziming created KAFKA-13462: -- Summary: KRaft server does not return internal topics on list topics RPC Key: KAFKA-13462 URL: https://issues.apache.org/jira/browse/KAFKA-13462 Project: Kafka

Re: [DISCUSS] KIP-797 Accept duplicate listener on port for IPv4/IPv6

Hi Matthew, Thanks for the KIP. I have a question: If I remembered correctly, the "advertised listeners" already support duplicated ports, so your KIP should only focus on "listeners" configuration, is that right? If so, could you please make it clear in KIP, to mention that your change only

Re: [DISCUSS] KIP-778 KRaft Upgrades

Hi Colin/David, > Like David said, basically it boils down to creating a feature flag for the new proposed __consumer_offsets version, or using a new IBP/metadata.version for it. Both approaches have pros and cons. Using an IBP/metadata.version bump reduces the size of the testing matrix. But

Re: [DISCUSS] KIP-778 KRaft Upgrades

A few additional questions: 1. Currently the IBP tells us what version of individual inter-broker RPCs will be used. I think the plan in this KIP is to use ApiVersions request instead to find the highest compatible version (just like clients). Do I have that right? 2. The following wasn't very

Re: [DISCUSS] KIP-778 KRaft Upgrades

On Wed, Nov 17, 2021, at 11:28, Jason Gustafson wrote: > Hi David, > > Forgive me if this ground has been covered already. Today, we have a few > other things that we have latched onto the IBP, such as upgrades to the > format of records in __consumer_offsets. I've been assuming that >

Re: [DISCUSS] KIP-796: Interactive Query v2

Thanks John. I made another pass on the KIP and overall it already looks pretty good. I just have a couple more minor comments: 13: What do you think about just removing the following function in QueryResult // returns a failed query result because caller requested a "latest" bound, but the

Re: [DISCUSS] KIP-778 KRaft Upgrades

On Wed, Nov 17, 2021, at 12:28, David Arthur wrote: > Colin, > > I wasn't intending to suggest that IBP and metadata.version co-exist long > term in KRaft. I was thinking we would have one final IBP that would signal > KRaft clusters to start looking at metadata.version instead. This > was working

Re: [VOTE] KIP-796: Interactive Query v2

Obviously, I will be voting +1 (binding) Thanks, -John On Wed, 2021-11-17 at 17:27 -0600, John Roesler wrote: > Hello all, > > I'd like to open the vote for KIP-796, which proposes > a revamp of the Interactive Query APIs in Kafka Streams. > > The proposal is here: >

[VOTE} KIP-796: Interactive Query v2

Hello all, I'd like to open the vote for KIP-796, which proposes a revamp of the Interactive Query APIs in Kafka Streams. The proposal is here: https://cwiki.apache.org/confluence/x/34xnCw Thanks to all who reviewed the proposal, and thanks in advance for taking the time to vote! Thank you,

Re: [DISCUSS] KIP-796: Interactive Query v2

Thanks for the reply, Guozhang! I have updated the KIP to tie up the remaining points that we have discussed. I really appreciate your time in refining the proposal. I included a quick summary of the final state of our discussion points below. Since it seems like this discussion thread is pretty

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.1 #19

See

Re: [DISCUSS] KIP-778 KRaft Upgrades

Jason, thanks for the review! No, I don't think that has been covered explicitly and no metadata.version will not gate things like our offsets format. The intention is that we will introduce new KIP-584 feature flags for those formats once the need arises. For ZK clusters, we'll probably keep

Re: [DISCUSS] KIP-778 KRaft Upgrades

Colin, I wasn't intending to suggest that IBP and metadata.version co-exist long term in KRaft. I was thinking we would have one final IBP that would signal KRaft clusters to start looking at metadata.version instead. This was working under the assumption that we should be able to upgrade 3.0

[jira] [Created] (KAFKA-13461) KafkaController stops functioning as active controller after ZooKeeperClient auth failure

Vincent Jiang created KAFKA-13461: - Summary: KafkaController stops functioning as active controller after ZooKeeperClient auth failure Key: KAFKA-13461 URL: https://issues.apache.org/jira/browse/KAFKA-13461

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.1 #18

See

Re: [DISCUSS] KIP-778 KRaft Upgrades

Hi David, Forgive me if this ground has been covered already. Today, we have a few other things that we have latched onto the IBP, such as upgrades to the format of records in __consumer_offsets. I've been assuming that metadata.version is not covering this. Is that right or is there some other

Re: [DISCUSS] KIP-778 KRaft Upgrades

Hi, Colin, Thanks for the reply. For case b, I am not sure that I understand your suggestion. Does "each subsequent level for metadata.version corresponds to an IBP version" mean that we need to keep IBP forever? Could you describe the upgrade process in this case? Jun On Tue, Nov 16, 2021 at

[jira] [Resolved] (KAFKA-12257) Consumer mishandles topics deleted and recreated with the same name

[ https://issues.apache.org/jira/browse/KAFKA-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-12257. - Resolution: Fixed > Consumer mishandles topics deleted and recreated with the same

Re: [DISCUSS] KIP-796: Interactive Query v2

Thanks for the reply, Sagar, Thanks for bringing up the point about documentation, I do think it would be a great idea for us to add a section to the IQ doc page that's basically a "store extension guide" that gives an overview of how to implement custom queries and custom stores. That would help

[jira] [Resolved] (KAFKA-13397) MirrorMaker2 shouldn't mirror Connect's internal topics

[ https://issues.apache.org/jira/browse/KAFKA-13397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13397. Fix Version/s: 3.2.0 Resolution: Fixed > MirrorMaker2 shouldn't mirror Connect's

Re: Wiki Permissions

Done. On 11/16/21 9:59 PM, Riven Sun wrote: Hello, team I'd like to be added to the contributors list, so I can submit a KIP. My Jira ID is: RivenSun Wiki ID: rivensun Best Regards --- RivenSun

[jira] [Resolved] (KAFKA-13460) Issue reporting

[ https://issues.apache.org/jira/browse/KAFKA-13460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13460. - Resolution: Won't Fix > Issue reporting > --- > > Key:

[jira] [Created] (KAFKA-13460) Issue reporting

Mikolaj Ryll created KAFKA-13460: Summary: Issue reporting Key: KAFKA-13460 URL: https://issues.apache.org/jira/browse/KAFKA-13460 Project: Kafka Issue Type: Wish Components:

Re: [DISCUSS] KIP-796: Interactive Query v2

Thanks John for answering the 2 questions. Pt #1 makes sense to me now. Regarding Pt #2, first of all thanks for bringing up KIP-614 :D I did learn about the interfaces the hard way and probably due to that, the PR really stretched a lot. Having said that, the point that you mentioned about any

[jira] [Created] (KAFKA-13459) MM2 should be able to add the source offset to the record header

Daniel Urban created KAFKA-13459: Summary: MM2 should be able to add the source offset to the record header Key: KAFKA-13459 URL: https://issues.apache.org/jira/browse/KAFKA-13459 Project: Kafka

Wiki Permissions

Hello, team I'd like to be added to the contributors list, so I can submit a KIP. My Jira ID is: RivenSun Wiki ID: rivensun Best Regards --- RivenSun

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.1 #17

See

[jira] [Created] (KAFKA-13458) The Stream is not able to consume from some of the partitions

Darshan Marathe created KAFKA-13458: --- Summary: The Stream is not able to consume from some of the partitions Key: KAFKA-13458 URL: https://issues.apache.org/jira/browse/KAFKA-13458 Project: Kafka

Re: Requesting permissions to contribute to Apache Kafka

Excellent, thank you so much for the quick help, David! --Gunnar Am Mi., 17. Nov. 2021 um 10:42 Uhr schrieb David Jacot : > Hi Gunnar, > > I have granted you the requested permissions. > > I am looking forward to your contributions. > > Best, > David > > On Wed, Nov 17, 2021 at 10:32 AM Gunnar

Re: Requesting permissions to contribute to Apache Kafka

Hi Gunnar, I have granted you the requested permissions. I am looking forward to your contributions. Best, David On Wed, Nov 17, 2021 at 10:32 AM Gunnar Morling wrote: > > Hi, > > As per the instructions given in [1], I would like to request the > permissions for creating a KIP. My ids are: >

Requesting permissions to contribute to Apache Kafka

Hi, As per the instructions given in [1], I would like to request the permissions for creating a KIP. My ids are: * Wiki: gunnarmorling * Jira: gunnar.morling Thanks a lot, --Gunnar [1] https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals