[jira] [Resolved] (KAFKA-16815) Handle FencedInstanceId on heartbeat for new consumer

2024-05-24 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16815. - Fix Version/s: 3.8.0 Reviewer: David Jacot Resolution: Fixed > Han

[jira] [Resolved] (KAFKA-16626) Uuid to String for subscribed topic names in assignment spec

2024-05-24 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16626. - Fix Version/s: 3.8.0 Resolution: Fixed > Uuid to String for subscribed topic na

[jira] [Resolved] (KAFKA-16793) Heartbeat API for upgrading ConsumerGroup

2024-05-23 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16793. - Fix Version/s: 3.8.0 Reviewer: David Jacot Resolution: Fixed > Heartbeat

[jira] [Resolved] (KAFKA-16762) SyncGroup API for upgrading ConsumerGroup

2024-05-17 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16762. - Fix Version/s: 3.8.0 Reviewer: David Jacot Resolution: Fixed > SyncGroup

Re: [VOTE] KIP-932: Queues for Kafka

2024-05-16 Thread David Jacot
Hi Andrew, Thanks for the KIP! This is really exciting! +1 (binding) from me. One note regarding the partition assignor interface changes that you proposed, it would be great to get the changes in 3.8 in order to not break the API of KIP-848 after the preview. Best, David On Wed, May 15, 2024

[jira] [Created] (KAFKA-16770) Coalesce records into bigger batches

2024-05-15 Thread David Jacot (Jira)
David Jacot created KAFKA-16770: --- Summary: Coalesce records into bigger batches Key: KAFKA-16770 URL: https://issues.apache.org/jira/browse/KAFKA-16770 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-16694) Remove rack aware code in assignors temporarily due to performance

2024-05-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16694. - Fix Version/s: 3.8.0 Resolution: Fixed > Remove rack aware code in assignors temporar

[jira] [Resolved] (KAFKA-15578) Run System Tests for Old protocol in the New Coordinator

2024-05-13 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15578. - Resolution: Fixed > Run System Tests for Old protocol in the New Coordina

[jira] [Resolved] (KAFKA-16117) Add Integration test for checking if the correct assignor is chosen

2024-05-13 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16117. - Fix Version/s: 3.8.0 Resolution: Fixed > Add Integration test for check

[jira] [Resolved] (KAFKA-16735) Deprecate offsets.commit.required.acks in 3.8

2024-05-13 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16735. - Resolution: Fixed > Deprecate offsets.commit.required.acks in

[jira] [Created] (KAFKA-16736) Remove offsets.commit.required.acks in 4.0

2024-05-13 Thread David Jacot (Jira)
David Jacot created KAFKA-16736: --- Summary: Remove offsets.commit.required.acks in 4.0 Key: KAFKA-16736 URL: https://issues.apache.org/jira/browse/KAFKA-16736 Project: Kafka Issue Type: Sub

[jira] [Created] (KAFKA-16735) Deprecate offsets.commit.required.acks in 3.8

2024-05-13 Thread David Jacot (Jira)
David Jacot created KAFKA-16735: --- Summary: Deprecate offsets.commit.required.acks in 3.8 Key: KAFKA-16735 URL: https://issues.apache.org/jira/browse/KAFKA-16735 Project: Kafka Issue Type: Sub

Re: [VOTE] KIP-1041: Drop `offsets.commit.required.acks` config in 4.0 (deprecate in 3.8)

2024-05-13 Thread David Jacot
gt; > > > > On Wed, May 8, 2024 at 5:27 PM Andrew Schofield > > > wrote: > > > > > > > > Hi, > > > > Thanks for the KIP. > > > > > > > > +1 (non-binding) > > > > > > > > Thanks, > > > > A

[jira] [Resolved] (KAFKA-16587) Store subscription model for consumer group in group state

2024-05-13 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16587. - Fix Version/s: 3.8.0 Reviewer: David Jacot Resolution: Fixed > St

[jira] [Resolved] (KAFKA-16663) CoordinatorRuntime write timer tasks should be cancelled once HWM advances

2024-05-13 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16663. - Fix Version/s: 3.8.0 Reviewer: David Jacot Resolution: Fixed

[VOTE] KIP-1041: Drop `offsets.commit.required.acks` config in 4.0 (deprecate in 3.8)

2024-05-08 Thread David Jacot
Hi folks, I'd like to start a voting thread for KIP-1041: Drop `offsets.commit.required.acks` config in 4.0 (deprecate in 3.8). KIP: https://cwiki.apache.org/confluence/x/9YobEg Best, David

[jira] [Resolved] (KAFKA-16307) fix EventAccumulator thread idle ratio metric

2024-05-07 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16307. - Fix Version/s: 3.8.0 Reviewer: David Jacot Resolution: Fixed >

[jira] [Resolved] (KAFKA-16615) JoinGroup API for upgrading ConsumerGroup

2024-05-07 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16615. - Fix Version/s: 3.8.0 Reviewer: David Jacot Assignee: Dongnuo Lyu

[DISCUSS] KIP-1041: Drop `offsets.commit.required.acks` config in 4.0 (deprecate in 3.8)

2024-05-02 Thread David Jacot
Hi folks, I have put together a very small KIP to deprecate offsets.commit.required.acks in 3.8 and remove it in 4.0. See the motivation for the reason. KIP: https://cwiki.apache.org/confluence/x/9YobEg Please let me know what you think. Best, David

[jira] [Created] (KAFKA-16658) Drop `offsets.commit.required.acks` config in 4.0 (deprecate in 3.8)

2024-05-02 Thread David Jacot (Jira)
David Jacot created KAFKA-16658: --- Summary: Drop `offsets.commit.required.acks` config in 4.0 (deprecate in 3.8) Key: KAFKA-16658 URL: https://issues.apache.org/jira/browse/KAFKA-16658 Project: Kafka

[jira] [Resolved] (KAFKA-16568) Add JMH Benchmarks for assignor performance testing

2024-04-25 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16568. - Fix Version/s: 3.8.0 Resolution: Fixed > Add JMH Benchmarks for assignor performa

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-04-25 Thread David Jacot
t; > >>>> Thanks, > >>>> Andrew > >>>> > >>>>> On 22 Apr 2024, at 20:04, Jun Rao wrote: > >>>>> > >>>>> Hi, Andrew, > >>>>> > >>>>> Thanks for the reply. >

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-04-15 Thread David Jacot
Hi Andrew, Thanks for the KIP. This work is really exciting. I finally had a bit of time to go through the KIP. I need to read it a second time in order to get into the details. I have noted a few points/questions: 001: The dynamic config to force the group type is really weird. As you said,

[jira] [Resolved] (KAFKA-16294) Add group protocol migration enabling config

2024-04-10 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16294. - Fix Version/s: 3.8.0 Resolution: Fixed > Add group protocol migration enabling con

Re: the migration of command tools

2024-04-10 Thread David Jacot
Hey, I think that we discussed this in this KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-906%3A+Tools+migration+guidelines. I don't remember all the details though. Best, David On Wed, Apr 10, 2024 at 2:54 PM Chia-Ping Tsai wrote: > Dear Kafka, > > Migrating command tools from

[jira] [Created] (KAFKA-16503) getOrMaybeCreateClassicGroup should not thrown GroupIdNotFoundException

2024-04-10 Thread David Jacot (Jira)
David Jacot created KAFKA-16503: --- Summary: getOrMaybeCreateClassicGroup should not thrown GroupIdNotFoundException Key: KAFKA-16503 URL: https://issues.apache.org/jira/browse/KAFKA-16503 Project: Kafka

Re: [VOTE] KIP-1022 Formatting and Updating Features

2024-04-10 Thread David Jacot
+1 (binding). Thanks for the KIP! On Mon, Apr 8, 2024 at 7:23 PM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi Justine, > Thanks for the KIP. > > +1 (non-binding) > > Thanks, > Andrew > > > On 8 Apr 2024, at 18:07, Justine Olshan > wrote: > > > > Hello all, > > I would like

Re: Gentle bump on KAFKA-16371 (Unstable committed offsets after triggering commits where metadata for some partitions are over the limit)

2024-04-05 Thread David Jacot
Thanks, Michal. Let me add it to my review queue. BR, David On Fri, Apr 5, 2024 at 3:29 PM Michał Łowicki wrote: > Hi there! > > Created https://issues.apache.org/jira/browse/KAFKA-16371 few weeks back > but there wasn't any attention. Any chance someone knowing that code could > take a look

[jira] [Created] (KAFKA-16470) kafka-dump-log --offsets-decoder should support new records

2024-04-04 Thread David Jacot (Jira)
David Jacot created KAFKA-16470: --- Summary: kafka-dump-log --offsets-decoder should support new records Key: KAFKA-16470 URL: https://issues.apache.org/jira/browse/KAFKA-16470 Project: Kafka

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

2024-04-03 Thread David Jacot
s. > >> > > > > > > KIP-915 introduced flexible versions, but it was never put > to > >> > use. > >> > > MV > >> > > > > has > >> > > > > > > never gated these. This KIP will do that. I can includ

[jira] [Resolved] (KAFKA-16148) Implement GroupMetadataManager#onUnloaded

2024-04-02 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16148. - Fix Version/s: 3.8.0 Resolution: Fixed > Implement GroupMetadataManager#onUnloa

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

2024-04-02 Thread David Jacot
the group coordinator as we may use it for queues too. It would also be aligned with `metadata.version`. I apologize if this was already discussed. Best, David On Tue, Apr 2, 2024 at 11:18 AM David Jacot wrote: > Hi Jun, > > > Historically, the format of all records were controlle

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

2024-04-02 Thread David Jacot
gt; that right? It would be useful to document that. > > > >> > > > >> Also, we should align on the version numbering. "kafka-feature > > disable" > > > >> says "Disable one or more feature flags. This is the same as > > downgrading > > >

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

2024-03-28 Thread David Jacot
Hi, Jun, Justine, Regarding `group.coordinator.version`, the idea is to use it to gate records and APIs of the group coordinator. The first use case will be KIP-848. We will use version 2 of the flag to gate all the new records and the new ConsumerGroupHeartbeat/Describe APIs present in AK 3.8.

[jira] [Resolved] (KAFKA-16353) Offline protocol migration integration tests

2024-03-27 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16353. - Resolution: Fixed > Offline protocol migration integration te

[jira] [Resolved] (KAFKA-16374) High watermark updates should have a higher priority

2024-03-25 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16374. - Fix Version/s: 3.8.0 Resolution: Fixed > High watermark updates should have a hig

[jira] [Resolved] (KAFKA-15989) Upgrade existing generic group to consumer group

2024-03-20 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15989. - Fix Version/s: 3.8.0 Resolution: Fixed > Upgrade existing generic group to consu

[jira] [Resolved] (KAFKA-15763) Group Coordinator should not deliver new assignment before previous one is acknowledged

2024-03-20 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15763. - Resolution: Won't Fix We went with another approach. > Group Coordinator should not deli

[jira] [Resolved] (KAFKA-16313) Offline group protocol migration

2024-03-20 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16313. - Fix Version/s: 3.8.0 Assignee: Dongnuo Lyu Resolution: Fixed > Offline gr

[jira] [Resolved] (KAFKA-16367) Full ConsumerGroupHeartbeat response must be sent when full request is received

2024-03-19 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16367. - Fix Version/s: 3.8.0 Resolution: Fixed > Full ConsumerGroupHeartbeat response m

[jira] [Created] (KAFKA-16374) High watermark updates should have a higher priority

2024-03-14 Thread David Jacot (Jira)
David Jacot created KAFKA-16374: --- Summary: High watermark updates should have a higher priority Key: KAFKA-16374 URL: https://issues.apache.org/jira/browse/KAFKA-16374 Project: Kafka Issue

[jira] [Resolved] (KAFKA-15997) Ensure fairness in the uniform assignor

2024-03-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15997. - Resolution: Fixed This issue got resolved by https://issues.apache.org/jira/browse/KAFKA-16249

[jira] [Resolved] (KAFKA-16249) Improve reconciliation state machine

2024-03-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16249. - Fix Version/s: 3.8.0 Resolution: Fixed > Improve reconciliation state mach

[jira] [Created] (KAFKA-16367) Full ConsumerGroupHeartbeat response must be sent when full request is received

2024-03-12 Thread David Jacot (Jira)
David Jacot created KAFKA-16367: --- Summary: Full ConsumerGroupHeartbeat response must be sent when full request is received Key: KAFKA-16367 URL: https://issues.apache.org/jira/browse/KAFKA-16367

[jira] [Resolved] (KAFKA-15462) Add group type filter to the admin client

2024-02-29 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15462. - Fix Version/s: 3.8.0 Resolution: Fixed > Add group type filter to the admin cli

[jira] [Resolved] (KAFKA-16306) GroupCoordinatorService logger is not configured

2024-02-27 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16306. - Fix Version/s: 3.8.0 Resolution: Fixed > GroupCoordinatorService log

[jira] [Created] (KAFKA-16249) Improve reconciliation state machine

2024-02-13 Thread David Jacot (Jira)
David Jacot created KAFKA-16249: --- Summary: Improve reconciliation state machine Key: KAFKA-16249 URL: https://issues.apache.org/jira/browse/KAFKA-16249 Project: Kafka Issue Type: Sub-task

Re: Improve flaky test reporting (KAFKA-12216)

2024-02-12 Thread David Jacot
nt and hence this information will be > completely missing from the Jenkins report. Have we considered including > the flakyFailure information ourselves? I have seen that being done and it > seems strictly better than totally ignoring it. > > Ismael > > On Mon, Feb 12, 2024 at 12:11 

[jira] [Created] (KAFKA-16244) Move code style exceptions from suppressions.xml to the code

2024-02-12 Thread David Jacot (Jira)
David Jacot created KAFKA-16244: --- Summary: Move code style exceptions from suppressions.xml to the code Key: KAFKA-16244 URL: https://issues.apache.org/jira/browse/KAFKA-16244 Project: Kafka

Improve flaky test reporting (KAFKA-12216)

2024-02-12 Thread David Jacot
Hi folks, I have been playing with `reports.junitXml.mergeReruns` setting in gradle [1]. From the gradle doc: > When mergeReruns is enabled, if a test fails but is then retried and succeeds, its failures will be recorded as instead of , within one . This is effectively the reporting produced by

[jira] [Resolved] (KAFKA-16178) AsyncKafkaConsumer doesn't retry joining the group after rediscovering group coordinator

2024-02-11 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16178. - Resolution: Fixed > AsyncKafkaConsumer doesn't retry joining the group after rediscover

Re: [VOTE] KIP-951: Leader discovery optimisations for the client

2024-02-06 Thread David Jacot
> > mayanks.nar...@gmail.com> wrote: > > > >> Thank you all for your votes, Jun, David, and Jason! > >> > >> On Tue, Oct 3, 2023 at 11:44 PM Jason Gustafson > >> wrote: > >> > >>> +1 Thanks for the KIP > >>&

[jira] [Created] (KAFKA-16227) Console consumer fails with `IllegalStateException`

2024-02-06 Thread David Jacot (Jira)
David Jacot created KAFKA-16227: --- Summary: Console consumer fails with `IllegalStateException` Key: KAFKA-16227 URL: https://issues.apache.org/jira/browse/KAFKA-16227 Project: Kafka Issue Type

[jira] [Resolved] (KAFKA-15460) Add group type filter to ListGroups API

2024-02-05 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15460. - Fix Version/s: 3.8.0 Resolution: Fixed > Add group type filter to ListGroups

[jira] [Resolved] (KAFKA-16189) Extend admin to support ConsumerGroupDescribe API

2024-02-01 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16189. - Fix Version/s: 3.8.0 Resolution: Fixed > Extend admin to support ConsumerGroupDescr

[jira] [Resolved] (KAFKA-16168) Implement GroupCoordinator.onPartitionsDeleted

2024-02-01 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16168. - Fix Version/s: 3.8.0 Resolution: Fixed > Implement GroupCoordinator.onPartitionsDele

[jira] [Resolved] (KAFKA-16095) Update list group state type filter to include the states for the new consumer group type

2024-01-29 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16095. - Fix Version/s: 3.8.0 Resolution: Fixed > Update list group state type filter to incl

[jira] [Resolved] (KAFKA-14505) Implement TnxOffsetCommit API

2024-01-26 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14505. - Fix Version/s: 3.8.0 Resolution: Fixed > Implement TnxOffsetCommit

[jira] [Created] (KAFKA-16194) KafkaConsumer.groupMetadata() should be correct when first records are returned

2024-01-25 Thread David Jacot (Jira)
David Jacot created KAFKA-16194: --- Summary: KafkaConsumer.groupMetadata() should be correct when first records are returned Key: KAFKA-16194 URL: https://issues.apache.org/jira/browse/KAFKA-16194

[jira] [Resolved] (KAFKA-16107) Ensure consumer does not start fetching from added partitions until onPartitionsAssigned completes

2024-01-24 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16107. - Reviewer: David Jacot Resolution: Fixed > Ensure consumer does not start fetching f

[jira] [Created] (KAFKA-16189) Extend admin to support ConsumerGroupDescribe API

2024-01-24 Thread David Jacot (Jira)
David Jacot created KAFKA-16189: --- Summary: Extend admin to support ConsumerGroupDescribe API Key: KAFKA-16189 URL: https://issues.apache.org/jira/browse/KAFKA-16189 Project: Kafka Issue Type

Re: [VOTE] KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

2024-01-22 Thread David Jacot
a little overkill to support append/subtract > configs or solve KAFKA-10140 here, so let’s leave it right now, I'm happy > to pick it after finishing this KIP. > > --, > Ziming > > > On Jan 22, 2024, at 18:23, David Jacot > wrote: > > > > Hi Ziming, > > > &

Re: [VOTE] KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

2024-01-22 Thread David Jacot
Hi Ziming, Thanks for driving this. I wanted to bring KAFKA-10140 to your attention. It looks like the incremental API does not work for configuring plugins. I think that we need to cover this in the KIP. Best, David On Mon, Jan 22, 2024 at

[jira] [Resolved] (KAFKA-16147) Partition is assigned to two members at the same time

2024-01-22 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16147. - Fix Version/s: 3.8.0 Resolution: Fixed > Partition is assigned to two memb

[jira] [Created] (KAFKA-16168) Implement GroupCoordinator.onPartitionsDeleted

2024-01-19 Thread David Jacot (Jira)
David Jacot created KAFKA-16168: --- Summary: Implement GroupCoordinator.onPartitionsDeleted Key: KAFKA-16168 URL: https://issues.apache.org/jira/browse/KAFKA-16168 Project: Kafka Issue Type: Sub

[jira] [Resolved] (KAFKA-16118) Coordinator unloading fails when replica is deleted

2024-01-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16118. - Fix Version/s: 3.8.0 Resolution: Fixed > Coordinator unloading fails when repl

[jira] [Created] (KAFKA-16118) Coordinator unloading fails when replica is deleted

2024-01-12 Thread David Jacot (Jira)
David Jacot created KAFKA-16118: --- Summary: Coordinator unloading fails when replica is deleted Key: KAFKA-16118 URL: https://issues.apache.org/jira/browse/KAFKA-16118 Project: Kafka Issue Type

[jira] [Resolved] (KAFKA-15982) Move GenericGroup state metrics to `GroupCoordinatorMetricsShard`

2024-01-09 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15982. - Resolution: Duplicate Done in KAFKA-15870. > Move GenericGroup state metr

[jira] [Resolved] (KAFKA-15870) Move new group coordinator metrics from Yammer to Metrics

2024-01-09 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15870. - Fix Version/s: 3.7.0 Resolution: Fixed > Move new group coordinator metrics from Yam

[jira] [Resolved] (KAFKA-14519) Add metrics to the new coordinator

2024-01-09 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14519. - Fix Version/s: 3.7.0 Resolution: Fixed > Add metrics to the new coordina

Re: Apache Kafka 3.7.0 Release

2024-01-08 Thread David Jacot
Hi all, Are you talking about publishing the artefacts to maven central? Looking at the history [1], it seems that the metadata module has been published since we have it. I also see other internal modules there too. [1]

Re: [ANNOUNCE] New Kafka PMC Member: Divij Vaidya

2023-12-27 Thread David Jacot
Congrats! Le jeu. 28 déc. 2023 à 05:13, Ismael Juma a écrit : > Congratulations Divij! > > Ismael > > On Wed, Dec 27, 2023 at 3:46 AM Luke Chen wrote: > > > Hi, Everyone, > > > > Divij has been a Kafka committer since June, 2023. He has remained very > > active and instructive in the community

Re: Kafka trunk test & build stability

2023-12-22 Thread David Jacot
I just merged both PRs. Cheers, David Le ven. 22 déc. 2023 à 14:38, David Jacot a écrit : > Hey folks, > > I believe that my two PRs will fix most of the issues. I have also tweaked > the configuration of Jenkins to fix the issues relating to cloning the > repo. There may

Re: Kafka trunk test & build stability

2023-12-22 Thread David Jacot
s.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:103) > > > > > at > > > > > > > > > > > > > > > org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call

[jira] [Resolved] (KAFKA-16040) Rename `Generic` to `Classic`

2023-12-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16040. - Resolution: Fixed > Rename `Generic` to `Clas

Re: [DISCUSS] Road to Kafka 4.0

2023-12-21 Thread David Jacot
Thanks, Ismael. The proposal makes sense. +1 David On Thu, Dec 21, 2023 at 5:59 PM Ismael Juma wrote: > Hi all, > > After understanding the use case Josep and Anton described in more detail, > I think it's fair to say that quorum reconfiguration is necessary for > migration of Apache Kafka

Re: [DISCUSS] Road to Kafka 4.0

2023-12-21 Thread David Jacot
Hi Divij, > Release 4.0 as an "experimental" release I don't think that this is something that we should do. If we need more time, we should just do a 3.8 release and then release 4.0 when we are ready. An experimental major release will be more confusing than anything else. We should also keep

[jira] [Resolved] (KAFKA-15456) Add support for OffsetFetch version 9 in consumer

2023-12-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15456. - Resolution: Fixed > Add support for OffsetFetch version 9 in consu

[jira] [Resolved] (KAFKA-16030) new group coordinator should check if partition goes offline during load

2023-12-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16030. - Fix Version/s: 3.7.0 Resolution: Fixed > new group coordinator should check if partit

[jira] [Created] (KAFKA-16040) Rename `Generic` to `Classic`

2023-12-21 Thread David Jacot (Jira)
David Jacot created KAFKA-16040: --- Summary: Rename `Generic` to `Classic` Key: KAFKA-16040 URL: https://issues.apache.org/jira/browse/KAFKA-16040 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-16036) Add `group.coordinator.rebalance.protocols` and publish all new configs

2023-12-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16036. - Resolution: Fixed > Add `group.coordinator.rebalance.protocols` and publish all new conf

[jira] [Created] (KAFKA-16036) Add `group.coordinator.rebalance.protocols` and publish all new configs

2023-12-20 Thread David Jacot (Jira)
David Jacot created KAFKA-16036: --- Summary: Add `group.coordinator.rebalance.protocols` and publish all new configs Key: KAFKA-16036 URL: https://issues.apache.org/jira/browse/KAFKA-16036 Project: Kafka

Re: Kafka trunk test & build stability

2023-12-19 Thread David Jacot
The slowness of the CI is definitely causing us a lot of pain. I wonder if we should move to a dedicated CI infrastructure for Kafka. Our integration tests are quite heavy and ASF's CI is not really tuned for them. We could tune it for our needs and this would also allow external companies to

[jira] [Resolved] (KAFKA-15971) Re-enable consumer integration tests for new consumer

2023-12-15 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15971. - Resolution: Fixed > Re-enable consumer integration tests for new consu

[jira] [Resolved] (KAFKA-15237) Implement write operation timeout

2023-12-13 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15237. - Fix Version/s: 3.7.0 Resolution: Fixed > Implement write operation time

[jira] [Resolved] (KAFKA-15981) update Group size only when groups size changes

2023-12-13 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15981. - Fix Version/s: 3.7.0 Resolution: Fixed > update Group size only when groups size chan

[jira] [Resolved] (KAFKA-15574) Update states and transitions for membership manager state machine

2023-12-11 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15574. - Fix Version/s: 3.7.0 Resolution: Fixed > Update states and transitions for members

[jira] [Resolved] (KAFKA-15978) New consumer sends OffsetCommit with empty member ID

2023-12-10 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15978. - Resolution: Fixed > New consumer sends OffsetCommit with empty member

[jira] [Resolved] (KAFKA-14516) Implement static membeship

2023-12-08 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14516. - Fix Version/s: 3.7.0 Resolution: Fixed > Implement static membes

[jira] [Resolved] (KAFKA-15910) New group coordinator needs to generate snapshots while loading

2023-12-06 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15910. - Fix Version/s: 3.7.0 Resolution: Fixed > New group coordinator needs to gener

[jira] [Resolved] (KAFKA-15705) Add integration tests for Heartbeat API and GroupLeave API

2023-12-05 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15705. - Fix Version/s: 3.7.0 Resolution: Fixed > Add integration tests for Heartbeat

[jira] [Resolved] (KAFKA-15061) CoordinatorPartitionWriter should reuse buffer

2023-12-04 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15061. - Fix Version/s: 3.7.0 Resolution: Fixed > CoordinatorPartitionWriter should reuse buf

Re: [DISCUSS] Should we continue to merge without a green build? No!

2023-11-27 Thread David Jacot
el Juma wrote: > > > I think it breaks the Jenkins output otherwise. Feel free to test it via > a > > PR. > > > > Ismael > > > > On Wed, Nov 22, 2023, 12:42 AM David Jacot > > wrote: > > > > > Hi Ismael, > > > >

[jira] [Resolved] (KAFKA-15856) Add integration tests for JoinGroup API and SyncGroup API

2023-11-23 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15856. - Fix Version/s: 3.7.0 Resolution: Fixed > Add integration tests for JoinGroup

[jira] [Resolved] (KAFKA-15484) Implement general uniform broker side assignor

2023-11-23 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15484. - Fix Version/s: 3.7.0 Resolution: Fixed > Implement general uniform broker side assig

[jira] [Created] (KAFKA-15889) Make General Assignor's rebalance incremental

2023-11-23 Thread David Jacot (Jira)
David Jacot created KAFKA-15889: --- Summary: Make General Assignor's rebalance incremental Key: KAFKA-15889 URL: https://issues.apache.org/jira/browse/KAFKA-15889 Project: Kafka Issue Type: Sub

Re: [DISCUSS] Should we continue to merge without a green build? No!

2023-11-22 Thread David Jacot
at 9:35 AM Ismael Juma wrote: > Hi David, > > Did you take a look at https://issues.apache.org/jira/browse/KAFKA-12216? > I > looked into this option already (yes, there isn't much that we haven't > considered in this space). > > Ismael > > On Wed, Nov 22, 2023 at

Re: [DISCUSS] Should we continue to merge without a green build? No!

2023-11-22 Thread David Jacot
Hi all, Thanks for the good discussion and all the comments. Overall, it seems that we all agree on the bad state of our CI. That's a good first step! I have talked to a few folks this week about it and it seems that many folks (including me) are not comfortable with merging PRs at the moment

Re: [VOTE] KIP-1001; CurrentControllerId Metric

2023-11-21 Thread David Jacot
+1 from me. Thanks, David On Mon, Nov 20, 2023 at 10:48 PM Jason Gustafson wrote: > The KIP makes sense. +1 > > On Mon, Nov 20, 2023 at 12:37 PM David Arthur > wrote: > > > Thanks Colin, > > > > +1 from me > > > > -David > > > > On Tue, Nov 14, 2023 at 3:53 PM Colin McCabe wrote: > > > > >

[jira] [Resolved] (KAFKA-15849) Fix ListGroups API when runtime partition size is zero

2023-11-17 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15849. - Fix Version/s: 3.7.0 Reviewer: David Jacot Resolution: Fixed > Fix ListGro

  1   2   3   4   5   6   7   8   9   >