Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3184

2024-08-08 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #26

2024-08-08 Thread Apache Jenkins Server
See

Re: New release branch 3.9

2024-08-08 Thread Chia-Ping Tsai
> - We have completed all the feature work for KIP-853: KRaft controller > membership changes. (Please note that there are still a few bug fixes > remaining, and the docs JIRA, KAFKA-17048, but those are all > post-feature-freeze tasks.) Sorry to make meaningless reply on this mail thread, but

Re: New release branch 3.9

2024-08-08 Thread Colin McCabe
Hi all, I think it's time to transition the 3.9 branch to feature freeze. Please note that this is 2 weeks past the original planned date. I apologize for this; our planning wasn't perfect. A few updates on features that are in or out of Apache Kafka 3.9: - We have completed all the feature wo

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #25

2024-08-08 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3183

2024-08-08 Thread Apache Jenkins Server
See

kafka-native image and -javaagent

2024-08-08 Thread Neil Buesing
I am attempt to set javaagents for the kafka-native image (like I have done with the confluent kafka images) However, the following: KAFKA_OPTS: -javaagent:/opt/jmx_prometheus/jmx_prometheus_javaagent.jar=7071:/opt/jmx_prometheus/kafka-config.yml -javaagent:/opt/jmx_prometheus/jolokia-jvm.jar=por

[jira] [Resolved] (KAFKA-17269) Fix ConcurrentModificationException caused by NioEchoServer.closeNewChannels

2024-08-08 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17269. Fix Version/s: 4.0.0 Resolution: Fixed > Fix ConcurrentModificationException caused

[jira] [Created] (KAFKA-17303) Enable testPutControllersInBootstrapBrokersConfig

2024-08-08 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17303: -- Summary: Enable testPutControllersInBootstrapBrokersConfig Key: KAFKA-17303 URL: https://issues.apache.org/jira/browse/KAFKA-17303 Project: Kafka Issue T

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #24

2024-08-08 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-17223) Retrying the call after encoutering UnsupportedVersionException will cause ConcurrentModificationException

2024-08-08 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17223. Fix Version/s: 4.0.0 Resolution: Fixed > Retrying the call after encoutering Unsupp

Re: [DISCUSS] KIP-1073 Return inactive observer nodes in DescribeQuorum response

2024-08-08 Thread Gantigmaa Selenge
Thank you Luke for taking a look at the KIP. I have corrected the typo and taken the suggestion of including replication states for inactive observers when "–include-inactive-observers" option is used with " kafka-metadata-quorum.sh describe --replication", as this might be useful for finding out

[jira] [Created] (KAFKA-17302) ReplicaFetcher changes for fetching from tiered offset

2024-08-08 Thread Abhijeet Kumar (Jira)
Abhijeet Kumar created KAFKA-17302: -- Summary: ReplicaFetcher changes for fetching from tiered offset Key: KAFKA-17302 URL: https://issues.apache.org/jira/browse/KAFKA-17302 Project: Kafka Is

Re: [DISCUSS] KIP-1075: Introduce delayed remote list offsets purgatory to make LIST_OFFSETS async

2024-08-08 Thread Kamal Chandraprakash
Hi Luke, Thanks for the review! LC1: When the consumer starts to read data, then it might need the below offsets: earliest, latest, and last-committed-offset based on the "auto.offset.reset" config. The earliest and latest offsets have special timestamps -2 and -1, those timestamp corresponding

Re: [DISCUSS] KIP-1074: Make the replication of internal topics configurable

2024-08-08 Thread Omnia Ibrahim
Hi Thinking of it more, I feel leaving customers to mirroring Kafka’s internal topics `__.*` either by mistake or intently will be eating up resources from both mm2 and the clusters for no actual value as the data is not that useful outside the context of the original cluster. These topics usua

Re: [DISCUSS] KIP-1016 Make MM2 heartbeats topic name configurable

2024-08-08 Thread Viktor Somogyi-Vass
Hi all, Regarding Omnia's last point: I also second that with a reasonable default we won't really complicate average users' problems while setting a config is simpler than having to provide a jar to override the replication policy. I have also mulled over what if we created a separate replication

Re: [VOTE] KIP-877: Mechanism for plugins and connectors to register metrics

2024-08-08 Thread Mickael Maison
Hi, I'm closing the vote. The vote has passed with + 3 bindings votes from Chris, Tom and Luke, and +1 non-binding vote from Hector. Thanks, Mickael On Thu, Aug 8, 2024 at 11:28 AM Luke Chen wrote: > > Hi Mickael, > > Thanks for the KIP. > +1 (binding) from me. > > Thanks. > Luke > > On Fri, Au

[jira] [Created] (KAFKA-17301) lz4-java is not maintained anymore

2024-08-08 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-17301: -- Summary: lz4-java is not maintained anymore Key: KAFKA-17301 URL: https://issues.apache.org/jira/browse/KAFKA-17301 Project: Kafka Issue Type: Task

[jira] [Created] (KAFKA-17300) documentation for disablement feature

2024-08-08 Thread Luke Chen (Jira)
Luke Chen created KAFKA-17300: - Summary: documentation for disablement feature Key: KAFKA-17300 URL: https://issues.apache.org/jira/browse/KAFKA-17300 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-16857) Zookeeper - Add new ZNodes

2024-08-08 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16857. --- Resolution: Not A Problem We are pausing ZK development so resolving the ticket. > Zookeeper - Add

[jira] [Resolved] (KAFKA-17031) Make configurations public

2024-08-08 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-17031. --- Fix Version/s: 3.9.0 Resolution: Fixed This is done in another ticket. Close it. > Make conf

[jira] [Resolved] (KAFKA-17236) local log should be deleted when remote copy disabled and no remote logs

2024-08-08 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-17236. --- Fix Version/s: 3.9.0 Resolution: Fixed > local log should be deleted when remote copy disable

[jira] [Resolved] (KAFKA-17080) bump metadata version for topic Record

2024-08-08 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-17080. --- Resolution: Not A Problem We don't need to bump MV because we don't use topicRecord anymore. > bump

[jira] [Created] (KAFKA-17299) Kafka streams consumer stops consumption

2024-08-08 Thread Laxman (Jira)
Laxman created KAFKA-17299: -- Summary: Kafka streams consumer stops consumption Key: KAFKA-17299 URL: https://issues.apache.org/jira/browse/KAFKA-17299 Project: Kafka Issue Type: Bug Compon

Re: [DISCUSS] KIP-1075: Introduce delayed remote list offsets purgatory to make LIST_OFFSETS async

2024-08-08 Thread Luke Chen
Hi Kamal, Thanks for the KIP! I think it is a good improvement to avoid users making many list_offset requests to starve other high priority requests. Questions: 1. When consumer poll the partitions first time, it'll also try to call list_offset to get the offset to fetch. If this offset is locat

Re: [VOTE] KIP-877: Mechanism for plugins and connectors to register metrics

2024-08-08 Thread Luke Chen
Hi Mickael, Thanks for the KIP. +1 (binding) from me. Thanks. Luke On Fri, Aug 2, 2024 at 4:57 AM Tom Bentley wrote: > +1 (binding). > > Thanks Mickael! > > On Thu, 1 Aug 2024 at 05:12, Mickael Maison > wrote: > > > Hi, > > > > Bumping this thread to get some more votes and/or feedback. > > >

[jira] [Resolved] (KAFKA-16742) Add ShareGroupDescribe API support in GroupCoordinator

2024-08-08 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-16742. --- Resolution: Fixed > Add ShareGroupDescribe API support in GroupCoordinator > ---

Re: [DISCUSS] KIP-1073 Return inactive observer nodes in DescribeQuorum response

2024-08-08 Thread Luke Chen
Hi Gantigmaa, Thanks for the KIP! The motivation and change looks good to me. Some comments: 1. typo: When a KRaft broker node shuts down, it is in "fenced" state, not "unfenced" state 2. Will the "–include-inactive-observers" option apply to " kafka-metadata-quorum.sh describe --replication"? I