[jira] [Created] (KAFKA-19649) Document List Offset changes in upgrade.html

Abhijeet Kumar created KAFKA-19649: -- Summary: Document List Offset changes in upgrade.html Key: KAFKA-19649 URL: https://issues.apache.org/jira/browse/KAFKA-19649 Project: Kafka Issue Type

Re: Significant startup delay after upgrading kafka clients from 3.5.1 to 4.0.0

Hi, Is this delay experienced on 3.7 versions also? This plugin discovery is the connect feature and recently a change was rolled out with different modes of plugin discovery. Is this because of that change? On Sat, 2 Aug 2025 at 7:24 PM, Kirk True wrote: > Hi! > > I work on the Kafka Java clien

[VOTE] KIP-1154: Extending support for Microsecond/Nanosecond Precision for Kafka Connect

Hi Kafka Community, Since there haven't been any new comments on the DISCUSS thread recently, I'd like to move KIP-1154 — *"Extending Support for Microsecond/Nanosecond Precision for Kafka Connect "* — to the voting stage.

Clarification on open(TopicPartitions) and close(TopicPartitions) Behavior During Rebalances in SinkTasks

! Best regards, *Pritam Kumar*

Discussion: Ensuring Unique client.id per Task in Kafka Connect (KAFKA-19070)

lag? Happy to revise the implementation depending on community feedback. Thanks in advance for your thoughts! Best regards, Pritam Kumar Mishra

Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

Hi Kafka Community, If there is no other feedback. I would like to start a VOTE. On Mon, May 19, 2025 at 6:51 PM pritam kumar wrote: > Hi Kafka Community, > Here is the KIP LInk -> > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=347933282 > > On Mon, May 1

Re: [DISCUSS] KIP-1173: Connect Storage Topics Sharing Across Clusters

43 PM pritam kumar wrote: > Hi chris, thank you very much for the review and the feedback, > 1. On read amplification part, the bulk read where the whole topic is read > will happen on when the cluster is restarted and apart from that it will > only be reading the additional rec

Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

Hi Kafka Community, Here is the KIP LInk -> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=347933282 On Mon, May 19, 2025 at 6:47 PM pritam kumar wrote: > Hi Kafka Community, > > Could you please review this KIP proposal when you have a chance? > > Thank you,

Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

Hi Kafka Community, Could you please review this KIP proposal when you have a chance? Thank you, Pritam On Sat, May 3, 2025 at 10:53 PM pritam kumar wrote: > Hi Chris, > Can you please review this one too? > > On Sat, Apr 5, 2025 at 7:00 AM pritam kumar > wrote: > >

Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

Hi Chris, Can you please review this one too? On Sat, Apr 5, 2025 at 7:00 AM pritam kumar wrote: > Hi Kafka Community, > Sorry due to some changes I had to change the link to the kip. > Here is the updated KIP link: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1154%

Re: [DISCUSS] KIP-1173: Connect Storage Topics Sharing Across Clusters

; > Finally, I think we may want to use a more structured format for record > keys. IIRC there's essentially no limits on what characters can be used for > group IDs (please correct me if I'm wrong), so we can't use any kind of > delimiter that won't be included in the group

Re: [DISCUSS] KIP-1173: Connect Storage Topics Sharing Across Clusters

ilures: The unavailability/corruption of one topic now > affects multiple Connect clusters instead of just one > * Complications with Exactly Once mode: transactional writes to internal > topics may cause unavailability in other clusters from hanging > transactions. > > Thanks! >

[DISCUSS] KIP-1173: Connect Storage Topics Sharing Across Clusters

Hi Kafka Community, I'd like to start a discussion on KIP-1173: Connect Storage Topics Sharing Across Clusters . The primary motivation for writing this KIP and proposing this enhancemen

[jira] [Created] (KAFKA-19211) Connect Storage Topics Sharing Across Clusters

Pritam Kumar created KAFKA-19211: Summary: Connect Storage Topics Sharing Across Clusters Key: KAFKA-19211 URL: https://issues.apache.org/jira/browse/KAFKA-19211 Project: Kafka Issue Type

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

Thank you Sudesh, for reviewing the KIP and the valuable feedback. Thanks, Pritam On Thu, Apr 17, 2025 at 8:59 PM Sudesh Wasnik wrote: > Thanks Pritam! > No more feedback from my end. Nice addition ! > > Thanks, > Sudesh > On 17 Apr 2025 at 4:59 PM +0530, pritam kumar , &

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

Hi Sudesh, Sorry for the earlier comment, I just checked that avro in 1.12 has timestamp-nanos support. I will update the KIP to have nanosecond support also and correspondingly I will make changes for nanosecond. Thanks Pritam. On Wed, Apr 16, 2025 at 7:13 PM pritam kumar wrote: > Also j

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

I have made Nanosecond related changes in the KIP. Please have a look. Thanks Pritam. On Thu, Apr 17, 2025 at 4:25 PM pritam kumar wrote: > Hi Sudesh, > Sorry for the earlier comment, I just checked that avro in 1.12 has > timestamp-nanos support. I will update the KIP to have n

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

Also just to add I did not add this in the first place as I think Avro itself does not have the Nanosecond logical type. On Wed, Apr 16, 2025 at 7:01 PM pritam kumar wrote: > Thanks Sudesh, for taking a look at this. I am already working on > extending this for nanosecond precision a

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

he KIP to also add support for Nanosecond precision! > > Thanks > Sudesh > > On 2025/04/05 01:30:49 pritam kumar wrote: > > Hi Kafka Community, > > Sorry due to some changes I had to change the link to the kip. > > Here is the updated KIP link: > > > https

Coordinating Cross-Cluster Kafka Transactions with Exactly-Once Semantics

suggestions, or shared pain would be incredibly helpful! Thanks in advance, Pritam Kumar

Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

Hi Kafka Community, Sorry due to some changes I had to change the link to the kip. Here is the updated KIP link: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1154%3A+Extending+support+for+Microsecond+Precision+for+Kafka+Connect On Sat, Apr 5, 2025 at 12:14 AM pritam kumar wrote: >

[DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

Hi Kafka Community, I’d like to start a discussion on KIP-1153: Extending Support for Microsecond Precision for Kafka Connect . The primary motivation behind this KIP is t

[jira] [Created] (KAFKA-19086) Extending support for Microsecond Precision for Kafka Connect

Pritam Kumar created KAFKA-19086: Summary: Extending support for Microsecond Precision for Kafka Connect Key: KAFKA-19086 URL: https://issues.apache.org/jira/browse/KAFKA-19086 Project: Kafka

[jira] [Created] (KAFKA-19070) Adding task number to the user provided client id (via consumer.override.client.id) to ensure each consumer has a unique client ID to avoid metric registration conflicts

Pritam Kumar created KAFKA-19070: Summary: Adding task number to the user provided client id (via consumer.override.client.id) to ensure each consumer has a unique client ID to avoid metric registration conflicts. Key: KAFKA

[jira] [Created] (KAFKA-18726) Support for root cause exception as a nested exception to TimeoutException for Producer framework

Vineet Kumar created KAFKA-18726: Summary: Support for root cause exception as a nested exception to TimeoutException for Producer framework Key: KAFKA-18726 URL: https://issues.apache.org/jira/browse/KAFKA-18726

Request for Permission to Contribute Code Changes to Apache Kafka

Dear Team, I hope this email finds you well. I am Suresh Kumar, a software developer with 2 years of experience, and I am eager to contribute to the Apache Kafka project to expand my knowledge and assist in its development. My *Jira username* is *suresh7 *and I kindly request permission to

[jira] [Created] (KAFKA-18133) Not getting 'target' details for metrics group: kafka.connect.mirror

MANOJ KUMAR GHOSH created KAFKA-18133: - Summary: Not getting 'target' details for metrics group: kafka.connect.mirror Key: KAFKA-18133 URL: https://issues.apache.org/jira/browse/K

[jira] [Created] (KAFKA-17983) Configurable JMX Port for Metrics Collection for Kafka MirrorMaker2

Basapuram Kumar created KAFKA-17983: --- Summary: Configurable JMX Port for Metrics Collection for Kafka MirrorMaker2 Key: KAFKA-17983 URL: https://issues.apache.org/jira/browse/KAFKA-17983 Project

[jira] [Created] (KAFKA-17982) Kafka Connect: Configurable JMX Port for Metrics Collection

Basapuram Kumar created KAFKA-17982: --- Summary: Kafka Connect: Configurable JMX Port for Metrics Collection Key: KAFKA-17982 URL: https://issues.apache.org/jira/browse/KAFKA-17982 Project: Kafka

How to Rate limit number of messages while writing Spark DataFrame to kafka topic

0 I have a spark dataframe which I am writing to Kafka topic using the below script. val ProducerConfig: Map[String, String] = Map( s"kafka.${ProducerConfig.REQUEST_TIMEOUT_MS_CONFIG}" -> Integer.MAX_VALUE.toString, s"kafka.${ProducerCon

[jira] [Created] (KAFKA-17872) Kafka stream job does not commit offset when packets are getting ignored intentionally

Manish Kumar Sinha created KAFKA-17872: -- Summary: Kafka stream job does not commit offset when packets are getting ignored intentionally Key: KAFKA-17872 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Created] (KAFKA-17599) Update Consumer Subscription with Current Assignment Before Partition Revocation

Pritam Kumar created KAFKA-17599: Summary: Update Consumer Subscription with Current Assignment Before Partition Revocation Key: KAFKA-17599 URL: https://issues.apache.org/jira/browse/KAFKA-17599

[jira] [Created] (KAFKA-17344) Add Unit tests for empty follower fetch scenarios

Abhijeet Kumar created KAFKA-17344: -- Summary: Add Unit tests for empty follower fetch scenarios Key: KAFKA-17344 URL: https://issues.apache.org/jira/browse/KAFKA-17344 Project: Kafka Issue

[jira] [Created] (KAFKA-17313) Fix object metric name for Tiered Storage quotas

Abhijeet Kumar created KAFKA-17313: -- Summary: Fix object metric name for Tiered Storage quotas Key: KAFKA-17313 URL: https://issues.apache.org/jira/browse/KAFKA-17313 Project: Kafka Issue

[jira] [Created] (KAFKA-17302) ReplicaFetcher changes for fetching from tiered offset

Abhijeet Kumar created KAFKA-17302: -- Summary: ReplicaFetcher changes for fetching from tiered offset Key: KAFKA-17302 URL: https://issues.apache.org/jira/browse/KAFKA-17302 Project: Kafka

[jira] [Created] (KAFKA-17266) Add dynamic broker config to enabled tiered offset follower fetch

Abhijeet Kumar created KAFKA-17266: -- Summary: Add dynamic broker config to enabled tiered offset follower fetch Key: KAFKA-17266 URL: https://issues.apache.org/jira/browse/KAFKA-17266 Project: Kafka

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

r this scenario due to increased probability of having > an aggressive local cleanup with Tiered Storage. > > -- > Divij Vaidya > > > > On Wed, Jul 24, 2024 at 1:22 PM Abhijeet Kumar > > wrote: > > > Hi Divij, > > > > The rare scenario we are discu

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

gt; documented as an acceptable risk in current design. > > -- > Divij Vaidya > > > > On Tue, Jul 23, 2024 at 11:55 AM Abhijeet Kumar < > abhijeet.cse@gmail.com> > wrote: > > > Hi Divij, > > > > Seems like there is some confusion about the ne

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

and now the new > last-tiered-offset is 15 > 5. Go back to 2 > > This could cause a cycle where the replica will be stuck trying to > reconcile with the leader. > > -- > Divij Vaidya > > > > On Fri, Apr 26, 2024 at 7:28 AM Abhijeet Kumar > > wrote: > >

[jira] [Resolved] (KAFKA-16853) Split RemoteLogManagerScheduledThreadPool

[ https://issues.apache.org/jira/browse/KAFKA-16853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhijeet Kumar resolved KAFKA-16853. Resolution: Fixed > Split RemoteLogManagerScheduledThreadP

[jira] [Created] (KAFKA-17143) Error while deleting segments and java.nio.file.NoSuchFileException

Prem Kumar created KAFKA-17143: -- Summary: Error while deleting segments and java.nio.file.NoSuchFileException Key: KAFKA-17143 URL: https://issues.apache.org/jira/browse/KAFKA-17143 Project: Kafka

[jira] [Created] (KAFKA-17108) ListOffset API changes

Abhijeet Kumar created KAFKA-17108: -- Summary: ListOffset API changes Key: KAFKA-17108 URL: https://issues.apache.org/jira/browse/KAFKA-17108 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-17069) Remote copy throttle metrics

Abhijeet Kumar created KAFKA-17069: -- Summary: Remote copy throttle metrics Key: KAFKA-17069 URL: https://issues.apache.org/jira/browse/KAFKA-17069 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-16706) Refactor ReplicationQuotaManager/RLMQuotaManager to eliminate code duplication

Abhijeet Kumar created KAFKA-16706: -- Summary: Refactor ReplicationQuotaManager/RLMQuotaManager to eliminate code duplication Key: KAFKA-16706 URL: https://issues.apache.org/jira/browse/KAFKA-16706

Re: [VOTE] KIP-1023: Follower fetch from tiered offset

gt; On Fri, 26 Apr 2024 at 8:35 PM, Jun Rao wrote: > > > Hi, Abhijeet, > > > > Thanks for the KIP. +1 > > > > Jun > > > > On Thu, Apr 25, 2024 at 10:30 PM Abhijeet Kumar < > > abhijeet.cse@gmail.com> > > wrote: > > > > >

[VOTE] KIP-1023: Follower fetch from tiered offset

Hi All, I would like to start the vote for KIP-1023 - Follower fetch from tiered offset The KIP is here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1023%3A+Follower+fetch+from+tiered+offset Regards. Abhijeet.

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

ments. > > Luke > > On Thu, Apr 25, 2024 at 4:21 AM Jun Rao wrote: > > > Hi, Abhijeet, > > > > Thanks for the updated KIP. It looks good to me. > > > > Jun > > > > On Mon, Apr 22, 2024 at 12:08 PM Abhijeet Kumar < > > abhijeet.cs

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

follower? > > > > > > 3. Could we add "Rejected Alternatives" section to the end of the KIP > to > > > add some of them? > > > Like the "ListOffsetRequest" approach VS > "Earliest-Pending-Upload-Offset" > > > approach,

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

we add "Rejected Alternatives" section to the end of the KIP to > add some of them? > Like the "ListOffsetRequest" approach VS "Earliest-Pending-Upload-Offset" > approach, or getting the "Earliest-Pending-Upload-Offset" from remote log > metadata

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

the offset and the corresponding epoch. > > > > 4. "Check if the follower replica is empty and if the feature to use > > last-tiered-offset is enabled." > > Why do we need to check if the follower replica is empty? > > > > 5. It can be confirmed by ch

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

e follower know Local-Log-Start-Offset? > Missed this detail. The follower will need to call the leader APi to fetch the EarliestLocal offset for this. > Jun > > On Sat, Mar 30, 2024 at 5:51 AM Abhijeet Kumar > > wrote: > > > Hi Christo, > > > >

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

> back to a follower - earliest-pending-upload-offset or the > latest-tiered-offset? If it is the second, then I believe KIP-1005 ought to > already be exposing that offset as part of the ListOffsets API, no? > > Best, > Christo > > On Wed, 27 Mar 2024 at 18:23, Abhijeet Kumar >

[DISCUSS] KIP-1023: Follower fetch from tiered offset

Hi All, I have created KIP-1023 to introduce follower fetch from tiered offset. This feature will be helpful in significantly reducing Kafka rebalance/rebuild times when the cluster is enabled with tiered storage. https://cwiki.apache.org/confluence/display/KAFKA/KIP-1023%3A+Follower+fetch+from+t

Re: [VOTE] KIP-956: Tiered Storage Quotas

t; > > > > -- > > > > Kamal > > > > > > > > On Fri, Mar 8, 2024 at 11:02 PM Jun Rao > > > wrote: > > > > > > > > > Hi, Abhijeet, > > > > > > > > > > Thanks for the KIP.

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

the configs: > - RLMCopyQuotaManager > - RLMFetchQuotaManager > > > On Fri, 8 Mar 2024 at 13:43, Abhijeet Kumar > wrote: > > > Thank you all for your comments. As all the comments in the thread are > > addressed, I am starting a Vote thread for the KIP. Please have a look. >

[VOTE] KIP-956: Tiered Storage Quotas

Hi All, I would like to start the vote for KIP-956 - Tiered Storage Quotas The KIP is here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-956+Tiered+Storage+Quotas Regards. Abhijeet.

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

look, and it LGTM now! > > Thanks. > Luke > > On Tue, Mar 5, 2024 at 2:50 AM Jun Rao wrote: > > > Hi, Abhijeet, > > > > Thanks for the reply. Sounds good to me. > > > > Jun > > > > > > On Sat, Mar 2, 2024 at 7:40 PM Abhijeet Kumar <

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

s use read/write whereas the metrics use fetch/copy. Could > we make them consistent? > > Jun > > On Wed, Feb 28, 2024 at 6:49 AM Abhijeet Kumar > > wrote: > > > Hi Jun, > > > > Clarified the meaning of the two metrics. Also updated the KIP. > > > >

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

ger, name=RemoteFetchThrottleTime > kafka.log.remote:type=RemoteLogManager, name=RemoteCopyThrottleTime > > Jun > > On Tue, Feb 27, 2024 at 1:39 AM Abhijeet Kumar > > wrote: > > > Hi Jun, > > > > The existing quota system for consumers is designed

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

tive Kafka topics.". However, this > can happen with or without tier storage and the current quota system for > consumers is designed for solving this exact problem. Could you explain the > usage of this additional quota? > > Thanks, > > Jun > > On Mon, Feb 12, 202

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

andle the situation when a segment is still waiting for > > offloading while this segment is expired and eligible to be deleted? > > Maybe it'll be easier to not block the RLMTask when quota exceeded, and > > just check it each time the RLMTask runs? > > >

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

RLMTask into smaller tasks is already being proposed in KIP-950. The two tasks will need some coordination at a topic-partition level to handle such cases as pointed out. For this particular case, the upload task could skip uploading the segment if it is already eligible for deletion. > Thank

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

the situation when a segment is still waiting for > > > offloading while this segment is expired and eligible to be deleted? > > > Maybe it'll be easier to not block the RLMTask when quota exceeded, and > > > just check it each time the RLMTask runs? > > >

[DISCUSS] KIP-956: Tiered Storage Quotas

Hi All, I have created KIP-956 for defining read and write quota for tiered storage. https://cwiki.apache.org/confluence/display/KAFKA/KIP-956+Tiered+Storage+Quotas Feedback and suggestions are welcome. Regards, Abhijeet.

[jira] [Created] (KAFKA-15680) Partition-Count is not getting updated Correctly in the Incremental Co-operative Rebalancing(ICR) Mode of Rebalancing

Pritam Kumar created KAFKA-15680: Summary: Partition-Count is not getting updated Correctly in the Incremental Co-operative Rebalancing(ICR) Mode of Rebalancing Key: KAFKA-15680 URL: https://issues.apache.org

[jira] [Resolved] (KAFKA-15181) Race condition on partition assigned to TopicBasedRemoteLogMetadataManager

[ https://issues.apache.org/jira/browse/KAFKA-15181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhijeet Kumar resolved KAFKA-15181. Resolution: Fixed > Race condition on partition assigned

[jira] [Resolved] (KAFKA-15261) ReplicaFetcher thread should not block if RLMM is not initialized

[ https://issues.apache.org/jira/browse/KAFKA-15261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhijeet Kumar resolved KAFKA-15261. Resolution: Fixed > ReplicaFetcher thread should not block if RLMM is not initiali

[jira] [Created] (KAFKA-15405) Create a new error code to indicate a resource is not ready yet

Abhijeet Kumar created KAFKA-15405: -- Summary: Create a new error code to indicate a resource is not ready yet Key: KAFKA-15405 URL: https://issues.apache.org/jira/browse/KAFKA-15405 Project: Kafka

Requesting permissions to contribute to Apache Kafka

Hi Team, Please provide access to contribute to Apache Kafka JIRA id -- akanimesh7 Wiki Id -- akanimesh7 -- Animesh Kumar 8120004556

[jira] [Created] (KAFKA-15343) Fix MirrorConnectIntegrationTests causing ci build failures.

Prasanth Kumar created KAFKA-15343: -- Summary: Fix MirrorConnectIntegrationTests causing ci build failures. Key: KAFKA-15343 URL: https://issues.apache.org/jira/browse/KAFKA-15343 Project: Kafka

[jira] [Created] (KAFKA-15293) Update metrics doc to add tiered storage metrics

Abhijeet Kumar created KAFKA-15293: -- Summary: Update metrics doc to add tiered storage metrics Key: KAFKA-15293 URL: https://issues.apache.org/jira/browse/KAFKA-15293 Project: Kafka Issue

Re: [VOTE] KIP-930: Tiered Storage Metrics

to it yet. > > > > -- > > Divij Vaidya > > > > > > > > On Tue, Jul 25, 2023 at 6:45 PM Satish Duggana > wrote: > > > > > > +1 for the KIP. > > > > > > Thanks, > > > Satish. > > > > > > On Tue

[jira] [Created] (KAFKA-15261) ReplicaFetcher thread should not block if RLMM is not initialized

Abhijeet Kumar created KAFKA-15261: -- Summary: ReplicaFetcher thread should not block if RLMM is not initialized Key: KAFKA-15261 URL: https://issues.apache.org/jira/browse/KAFKA-15261 Project: Kafka

[jira] [Created] (KAFKA-15260) RLM Task should wait until RLMM is initialized before copying segments to remote

Abhijeet Kumar created KAFKA-15260: -- Summary: RLM Task should wait until RLMM is initialized before copying segments to remote Key: KAFKA-15260 URL: https://issues.apache.org/jira/browse/KAFKA-15260

Re: [VOTE] KIP-930: Tiered Storage Metrics

Please find the updated link to the KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Rename+ambiguous+Tiered+Storage+Metrics Updated the KIP as per our conversation on the discussion thread. On Tue, Jul 25, 2023 at 11:29 AM Abhijeet Kumar wrote: > Hi All, > > I woul

Re: [DISCUSS] KIP-930: Tiered Storage Metrics

t-offset and log-end-offset metrics. Should we > expose local-log-start-offset and highest-offset-uploaded-to-remote-storage > as metric? > > Thanks, > Kamal > > On Mon, Jul 24, 2023 at 2:08 PM Abhijeet Kumar > > wrote: > > > Hi All, > > > > I created

[VOTE] KIP-930: Tiered Storage Metrics

Hi All, I would like to start the vote for KIP-930 Tiered Storage Metrics. The KIP is here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-930%3A+Tiered+Storage+Metrics Regards Abhijeet.

[jira] [Created] (KAFKA-15245) Improve Tiered Storage Metrics

Abhijeet Kumar created KAFKA-15245: -- Summary: Improve Tiered Storage Metrics Key: KAFKA-15245 URL: https://issues.apache.org/jira/browse/KAFKA-15245 Project: Kafka Issue Type: Sub-task

[DISCUSS] KIP-930: Tiered Storage Metrics

Hi All, I created KIP-930 for adding RemoteIndexCache stats and also to rename some tiered storage metrics added as part of KIP-405 to remove ambiguity. https://cwiki.apache.or

[DISCUSS] KIP-930: Tiered Storage Metrics

Hi All, I created KIP-930 for adding RemoteIndexCache stats and also to rename some tiered storage metrics added as part of KIP-405 to remove ambiguity. https://cwiki.apache.or

[jira] [Created] (KAFKA-15236) Rename Remote Storage metrics to remove ambiguity

Abhijeet Kumar created KAFKA-15236: -- Summary: Rename Remote Storage metrics to remove ambiguity Key: KAFKA-15236 URL: https://issues.apache.org/jira/browse/KAFKA-15236 Project: Kafka Issue

[jira] [Created] (KAFKA-14946) Kafka Node Shutting Down Automatically

Akshay Kumar created KAFKA-14946: Summary: Kafka Node Shutting Down Automatically Key: KAFKA-14946 URL: https://issues.apache.org/jira/browse/KAFKA-14946 Project: Kafka Issue Type: Bug

RE: Supported Kafka/Zookeeper Version with ELK 8.4.3

Hi Team, We are still waiting for the reply. Please update we must know what version of Kafka is compatible with ELK 8.4 version. Still, I can see no one replied on user and Dev community portal [cid:image001.png@01D8EAFE.9B1F9280] Thanks Sudip From: Kumar, Sudip Sent: Monday, October 17

Supported Kafka/Zookeeper Version with ELK 8.4.3

) consuming the data. We have an integration of ELK 7.16 with Kafka V2.5.1 and zookeeper 3.5.8. Please suggest if we upgrade on ELK 8.4.3 version which Kafka and Zookeeper version will be supported? Provide us handful documents. Let me know if you any further questions. Thanks Sudip Kumar

[jira] [Resolved] (KAFKA-14220) "partition-count" not getting updated after revocation of partitions in case of Incremental Co-operative rebalancing.

[ https://issues.apache.org/jira/browse/KAFKA-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pritam Kumar resolved KAFKA-14220. -- Reviewer: (was: Chris Egerton) Resolution: Abandoned > "partition-count"

[jira] [Created] (KAFKA-14220) "partition-count" not getting updated after revocation of partitions in case of Incremental Co-operative rebalancing.

Pritam Kumar created KAFKA-14220: Summary: "partition-count" not getting updated after revocation of partitions in case of Incremental Co-operative rebalancing. Key: KAFKA-14220 URL: https://issues.

Re: [ANNOUNCE] New Committer: Chris Egerton

Congratulations Chris! On Tue, 26 Jul, 2022, 7:11 AM deng ziming, wrote: > Congratulations Chris ! > > -- > Ziming > > > On Jul 26, 2022, at 5:01 AM, Matthias J. Sax wrote: > > > > Congrats! Well deserved! > > > > -Matthias > > > > On 7/25/22 1:08 PM, Bill Bejeck wrote: > >> Congrats Chris! > >

[jira] [Resolved] (KAFKA-13926) Proposal to have "HasField" predicate for kafka connect

[ https://issues.apache.org/jira/browse/KAFKA-13926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kumud Kumar Srivatsava Tirupati resolved KAFKA-13926. - Resolution: Won't Fix Dropping in favor of impr

Re: [DISCUSS] KIP-845: HasField predicate for kafka connect

Hi Chris, Thanks for your comment. I might have misunderstood the filter SMT. Makes sense. Dropping this KIP for now. I will look at improving the existing SMTs separately. *---* *Thanks and Regards,* *Kumud Kumar Srivatsava Tirupati* On Sat, 4 Jun 2022 at 03:57, Chris Egerton wrote: >

Re: [DISCUSS] KIP-845: HasField predicate for kafka connect

. *---* *Thanks and Regards,* *Kumud Kumar Srivatsava Tirupati* *Ph : +91-8686073938* On Fri, 3 Jun 2022 at 18:04, Chris Egerton wrote: > Hi Kumud, > > Responses inline. > > > But, I still believe this logic of predicate checking shouldn't be made a > part of ea

Re: [DISCUSS] KIP-845: HasField predicate for kafka connect

m the transformation chain altogether using the current ` org.apache.kafka.connect.transforms.Filter`. So, the use cases are not just limited to skipping some SMTs. If this makes sense, I should probably add this and give an example in the KIP as well. *---* *Thanks and Regards,* *Kumud Kumar Sriva

Re: [DISCUSS] KIP-845: HasField predicate for kafka connect

Hi Sagar, Added the examples to the KIP wiki as suggested. *---* *Thanks and Regards,* *Kumud Kumar Srivatsava Tirupati* On Wed, 25 May 2022 at 17:14, Sagar wrote: > Thanks for the KIP Kumud. > > Can you please add a couple of examples on how this would behave with > different com

[DISCUSS] KIP-845: HasField predicate for kafka connect

Regards,* *Kumud Kumar Srivatsava Tirupati*

Requesting permissions to contribute to Kafka

Kumar Srivatsava Tirupati*

[jira] [Created] (KAFKA-13926) Proposal to have "HasField" predicate for kafka connect

Kumud Kumar Srivatsava Tirupati created KAFKA-13926: --- Summary: Proposal to have "HasField" predicate for kafka connect Key: KAFKA-13926 URL: https://issues.apache.org/jira/browse/K

[jira] [Created] (KAFKA-13575) Unwanted cleanup since log.retention.hours=-1 does not work

Alok Kumar Singh created KAFKA-13575: Summary: Unwanted cleanup since log.retention.hours=-1 does not work Key: KAFKA-13575 URL: https://issues.apache.org/jira/browse/KAFKA-13575 Project: Kafka

Re: [ANNOUNCE] New Kafka PMC member: David Jacot

Congratulations, David! Best regards, Rankesh Kumar Partner Solutions Engineer +91 (701)913-0147 Follow us: Blog • Slack • Twitter • YouTube > On 18-Dec-2021, at 4:38 AM, Gwen Shapira wrote: > > Hi everyone, > > David Jacot has been an Apache Kafka committer since Oct 20

Kafka SSL CA Change Issue

g to connect to broker ( from kafka tool) by using consumer certificates. Thanks & Regards R . Naresh Kumar LCG-DF DevOps Engineer​ [cid:354c3de2-833f-4115-ad41-699919639207]

[jira] [Created] (KAFKA-13334) ERROR Failed to clean up log for __consumer_offsets

Udaya Kumar created KAFKA-13334: --- Summary: ERROR Failed to clean up log for __consumer_offsets Key: KAFKA-13334 URL: https://issues.apache.org/jira/browse/KAFKA-13334 Project: Kafka Issue Type

FW: Abe to access Kafka Services inside but unable ... -

Hi Team, Kafka Zookeeper & Kafka Server services are configured in a Linux box. Inside the linux box we are able to access both the server. While we try to access from our local machine it not connected. We try the following document to configure Kafka in SASL_PLAINTEXT protocal. We re facing

  1   2   3   4   >