Re: [DISCUSS] KIP-917: Additional custom metadata for remote log segment

Hi all FYI, I opened this for a vote: https://lists.apache.org/thread/pnrkgomomwb03h8pfgs0k7dzwgpbtloz On Tue, 13 Jun 2023 at 08:01, Ivan Yurchenko wrote: > Hi Luke, > > > I saw you add the `RemoteLogSegmentMetadataRecord` and > > `RemoteLogSegmentMetadataSnapshotRecord`, I'd like to confirm

Re: [DISCUSS] KIP-917: Additional custom metadata for remote log segment

Hi Luke, > I saw you add the `RemoteLogSegmentMetadataRecord` and > `RemoteLogSegmentMetadataSnapshotRecord`, I'd like to confirm we're > not adding these records into any new API request/response, right? Not really, the KIP only extends these records, they were added before. And to your

[jira] [Created] (KAFKA-15082) The log retention policy doesn't take effect after altering log dir

Drawxy created KAFKA-15082: -- Summary: The log retention policy doesn't take effect after altering log dir Key: KAFKA-15082 URL: https://issues.apache.org/jira/browse/KAFKA-15082 Project: Kafka

Re: [DISCUSS] KIP-917: Additional custom metadata for remote log segment

Hi Ivan, I agree this is a good improvement for remote storage plugin. One question from me, I saw you add the `RemoteLogSegmentMetadataRecord` and `RemoteLogSegmentMetadataSnapshotRecord`, I'd like to confirm we're not adding these records into any new API request/response, right? I think the

Re: [VOTE] KIP-917: Additional custom metadata for remote log segment

+1 (non-binding). Thanks for the KIP! On Mon, Jun 12, 2023, 21:23 Divij Vaidya wrote: > I have reviewed the proposal and feel that it would be beneficial to > implement. > > Vote +1 (non-binding) > > > -- > Divij Vaidya > > > > On Mon, Jun 12, 2023 at 4:39 PM Ivan Yurchenko > wrote: > > >

Re: Contributing to Kafka

Hi Joobi, Thanks for the interest in Apache Kafka. You can read the contributor guide here first: https://kafka.apache.org/contributing And find tickets you're interested from JIRA: https://issues.apache.org/jira/projects/KAFKA/ Let us know if you have any questions. Thank you. Luke On Tue, Jun

[jira] [Created] (KAFKA-15081) Implement new consumer offsetsForTimes

Lianet Magrans created KAFKA-15081: -- Summary: Implement new consumer offsetsForTimes Key: KAFKA-15081 URL: https://issues.apache.org/jira/browse/KAFKA-15081 Project: Kafka Issue Type: Task

Re: [VOTE] KIP-925: rack aware task assignment in Kafka Streams

Hi all, The vote passed with 3 binding votes and 1 non-binding vote. Thanks all for voting! Thanks, Hao On Mon, Jun 5, 2023 at 4:29 PM John Roesler wrote: > Thanks, Hao! > > I'm +1 (binding) > -John > > On 2023/06/05 18:07:56 Walker Carlson wrote: > > +1 (binding) > > > > On Mon, Jun 5, 2023

Re: [VOTE] 3.5.0 RC1

Hey Mickael, thanks for running the release! I downloaded the 2.12 binary and did the following: * Verified signatures * Performed KRaft quickstart * Manually ran through a ZK to KRaft migration I notice we're missing the KRaft migration docs from

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1919

See

Contributing to Kafka

Dear all, My name is Joobi and I am a software engineer with experience in working with Kafka. I am reaching out to express my keen interest in contributing to Kafka. Currently, I'm going through the source code and the official documentation to better understand the project. I would greatly

Re: [DISCUSS] KIP-937 Improve Message Timestamp Validation

Hi Luke, Divij and All, I have updated the KIP to incorporate Luke's comment. We now have two new configurations for validating the message timestamp difference. The existing configuration, "log.message.timestamp.difference.max.ms", will be deprecated. The "before" validation uses the same

Re: [VOTE] 3.5.0 RC1

Hi Mickael, I verified the following: 1. All signatures and checksums 2. Built from source 3. Ran all the unit tests 4. Ran the Kafka-Zookeeper, Kafka-KRaft, and the Kafka Streams quickstarts 5. Spot-checked the docs 6. Spot-checked the JavaDocs It's a +1(binding) for me.

Re: [VOTE] KIP-917: Additional custom metadata for remote log segment

I have reviewed the proposal and feel that it would be beneficial to implement. Vote +1 (non-binding) -- Divij Vaidya On Mon, Jun 12, 2023 at 4:39 PM Ivan Yurchenko wrote: > Hello, > > Some interest in KIP-917 was expressed in the discussion thread [1]. After > addressing all the comments

[jira] [Resolved] (KAFKA-15076) KRaft should prefer snapshots when listeners are at the start of the log

[ https://issues.apache.org/jira/browse/KAFKA-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-15076. Resolution: Fixed > KRaft should prefer snapshots when listeners

[VOTE] KIP-917: Additional custom metadata for remote log segment

Hello, Some interest in KIP-917 was expressed in the discussion thread [1]. After addressing all the comments there, I'm putting it up to a vote. Thanks! Best, Ivan [1] https://lists.apache.org/thread/qpccqd3jy5rzvbt5ngtzo3dg9pzp722y

Re: [DISCUSS] KIP-935: Extend AlterConfigPolicy with existing configurations

Thanks Colin! You're right. I have added some notes about this to the KIP, and clarify how this KIP is related to legacy and incremental alter config APIs. Let me know if there's any gaps on the current proposal. Many thanks, Jorge. On Mon, 12 Jun 2023 at 11:04, Colin McCabe wrote: > See

Re: Permissions to contribute to Apache Kafka.

Hi Vaibhav, You are all set. Thanks for your interest in Apache Kafka! Best, On Mon, Jun 12, 2023 at 3:21 PM Vaibhav Nazare wrote: > HI Team, > > Following are the details for > > Wiki id > Email: vaibhav.naz...@ibm.com > Username: vnazare > > Jira id > Email:

Permissions to contribute to Apache Kafka.

HI Team, Following are the details for Wiki id Email: vaibhav.naz...@ibm.com Username: vnazare Jira id Email: vaibhav.naz...@ibm.com Username: vnazare Thanks, Vaibhav Nazare

Re: Apache Kafka 3.6.0 release

Hi, I have created a release plan for Apache Kafka version 3.6.0 on the wiki. You can access the release plan and all related information by following this link: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+3.6.0 The release plan outlines the key milestones and important dates

[VOTE] KIP-858: Handle JBOD broker disk failure in KRaft

Hi everyone, We're getting closer to dropping ZooKeeper support, and JBOD in KRaft mode is one of the outstanding big missing features. It's been a while since there was new feedback on KIP-858 [1] which aims to address this gap, so I'm calling for a vote. A huge thank you to everyone who has

Re: [VOTE] 3.5.0 RC1

Hi Mickael, Thanks for running the release. +1 (non-binding) - Ran testAll/releaseTarGzAll successfully with no failures. - Ran through quickstart of core/streams on builds generated from 3.5.0-rc1 tag. - Ran a few internal apps targeting to topics on a 3 node cluster. On Mon, 12 Jun 2023 at

Re: [DISCUSS] KIP-916: MM2 distributed mode flow log context

Updated the KIP with a few example log lines before/after the change. Daniel Dániel Urbán ezt írta (időpont: 2023. jún. 7., Sze, 13:59): > Hi Chris, > > Thank you for your comments! I updated the KIP. I still need to add the > example before/after log lines, will do that soon, but I addressed

Re: [DISCUSS] KIP-935: Extend AlterConfigPolicy with existing configurations

See KAFKA-14195. Some deletions are not handled correctly. And this cannot be fixed without a kip because of backwards compatibility. Colin On Wed, Jun 7, 2023, at 17:07, Jorge Esteban Quilcate Otoya wrote: > Thank Colin. > > I've took a closer look on how configs are passed to the policy when

[jira] [Created] (KAFKA-15080) Fetcher's lag never set when partition is idle

David Jacot created KAFKA-15080: --- Summary: Fetcher's lag never set when partition is idle Key: KAFKA-15080 URL: https://issues.apache.org/jira/browse/KAFKA-15080 Project: Kafka Issue Type: Bug

Re: [VOTE] 3.5.0 RC1

Hi MIckael, Just for the record, I +1'd this release. However, my vote falls onto the non-binding ones as well. Best, On Sun, Jun 11, 2023 at 11:38 AM Mickael Maison wrote: > Hi, > > We've passed the deadline but we are still missing votes. > So far we have have 2 binding votes (Luke and John)