[GitHub] [kafka-site] showuon opened a new pull request, #519: MINOR: Add Kafka 3.4.1 documentation and javadoc

showuon opened a new pull request, #519: URL: https://github.com/apache/kafka-site/pull/519 Generated for 3.4.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1899

See

Re: [DISCUSS] KIP-937 Improve Message Timestamp Validation

Hey Justine and Divij, Thank you for the recommendations. I've made the updates to the KIP and added a new section called "Future Work: Update Message Format to Include Both Client Timestamp and LogAppend Timestamp." Please take a look when get some time and let me know if there's anything

Re: [VOTE] KIP-925: rack aware task assignment in Kafka Streams

Thanks, Hao! I'm +1 (binding) -John On 2023/06/05 18:07:56 Walker Carlson wrote: > +1 (binding) > > On Mon, Jun 5, 2023 at 3:14 AM Bruno Cadonna wrote: > > > Hi Hao, > > > > +1 (binding) > > > > Thanks! > > Bruno > > > > On 30.05.23 21:16, Colt McNealy wrote: > > > +1 (non-binding) > > > > >

[jira] [Created] (KAFKA-15060) Fix Admin.describeFeatures

Colin McCabe created KAFKA-15060: Summary: Fix Admin.describeFeatures Key: KAFKA-15060 URL: https://issues.apache.org/jira/browse/KAFKA-15060 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-15059) Exactly-once source tasks fail to start during pending rebalances

Chris Egerton created KAFKA-15059: - Summary: Exactly-once source tasks fail to start during pending rebalances Key: KAFKA-15059 URL: https://issues.apache.org/jira/browse/KAFKA-15059 Project: Kafka

Re: [DISCUSS] KIP-858: Handle JBOD broker disk failure in KRaft

> How to attract more feedback from committers for this proposal Hi Igor. I'll review the KIP later this week Ron On Mon, Jun 5, 2023 at 1:37 PM Igor Soarez wrote: > > Hi all, > > We just had a video call to discuss this KIP and I just wanted > update this thread with a note on the meeting. >

[VOTE] KIP-938: Add more metrics for measuring KRaft performance

Hi all, I'd like to open the vote for KIP-938: Add more metrics for measuring KRaft performance. Take a look here: https://cwiki.apache.org/confluence/x/gBU0Dw Thanks to everyone who reviewed the proposal. best, Colin

Re: [DISCUSS] KIP-938: Add more metrics for measuring KRaft performance

On Sun, Jun 4, 2023, at 04:10, Divij Vaidya wrote: > Thanks for the KIP Colin. I liked the rationale section which clearly > explains why the metrics are required and what they might indicate. > > 1. I have a question about the "CurrentMetadataVersion" metric. Correct > me > if I'm wrong, but I

Re: [VOTE] 3.5.0 RC1

Hi Mickael, I ran the following validation steps: - Built from source with Java 11 and Scala 2.13 - Signatures and hashes of the artifacts generated - Navigated through Javadoc including links to JDK classes - Run the unit tests - Run integration tests - Run the quickstart in KRaft and Zookeeper

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

Hi Victoria, that is a good point! I think, the topic needs to be a compacted topic to be able to get rid of records that are evicted from the buffer. So the key might be something with the key, the timestamp, and a sequence number to distinguish between records with the same key and same

Re: [VOTE] KIP-923: Add A Grace Period to Stream Table Join

Hi Walker, Thanks for the KIP! Left a clarification question on the discussion thread just now but it's about an implementation detail, so I don't think it changes anything in this vote thread. +1 (non-binding) Cheers, Victoria On Mon, Jun 5, 2023 at 10:23 AM Bill Bejeck wrote: > Hi Walker,

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

Hi Walker, Thanks for the latest updates! The KIP looks great. Just one question about the changelog topic for the join buffer: The KIP says "When a failure occurs the buffer will try to recover from an OffsetCheckpoint if possible. If not it will reload the buffer from a compacted change-log

Re: [VOTE] KIP-925: rack aware task assignment in Kafka Streams

+1 (binding) On Mon, Jun 5, 2023 at 3:14 AM Bruno Cadonna wrote: > Hi Hao, > > +1 (binding) > > Thanks! > Bruno > > On 30.05.23 21:16, Colt McNealy wrote: > > +1 (non-binding) > > > > Thank you Hao! > > > > Colt McNealy > > > > *Founder, LittleHorse.dev* > > > > > > On Tue, May 30, 2023 at 9:50 

[jira] [Created] (KAFKA-15058) Improve the accuracy of Histogram in client metric

Jun Rao created KAFKA-15058: --- Summary: Improve the accuracy of Histogram in client metric Key: KAFKA-15058 URL: https://issues.apache.org/jira/browse/KAFKA-15058 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-937 Improve Message Timestamp Validation

Hey Divij, Yeah, this makes sense. Let's just include this in the KIP as well. Thanks! On Mon, Jun 5, 2023 at 10:16 AM Divij Vaidya wrote: > Hey Justine > > Thank you for bringing this up. We had a discussion earlier in this [1] > thread and concluded that bumping up the message version is a

[DISCUSS] Partial CI builds - Reducing flakiness with fewer tests

Hey all, I've been working on test flakiness recently, and I've been trying to come up with ways to tackle the issue top-down as well as bottom-up, and I'm interested to hear your thoughts on an idea. In addition to the current full-suite runs, can we in parallel trigger a smaller test run which

Re: [DISCUSS] KIP-858: Handle JBOD broker disk failure in KRaft

Hi all, We just had a video call to discuss this KIP and I just wanted update this thread with a note on the meeting. Attendees: - Igor - Christo - Divij - Colt Items discussed: - Context, motivation and overview of the proposal. - How log directories are identified by each Broker. - How old

Re: [VOTE] KIP-923: Add A Grace Period to Stream Table Join

Hi Walker, Thanks for the KIP. I've caught up on the discussion thread and I'm satisfied with all responses. +1(binding) -Bill On Mon, Jun 5, 2023 at 10:20 AM Bruno Cadonna wrote: > Hi Walker, > > Thank you for the KIP! > > +1 (binding) > > Best, > Bruno > > On 24.05.23 23:00, Walker

Re: [DISCUSS] KIP-937 Improve Message Timestamp Validation

Hey Justine Thank you for bringing this up. We had a discussion earlier in this [1] thread and concluded that bumping up the message version is a very expensive operation. Hence, we want to bundle together a bunch of impactful changes that we will perform on the message version and change it in

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.5 #18

See

Re: [DISCUSS] KIP-937 Improve Message Timestamp Validation

Hey Mehari, Thanks for adding that section. I think one other thing folks have considered is including two timestamps in the message format -- one for the client side timestamp and one for the server side. Of course, this would require a bump to the message format, and that hasn't happened in a

Call for Presentations, Community Over Code Asia 2023

You are receiving this message because you are subscribed to one more more developer mailing lists at the Apache Software Foundation. The call for presentations is now open at "https://apachecon.com/acasia2023/cfp.html;, and will be closed by Sunday, Jun 18th, 2023 11:59 PM GMT. The event will

Re: [DISCUSS] solutions for broker OOM caused by many producer IDs

Hi Justine, Thanks for having a look > One question I have is how will we handle a scenario where potentially each new client has a new Kafka Principal? Is that simply not covered by throttling? if any new client setup a new principal they will be throttled based on the throttling for

Re: [DISCUSS] KIP-916: MM2 distributed mode flow log context

Hi Daniel, Thanks for the updates! A few more thoughts: 1. The "Proposed Changes" section seems a bit like a pseudocode implementation of the KIP. We don't really need this level of detail; most of the time, we're just looking for implementation details that don't directly affect the user-facing

Re: [VOTE] KIP-923: Add A Grace Period to Stream Table Join

Hi Walker, +1 (non-binding) Cheers, Lucas On Mon, Jun 5, 2023 at 4:20 PM Bruno Cadonna wrote: > > Hi Walker, > > Thank you for the KIP! > > +1 (binding) > > Best, > Bruno > > On 24.05.23 23:00, Walker Carlson wrote: > > Hello everybody, > > > > I'm opening the vote on KIP-923 here > >

Re: [VOTE] KIP-923: Add A Grace Period to Stream Table Join

Hi Walker, Thank you for the KIP! +1 (binding) Best, Bruno On 24.05.23 23:00, Walker Carlson wrote: Hello everybody, I'm opening the vote on KIP-923 here . If we have more to discus please continue the discussion on the existing thread

Re: [DISCUSS] KIP-916: MM2 distributed mode flow log context

I updated the KIP accordingly. Tried to come up with more generic terms in the Connect code instead of referring to "flow" anywhere. Daniel Dániel Urbán ezt írta (időpont: 2023. jún. 5., H, 14:49): > Hi Chris, > > Thank you for your comments! > > I agree that the toString based logging is not

[VOTE] 3.5.0 RC1

Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 3.5.0. Some of the major features include: - KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters - KIP-881: Rack-aware Partition Assignment for Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1897

See

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.5 #17

See

Re: Requesting permission to contribute

Seem to be working now. Thanks Josep! On Mon, 5 Jun 2023 at 14:50, Josep Prat wrote: > What I did was grant you rights to create KIPs, if you still need a Jira > account the new process is to request it via: > https://infrahelp.apache.org/jira-account-creation.html > > On Mon, Jun 5, 2023 at

Re: Requesting permission to contribute

What I did was grant you rights to create KIPs, if you still need a Jira account the new process is to request it via: https://infrahelp.apache.org/jira-account-creation.html On Mon, Jun 5, 2023 at 2:45 PM Josep Prat wrote: > Hi Igor, > Sorry for the delay. You should be good to go now. Let me

Re: [DISCUSS] KIP-916: MM2 distributed mode flow log context

Hi Chris, Thank you for your comments! I agree that the toString based logging is not ideal, and I believe all occurrences are within a proper logging context, so they can be ignored. If thread names can be changed unconditionally, I agree, using a new MDC key is the ideal solution. Will update

Re: Requesting permission to contribute

Hi Igor, Sorry for the delay. You should be good to go now. Let me know if it doesn't work. Best, On Mon, Jun 5, 2023 at 2:40 PM Igor Buzatovic wrote: > Anyone? :) > > On Tue, 30 May 2023 at 19:13, Igor Buzatovic wrote: > > > Hi, > > I'm kindly asking for permission to contribute to the

Re: Requesting permission to contribute

Anyone? :) On Tue, 30 May 2023 at 19:13, Igor Buzatovic wrote: > Hi, > I'm kindly asking for permission to contribute to the Apache Kafka > project, as described on > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals > page. > > My Apache Wiki ID: beegor > My Apache

[jira] [Created] (KAFKA-15057) Use new interface ZstdBufferDecompressingStreamNoFinalizer from zstd-jni

Divij Vaidya created KAFKA-15057: Summary: Use new interface ZstdBufferDecompressingStreamNoFinalizer from zstd-jni Key: KAFKA-15057 URL: https://issues.apache.org/jira/browse/KAFKA-15057 Project:

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1896

See

Re: [DISCUSS] KIP-928: Making Kafka resilient to log directories becoming full

Hey Colin, Thanks for the review! I am also skeptical that much space can be reclaimed via compaction as detailed in the limitations section of the KIP. In my head there are two ways to get out of the saturated state - configure more aggressive retention and delete topics. I wasn't aware that

Re: [DISCUSS] KIP-928: Making Kafka resilient to log directories becoming full

Heya Igor, Thank you for reading through the KIP and providing feedback! 11. Good question. I will check whether a change is needed in the processing of the metadata records and come back. My hunch says no as long as the Kafka broker is still alive to process the metadata records. This being

Re: [VOTE] 3.4.1 RC3

Hi Luke, Thanks a lot for the patience you had for this release! @Prem you are probably subscribed to either the user or dev mailing list for Apache Kafka, this is why you are receiving these emails. Best, On Mon, Jun 5, 2023 at 10:32 AM Prem Sagar wrote: > Why this mail is marked to me

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

Hi Walker, Thanks once more for the updates to the KIP! Do you also plan to expose metrics for the buffer? Best, Bruno On 02.06.23 17:16, Walker Carlson wrote: Hello Bruno, I think this covers your questions. Let me know what you think 2. We can use a changelog topic. I think we can treat

Re: [VOTE] 3.4.1 RC3

Hi Tom, Thanks for the vote. I've re-run the 3.4 jenkins build, and the `DynamicBrokerReconfigurationTest.testAdvertisedListenerUpdate` test still pass. https://ci-builds.apache.org/job/Kafka/job/kafka/job/3.4/142/ And now, I've got: Binding +1 PMC votes: * Chris Egerton * Mickael Maison * Tom

[jira] [Created] (KAFKA-15056) Kafka producer still fails with ClusterAuthorizationException after permission granted

Jeff created KAFKA-15056: Summary: Kafka producer still fails with ClusterAuthorizationException after permission granted Key: KAFKA-15056 URL: https://issues.apache.org/jira/browse/KAFKA-15056 Project:

Re: [VOTE] KIP-925: rack aware task assignment in Kafka Streams

Hi Hao, +1 (binding) Thanks! Bruno On 30.05.23 21:16, Colt McNealy wrote: +1 (non-binding) Thank you Hao! Colt McNealy *Founder, LittleHorse.dev* On Tue, May 30, 2023 at 9:50 AM Hao Li wrote: Hi all, I'd like to open the vote for KIP-925: rack aware task assignment in Kafka Streams.

Re: Requesting permissions to contribute/create KIPs for apache Kafka

Hi Arunav, You should be all setup now! Thank you for your interest in Apache Kafka! Best, Bruno On 02.06.23 23:30, Arunav Sanyal wrote: Wiki ID: arunav.sanyal91 JIRA ID: arunav.sanyal91