Re: [VOTE] 3.0.1 RC0

2022-03-07 Thread Luke Chen
Hi Mickael, Thanks for running the release! I did the following: 1. Validated the scala 2.13 checksums 2. Spot checked the java docs 3. Ran the quick start with scala 2.13 (found a minor bug KAFKA-13718 , won't block the release) +1

[jira] [Created] (KAFKA-13718) kafka-topics create with default config will show `segment.bytes` overridden config

2022-03-07 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13718: - Summary: kafka-topics create with default config will show `segment.bytes` overridden config Key: KAFKA-13718 URL: https://issues.apache.org/jira/browse/KAFKA-13718

Re: [DISCUSS] KIP-714: Client metrics and observability

2022-03-07 Thread Ashenafi Marcos
Hi, Can you please take out my email I’d so that will not be able to receive any mail from you. Thank you On Tue, Oct 19, 2021 at 1:30 PM Mickael Maison wrote: > Hi Magnus, > > Thanks for the proposal. > > 1. Looking at the protocol section, isn't "ClientInstanceId" expected > to be a field in

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

2022-03-07 Thread Sergio Daniel Troiano
Hi Luke, Make sense, done! Thank you. Sergio Troiano On Tue, 8 Mar 2022 at 03:02, Luke Chen wrote: > Hi Sergio, > > > I don't want this to minimize the main feature I want to deploy as I > think the > message size limit is not as important as the limiting the amount of > batches. > > Agree!

[jira] [Created] (KAFKA-13717) KafkaConsumer.close throws authorization exception even when commit offsets is empty

2022-03-07 Thread Vincent Jiang (Jira)
Vincent Jiang created KAFKA-13717: - Summary: KafkaConsumer.close throws authorization exception even when commit offsets is empty Key: KAFKA-13717 URL: https://issues.apache.org/jira/browse/KAFKA-13717

[jira] [Created] (KAFKA-13716) add tests for `DeleteRecordsCommand`

2022-03-07 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13716: - Summary: add tests for `DeleteRecordsCommand` Key: KAFKA-13716 URL: https://issues.apache.org/jira/browse/KAFKA-13716 Project: Kafka Issue Type: Test

[jira] [Created] (KAFKA-13715) Add "generation" field into consumer protocol

2022-03-07 Thread Luke Chen (Jira)
Luke Chen created KAFKA-13715: - Summary: Add "generation" field into consumer protocol Key: KAFKA-13715 URL: https://issues.apache.org/jira/browse/KAFKA-13715 Project: Kafka Issue Type: New

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

2022-03-07 Thread Luke Chen
Hi Sergio, > I don't want this to minimize the main feature I want to deploy as I think the message size limit is not as important as the limiting the amount of batches. Agree! Let's focus on the feature of limiting the batch amounts. One more comment to the KIP: 1. Could you put the new

Re: [DISCUSS] KIP-820: Extend KStream process with new Processor API

2022-03-07 Thread Matthias J. Sax
I think it's ok that we cannot prevent users from mutating a given read-only object. We have similar issues "all over the place" in the API, because it's just how Java works unfortunately (eg, `ValueMapperWithKey` and similar interfaces). The point being is, that the API clearly expresses

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #743

2022-03-07 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-13714) Flaky test IQv2StoreIntegrationTest

2022-03-07 Thread John Roesler (Jira)
John Roesler created KAFKA-13714: Summary: Flaky test IQv2StoreIntegrationTest Key: KAFKA-13714 URL: https://issues.apache.org/jira/browse/KAFKA-13714 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-714: Client metrics and observability

2022-03-07 Thread Magnus Edenhill
Hi Jun, thanks for your initiated questions, see my answers below. There's been a number of clarifications to the KIP. Den tors 27 jan. 2022 kl 20:08 skrev Jun Rao : > Hi, Magnus, > > Thanks for updating the KIP. The overall approach makes sense to me. A few > more detailed comments below. >

Re: [DISCUSS] KIP-820: Extend KStream process with new Processor API

2022-03-07 Thread Guozhang Wang
Thanks John! I feel a bit ashamed of just thinking loud here without trying out prototypes myself :P I think the FixedKeyProcessor/Record looks very good -- like you said, since we are making a new set of APIs then why don't we reconsider more bolderly -- but at the same time I'd also like to

Re: [DISCUSS] KIP-820: Extend KStream process with new Processor API

2022-03-07 Thread Matthias J. Sax
Thanks John! This is great! I guess I was aware the pulling the `ValueRecord` string might move more parts than I mentioned. Happy to see you being supportive of the idea. -Matthias On 3/7/22 10:31 AM, Jorge Esteban Quilcate Otoya wrote: Thanks, John! This looks very promising. I will

Re: [DISCUSS] KIP-813 Shared State Stores

2022-03-07 Thread Matthias J. Sax
Thanks for updating the KIP. LGTM. I think we can start a vote. I think this might provide issues if your processor is doing a projection of the data. This is correct. It's a know issue: https://issues.apache.org/jira/browse/KAFKA-7663 Global-stores/KTables are designed to put the data

Re: [DISCUSS] KIP-820: Extend KStream process with new Processor API

2022-03-07 Thread Jorge Esteban Quilcate Otoya
Thanks, John! This looks very promising. I will familiarize this approach and update the KIP accordingly. From what I can see so far, this should cover most of the open issues in this proposal. PS. > Just as a reminder, the current approach with transformers > is NOT enforced at compile time.

Re: [VOTE] 3.0.1 RC0

2022-03-07 Thread Mickael Maison
Here is a successful Jenkins build for the 3.0 branch: https://ci-builds.apache.org/job/Kafka/job/kafka/job/3.0/183/ On Mon, Mar 7, 2022 at 12:27 AM Jakub Scholz wrote: > > +1 (non-binding). I used the staged Scala 2.13 binaries and the staging > Maven repository to run my tests. All seems to

Jenkins build is back to stable : Kafka » Kafka Branch Builder » 3.0 #183

2022-03-07 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.0 #182

2022-03-07 Thread Apache Jenkins Server
See

Re: [DISCUSS] Apache Kafka 3.2.0 release

2022-03-07 Thread Bruno Cadonna
Hi Kafkateers, Last week we reached KIP freeze for the next major release 3.2.0 of Apache Kafka. I have updated the release plan for AK 3.2.0 with all the KIPs that passed the vote last week. Please, verify the plan and let me know if any KIP should be added to or removed from the release

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

2022-03-07 Thread Sergio Daniel Troiano
hey Luke, I am interested in expanding the KIP scope but I am a bit concerned this could create a lot of noise and confusion as they look like very similar parameters, I agree this is a small change, so I think if I do it properly it should not be a problem at all, I just will need a couple more

[jira] [Resolved] (KAFKA-10759) ARM support for Kafka

2022-03-07 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-10759. Fix Version/s: 3.0.0 Resolution: Fixed > ARM support for Kafka >

[jira] [Resolved] (KAFKA-13671) Power (ppc64le) support for kafka

2022-03-07 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13671. Fix Version/s: 3.2.0 Resolution: Fixed > Power (ppc64le) support for kafka >