RE: [EXTERNAL] Re: [DISCUSS] KIP-280: Enhanced log compaction

Thanks Jun for confirming! I have updated the KIP (added recommendation section and special case in handling LEO record for non-offset based compaction strategy). Please review and let me know if you have any other feedback. Regards, Senthil -Original Message- From: Jun Rao Sent:

RE: [VOTE] KIP-280: Enhanced log compaction

Jun, If the updated KIP looks good, can you please vote for it. Thanks, Senthil -Original Message- From: Jun Rao Sent: Thursday, November 7, 2019 4:33 PM To: dev Subject: Re: [VOTE] KIP-280: Enhanced log compaction Hi, Senthil, Thanks for the KIP. Added a few more comments on the

[jira] [Created] (KAFKA-9238) Flaky Test UncleanLeaderElectionTest#testUncleanLeaderElectionEnabledByTopicOverride

Matthias J. Sax created KAFKA-9238: -- Summary: Flaky Test UncleanLeaderElectionTest#testUncleanLeaderElectionEnabledByTopicOverride Key: KAFKA-9238 URL: https://issues.apache.org/jira/browse/KAFKA-9238

[jira] [Created] (KAFKA-9237) Flaky Test UncleanLeaderElectionTest#testUncleanLeaderElectionDisabled

Matthias J. Sax created KAFKA-9237: -- Summary: Flaky Test UncleanLeaderElectionTest#testUncleanLeaderElectionDisabled Key: KAFKA-9237 URL: https://issues.apache.org/jira/browse/KAFKA-9237 Project:

[jira] [Created] (KAFKA-9236) Confused log after using CLI scripts to produce messages

Xiang Zhang created KAFKA-9236: -- Summary: Confused log after using CLI scripts to produce messages Key: KAFKA-9236 URL: https://issues.apache.org/jira/browse/KAFKA-9236 Project: Kafka Issue

[jira] [Created] (KAFKA-9235) Transaction state not cleaned up following StopReplica request

Jason Gustafson created KAFKA-9235: -- Summary: Transaction state not cleaned up following StopReplica request Key: KAFKA-9235 URL: https://issues.apache.org/jira/browse/KAFKA-9235 Project: Kafka

[jira] [Created] (KAFKA-9234) Consider using @Nullable and @Nonnull annotations

Matthias J. Sax created KAFKA-9234: -- Summary: Consider using @Nullable and @Nonnull annotations Key: KAFKA-9234 URL: https://issues.apache.org/jira/browse/KAFKA-9234 Project: Kafka Issue

Re: [DISCUSS] KIP-280: Enhanced log compaction

Hi, Senthil, Sorry for the delay. 51. It seems that we can just remove the last record from the batch, but keeps the batch during compaction. The batch level metadata is enough to preserve the log end offset. 53. Yes, your understanding is correct. So we could recommend users to set "

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Hi, Satish and Ying, Thanks for the reply. 40/41. There are two different ways that we can approach this. One is what you said. We can have an opinionated way of storing and populating the tier metadata that we think is good enough for everyone. I am not sure if this is the case based on what's

Re: [VOTE] 2.4.0 RC1

Hi, I also used Eric's test script. I had a few issues running it that I address below[0][1], otherwise looks good. - Signing keys all good - All md5, sha1sums and sha512sums are good - A couple transient test failures that passed on a second run

[jira] [Created] (KAFKA-9233) Kafka consumer throws undocumented IllegalStateException

Andrew Olson created KAFKA-9233: --- Summary: Kafka consumer throws undocumented IllegalStateException Key: KAFKA-9233 URL: https://issues.apache.org/jira/browse/KAFKA-9233 Project: Kafka Issue

Build failed in Jenkins: kafka-2.4-jdk8 #87

See Changes: [mumrah] KAFKA-8981 Add rate limiting to NetworkDegradeSpec (#7446) [mumrah] KAFKA-9123 Test a large number of replicas (#7621) -- [...truncated 2.70 MB...]

Re: [DISCUSS] KIP-548 Add Option to enforce rack-aware custom partition reassignment execution

Thanks for the comments @Vahid, Yes i agree we can always introduce the new option, but what i was think is, as this is a ad-hoc tool and whoever is using the new version of the tool always will have the info to correct the usage, and also this will keep the tool in-sync with the current

Re: Connect port

Hi Paul, A Connect worker will bring up and listen to at least one port that is used by its REST API. This API is used externally to manage connectors and query their status, as well as internally between the Connect workers in order for them to form a cluster and share tasks (Connect workers

[jira] [Created] (KAFKA-9232) Coordinator heartbeat completion does not work for JoinGroup v3

Jason Gustafson created KAFKA-9232: -- Summary: Coordinator heartbeat completion does not work for JoinGroup v3 Key: KAFKA-9232 URL: https://issues.apache.org/jira/browse/KAFKA-9232 Project: Kafka

Re: [VOTE] 2.4.0 RC1

Hi All, Please download, test and vote the RC1 in order to provide quality assurance for the forthcoming 2.4 release. Thanks. On Tue, Nov 26, 2019 at 8:11 PM Adam Bellemare wrote: > Hello, > > Ran Eric's test script: > $ git clone https://github.com/elalonde/kafka > $

Re: [VOTE] KIP-533: Add default api timeout to AdminClient

Thanks Colin, that makes sense. I'm going to close this vote. +4 (binding) is the total. -Jason On Tue, Nov 26, 2019 at 9:18 AM Colin McCabe wrote: > +1 (binding). > > Thanks, Jason. > > Maybe we should specify that if the configured request.timeout.ms is > longer than default.api.timeout.ms,

Re: Please help me add the permission for creating KIP,thanks

You're all set now. Thanks for your interest in Apache Kafka. -Bill On Tue, Nov 26, 2019 at 11:28 AM 卢世吉 wrote: > I want to create KIP,but I don't have the permission,please help me solve > it,my username is stevenlumt > > > > >

Re: [VOTE] KIP-533: Add default api timeout to AdminClient

+1 (binding). Thanks, Jason. Maybe we should specify that if the configured request.timeout.ms is longer than default.api.timeout.ms, the request timeout will be reduced to fit in the API timeout. best, Colin On Sat, Nov 23, 2019, at 16:59, Ismael Juma wrote: > +1 (binding) > > Note that

Re: Preliminary blog post about the Apache Kafka 2.4.0 release

Sure, I will mention the details about ZK upgrade to 3.5 Thanks. On Tue, Nov 26, 2019 at 1:57 PM Sönke Liebau wrote: > Hi Manikumar, > > looks great, thanks for the effort! > > Like Ismael, I think it would make sense to mention the ZK upgrade to 3.5 I > know a few people that are waiting for

Please help me add the permission for creating KIP,thanks

I want to create KIP,but I don't have the permission,please help me solve it,my username is stevenlumt

Re: What happened to KIP-158?

Hi Tom. Good timing for your question. I'll be revisiting KIP-158 and I'll bring an updated proposal for discussion this quarter. As always, it'll be ideal to strike a good balance between flexibility and conciseness on what we expose to Connect's developers and operators. Stay tuned.

[jira] [Resolved] (KAFKA-9229) initTransactions() fails when running new producer against an old server

[ https://issues.apache.org/jira/browse/KAFKA-9229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-9229. Resolution: Fixed > initTransactions() fails when running new producer against an old

[jira] [Created] (KAFKA-9231) ProducerFencedException may cause Streams Thread to die

John Roesler created KAFKA-9231: --- Summary: ProducerFencedException may cause Streams Thread to die Key: KAFKA-9231 URL: https://issues.apache.org/jira/browse/KAFKA-9231 Project: Kafka Issue

Re: [VOTE] 2.4.0 RC1

Hello, Ran Eric's test script: $ git clone https://github.com/elalonde/kafka $ ./kafka/bin/verify-kafka-rc.sh 2.4.0 https://home.apache.org/~manikumar/kafka-2.4.0-rc1 - All PGP signatures are good - All md5, sha1sums and sha512sums pass - Had

Re: [DISCUSS] KIP-280: Enhanced log compaction

Hi Gouzhang & Jun, Can one of you please confirm/respond to the below mail so that I will go ahead and update the KIP and proceed. Thanks Senthil - Senthil From: Senthilnathan Muthusamy Sent: Wednesday, November 20, 2019 5:04:20 PM To: dev@kafka.apache.org

Build failed in Jenkins: kafka-trunk-jdk8 #4070

See Changes: [github] KAFKA-9229: Fix incompatible change in InitProducerIdRequest (#7746) -- [...truncated 8.30 MB...] org.apache.kafka.streams.test.TestRecordTest >

[jira] [Created] (KAFKA-9230) Change User Customizable Metrics API in StreamsMetrics interface

Bruno Cadonna created KAFKA-9230: Summary: Change User Customizable Metrics API in StreamsMetrics interface Key: KAFKA-9230 URL: https://issues.apache.org/jira/browse/KAFKA-9230 Project: Kafka

Re: Preliminary blog post about the Apache Kafka 2.4.0 release

Hi Manikumar, looks great, thanks for the effort! Like Ismael, I think it would make sense to mention the ZK upgrade to 3.5 I know a few people that are waiting for this because of the SSL support so there is probably more of them out there :) Best regards, Sönke On Mon, 25 Nov 2019 at 20:11,