Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #155

2023-08-08 Thread Apache Jenkins Server
See Changes: -- [...truncated 4405 lines...] - group 5 entry nodes: [:spotlessScalaCheck (complete)] - group 6 entry nodes: [:clients:checkstyleMain

[jira] [Created] (KAFKA-15324) Do not bump the leader epoch when changing the replica set

2023-08-08 Thread zeyuliu (Jira)
zeyuliu created KAFKA-15324: --- Summary: Do not bump the leader epoch when changing the replica set Key: KAFKA-15324 URL: https://issues.apache.org/jira/browse/KAFKA-15324 Project: Kafka Issue Type:

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2078

2023-08-08 Thread Apache Jenkins Server
See

Re: [QUESTION] about topic dimension quota

2023-08-08 Thread hudeqi
In fact, I have implemented the bytesIn/bytesOut limit of the topic dimension. I don't know the community's attitude towards this feature, so I don't know if I need to propose a KIP to contribute. best, hudeqi -原始邮件- 发件人: hudeqi 16120...@bjtu.edu.cn 发送时间: 2023-08-08 21:10:39 (星期二)

Re: [DISCUSS] KIP-965: Support disaster recovery between clusters by MirrorMaker

2023-08-08 Thread hudeqi
Thanks for your suggestion, Ryanne. I have updated the configuration name in cwiki. best, hudeqi

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #154

2023-08-08 Thread Apache Jenkins Server
See Changes: -- [...truncated 440796 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 169 > KafkaZkClientTest > testGetLogConfigs() STARTED Gradle

[jira] [Created] (KAFKA-15323) Possible thread leaks in ListOffsetsHandlerTest

2023-08-08 Thread Kirk True (Jira)
Kirk True created KAFKA-15323: - Summary: Possible thread leaks in ListOffsetsHandlerTest Key: KAFKA-15323 URL: https://issues.apache.org/jira/browse/KAFKA-15323 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-15322) Possible thread leaks in AbstractCoordinatorTest

2023-08-08 Thread Kirk True (Jira)
Kirk True created KAFKA-15322: - Summary: Possible thread leaks in AbstractCoordinatorTest Key: KAFKA-15322 URL: https://issues.apache.org/jira/browse/KAFKA-15322 Project: Kafka Issue Type: Bug

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2077

2023-08-08 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-15312) FileRawSnapshotWriter must flush before atomic move

2023-08-08 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-15312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-15312. Resolution: Fixed > FileRawSnapshotWriter must flush before

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #54

2023-08-08 Thread Apache Jenkins Server
See Changes: -- [...truncated 189332 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 180 > ZooKeeperClientTest > testZooKeeperStateChangeRateMetrics()

[jira] [Created] (KAFKA-15321) Document consumer group member state machine

2023-08-08 Thread Kirk True (Jira)
Kirk True created KAFKA-15321: - Summary: Document consumer group member state machine Key: KAFKA-15321 URL: https://issues.apache.org/jira/browse/KAFKA-15321 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-15320) Document event queueing patterns

2023-08-08 Thread Kirk True (Jira)
Kirk True created KAFKA-15320: - Summary: Document event queueing patterns Key: KAFKA-15320 URL: https://issues.apache.org/jira/browse/KAFKA-15320 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-15319) Upgrade rocksdb to fix CVE-2022-37434

2023-08-08 Thread Maruthi (Jira)
Maruthi created KAFKA-15319: --- Summary: Upgrade rocksdb to fix CVE-2022-37434 Key: KAFKA-15319 URL: https://issues.apache.org/jira/browse/KAFKA-15319 Project: Kafka Issue Type: Bug Affects

Re: [DISCUSS] Apache Kafka 3.4.1 release

2023-08-08 Thread José Armando García Sancio
Hey Luke, Thanks for working on the release for 3.4.1. I was working on some cherry picks and I noticed that branch 3.4 doesn't contain the commit/tag for 3.4.1. I think we are supposed to merge the tag back to the 3.4 branch. E.g.: > Merge the last version change / rc tag into the release

Re: Flaky tests need attention (clients, Connect, Mirror Maker, Streams, etc.)

2023-08-08 Thread Greg Harris
Hey all, MirrorConnectorsIntegration*Test#testOffsetTranslationBehindReplicationFlow() flakiness should be addressed by https://github.com/apache/kafka/pull/14156 which is currently in review. There is other flakiness in the suite which this PR does not address and needs further investigation.

Re: Flaky tests need attention (clients, Connect, Mirror Maker, Streams, etc.)

2023-08-08 Thread Kirk True
Here are some useful links for filtering failing tests by branches: All branches: https://ge.apache.org/scans/tests?search.rootProjectNames=kafka=P28D trunk-only: https://ge.apache.org/scans/tests?search.rootProjectNames=kafka=P28D=Git%20branch=trunk All branches except trunk:

Re: Flaky tests need attention (clients, Connect, Mirror Maker, Streams, etc.)

2023-08-08 Thread Justine Olshan
Thanks Kirk! I will try to go through in the next day or so and see if there is any tests I can fix. On Tue, Aug 8, 2023 at 3:13 PM Kirk True wrote: > Hi Justine, > > > On Aug 1, 2023, at 4:50 PM, Justine Olshan > wrote: > > > > Is that right that the first one on the list ( > > >

Re: Flaky tests need attention (clients, Connect, Mirror Maker, Streams, etc.)

2023-08-08 Thread Kirk True
Hi Justine, > On Aug 1, 2023, at 4:50 PM, Justine Olshan > wrote: > > Is that right that the first one on the list ( > org.apache.kafka.connect.mirror.integration.MirrorConnectorsIntegrationExactlyOnceTest) > takes > 20 minutes?! That's quite a test. > I wonder if the length corresponds to

Re: Debugging Jenkins test failures

2023-08-08 Thread Kirk True
I created this INFRA Jira just now to see if they can help resolve some of the intermittent Jenkins build issues: https://issues.apache.org/jira/browse/INFRA-24874 > On Aug 1, 2023, at 4:04 PM, Kirk True wrote: > > Hi Divij, > > Thanks for the pointer to Gradle Enterprise! That’s exactly

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2076

2023-08-08 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-960: Support interactive queries (IQv2) for versioned state stores

2023-08-08 Thread Lucas Brutschy
Hi Alieh, thanks a lot for the KIP. IQ with time semantics is going to be another great improvement towards having crystal clear streaming semantics! 1. I agree with Bruno and Matthias, to remove the 'bound' term for the timestamps. It's confusing that we have bounds for both timestamps and

[jira] [Created] (KAFKA-15318) Move Acl publishing outside the QuorumController

2023-08-08 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-15318: Summary: Move Acl publishing outside the QuorumController Key: KAFKA-15318 URL: https://issues.apache.org/jira/browse/KAFKA-15318 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-15317) Fix for async consumer access to committed offsets with multiple consumers

2023-08-08 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15317: -- Summary: Fix for async consumer access to committed offsets with multiple consumers Key: KAFKA-15317 URL: https://issues.apache.org/jira/browse/KAFKA-15317

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2075

2023-08-08 Thread Apache Jenkins Server
See Changes: -- [...truncated 385714 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 192 > SaslOAuthBearerSslEndToEndAuthorizationTest >

[jira] [Resolved] (KAFKA-15126) Change range queries to accept null lower and upper bounds

2023-08-08 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-15126. - Resolution: Fixed [Merged to trunk|https://github.com/apache/kafka/pull/14137] > Change range

[jira] [Created] (KAFKA-15316) CommitRequestManager not calling RequestState callbacks

2023-08-08 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15316: -- Summary: CommitRequestManager not calling RequestState callbacks Key: KAFKA-15316 URL: https://issues.apache.org/jira/browse/KAFKA-15316 Project: Kafka

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

2023-08-08 Thread Kamal Chandraprakash
Hi Christo, Thanks for the KIP! The proposed tiered storage metrics are useful. The unit mentioned in the KIP is the number of records. Each topic can have varying amounts of records in a segment depending on the record size. Do you think having the tier-lag by number of segments (or) size of

[DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

2023-08-08 Thread Christo Lolov
Hello all! I would like to start a discussion for KIP-963: Upload and delete lag metrics in Tiered Storage (https://cwiki.apache.org/confluence/x/sZGzDw). The purpose of this KIP is to introduce a couple of metrics to track lag with respect to remote storage from the point of view of Kafka.

Re: [DISCUSSION] KIP-965: Support disaster recovery between clusters by MirrorMaker

2023-08-08 Thread Ryanne Dolan
hudeqi, I'd call the configuration property something that describes what it does rather than it's intended use-case. Ryanne On Tue, Aug 8, 2023, 4:46 AM hudeqi <16120...@bjtu.edu.cn> wrote: > Hi, all. I want to submit a kip, and hope get some review and good > suggestions. the kip is here:

[jira] [Created] (KAFKA-15315) Use getOrDefault rather than get

2023-08-08 Thread roon (Jira)
roon created KAFKA-15315: Summary: Use getOrDefault rather than get Key: KAFKA-15315 URL: https://issues.apache.org/jira/browse/KAFKA-15315 Project: Kafka Issue Type: Improvement

[QUESTION] about topic dimension quota

2023-08-08 Thread hudeqi
Hi,all. Let me ask a question first, that is, do we plan to support quota in the topic dimension?

[jira] [Created] (KAFKA-15314) No Quota applied if client-id is null or empty

2023-08-08 Thread Jorge Esteban Quilcate Otoya (Jira)
Jorge Esteban Quilcate Otoya created KAFKA-15314: Summary: No Quota applied if client-id is null or empty Key: KAFKA-15314 URL: https://issues.apache.org/jira/browse/KAFKA-15314

Re: [VOTE] KIP-959 Add BooleanConverter to Kafka Connect

2023-08-08 Thread Mickael Maison
Hi, +1 (binding) Thanks for the KIP! On Mon, Aug 7, 2023 at 3:15 PM Hector Geraldino (BLOOMBERG/ 919 3RD A) wrote: > > Hello, > > I still need help from a committer to review/approve this (small) KIP, which > adds a new BooleanConverter to the list of converters in Kafka Connect. > > The KIP

[jira] [Created] (KAFKA-15313) Delete remote log segments partition asynchronously when a partition is deleted.

2023-08-08 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15313: -- Summary: Delete remote log segments partition asynchronously when a partition is deleted. Key: KAFKA-15313 URL: https://issues.apache.org/jira/browse/KAFKA-15313

Re: [VOTE] KIP-714: Client metrics and observability

2023-08-08 Thread Milind Luthra
Hi Andrew, thanks for working on the KIP. +1 (non binding) Thanks, Milind On Fri, Aug 4, 2023 at 2:16 PM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi, > After almost 2 1/2 years in the making, I would like to call a vote for > KIP-714 ( >

[DISCUSSION] KIP-965: Support disaster recovery between clusters by MirrorMaker

2023-08-08 Thread hudeqi
Hi, all. I want to submit a kip, and hope get some review and good suggestions. the kip is here: https://cwiki.apache.org/confluence/x/k5KzDw Motivation: When mirroring ACLs, MirrorMaker downgrades allow ALL ACLs to allow READ. The rationale to is prevent other clients to produce to remote

Re: [DISCUSS] KIP-964: Have visibility when produce requests become "async".

2023-08-08 Thread Sergio Daniel Troiano
Hi everyone! I have a doubt regarding where the metric should go, I need to know where the local append happens in the active segment log. I saw some files which "append" on the segment log but I am a bit confusing which one is the one: core/src/main/scala/kafka/log/LocalLog.scala

Re: [DISCUSS] KIP-714: Client metrics and observability

2023-08-08 Thread Doğuşcan Namal
Thanks for your answers Andrew. I share your pain that it took a while for you to get this KIP approved and you want to reduce the scope of it, will be happy to help you with the implementation :) Could you help me walk through what happens if the target broker is unreachable? Is the client going

Re: [DISCUSS] KIP-943: Add independent "offset.storage.segment.bytes" for connect-distributed.properties

2023-08-08 Thread hudeqi
Sorry for not getting email reminders and ignoring your reply for getting back so late, Yash Mayya, Greg Harris, Sagar. Thank you for your thoughts and suggestions, I learned a lot, I will give my thoughts and answers in a comprehensive way: 1. The default configuration of 50MB is the online