Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2750

See Changes: -- [...truncated 462807 lines...] [2024-03-26T04:26:11.024Z] [2024-03-26T04:26:11.024Z] Gradle Test Run :streams:test > Gradle Test Executor 25 > TasksTest

Re: [Confluence] Request for an account

Hi Johnny, Currently, there is an infra issue about this: https://issues.apache.org/jira/browse/INFRA-25451 , and unfortunately it's not fixed, yet. I think alternatively, maybe you could put your proposal in a shared google doc for discussion. (without comment enabled since we want to keep all

[jira] [Resolved] (KAFKA-16409) kafka-delete-records / DeleteRecordsCommand should use standard exception handling

[ https://issues.apache.org/jira/browse/KAFKA-16409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16409. --- Fix Version/s: 3.8.0 Resolution: Fixed > kafka-delete-records / DeleteRecordsCommand should

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

Hi Jun, I apologize for typos. I thought I got rid of all the non protocol versions. It is protocol version as per my previous email. I will fix the KIP. The group coordinator version is used to upgrade to the new group coordinator protocol. (KIP-848) I don't have all the context there. I would

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

Hi, Justine, Thanks for the updated KIP. A few more comments. 10. Could we describe what RPCs group.coordinator.version controls? 12. --metadata METADATA is not removed from kafka-features. Do we have a justification for this? If so, should we add that to kafka-storage to be consistent? 14.

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

I've updated the KIP to include this CLI. For now, I've moved the new api to the server as a rejected alternative. It seems like we can keep the mapping in the tool. Given that we also need to do the same validation for using multiple --feature flags (the request will look the same to the

Re: [DISCUSS] KIP-1024: Make the restore behavior of GlobalKTables with custom processors configureable

Hello Folk! Glad to see improvements to the GlobalKTables in discussion! I think they deserve more love :) Scope creep alert (which I'm generally against and certainly still support this KIP without but I want to see if there's an elegant way to address both problems). The KIP mentions that "Now

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

Hi Jose, Sorry for the typos. I think you figured out what I meant. I can make a new API. There is a risk of creating a ton of very similar APIs though. Even the ApiVersions api is confusing with its supported and finalized features fields. I wonder if there is a middle ground here. I can have

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

Hi Justine, Thanks for the update. See my comments below. On Mon, Mar 25, 2024 at 2:51 PM Justine Olshan wrote: > I've updated the KIP with the changes I mentioned earlier. I have not yet > removed the --feature-version flag from the upgrade tool. What's the "--feature-version" flag? This is

Re: [DISCUSS] KIP-1026: Handling producer snapshot when upgrading from < v2.8.0 for Tiered Storage

Hi Arpit, I think creating empty producer snapshots would be backwards-compatible for the tiered storage plugins, but I'm not aware of what the other compatibility/design concerns might be. Maybe you or another reviewer can answer these questions: 1. Does an empty producer snapshot have the same

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

Hey all, I've updated the KIP with the changes I mentioned earlier. I have not yet removed the --feature-version flag from the upgrade tool. Please take a look at the API to get the versions for a given metadata version. Right now I'm using ApiVersions request and specifying a metadata version.

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

Hi, Jose, Thanks for the reply. 54. Yes, we could include SecurityProtocol in DescribeQuorumResponse. Then, we could include it in the output of kafka-metadata-quorum --describe. 55.1 Could number-of-observers and pending-voter-change be reported by all brokers and controllers? I thought only

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.7 #119

See Changes: -- [...truncated 447336 lines...] [2024-03-25T19:35:34.982Z] [2024-03-25T19:35:34.982Z] Gradle Test Run :connect:runtime:test > Gradle Test Executor 43 >

Re: [VOTE] KIP-1025: Optionally URL-encode clientID and clientSecret in authorization header

Hi Doğuşcan, Thanks for your vote! Currently, the usage of TLS depends on the protocol used by the authorization server which is configured through the "sasl.oauthbearer.token.endpoint.url" option. So, if the URL address uses simple http (not https) then secrets will be transmitted in plaintext.

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

Hi Jun, See my comments below. On Fri, Mar 22, 2024 at 1:30 PM Jun Rao wrote: > 54. Admin.addMetadataVoter: It seems that Endpoint shouldn't include > securityProtocol since it's not in DescribeQuorumResponse. Yeah. I noticed that when I made the Admin changes. We either use a different type

[VOTE] KIP-1024: Make the restore behavior of GlobalKTables with custom processors configureable

Hello everybody, I think we have had some pretty good discussion on this kip and it seems that we are close if not yet settled on the final version. So I would like to open up the voting for KIP-1024: https://cwiki.apache.org/confluence/x/E4t3EQ Thanks everyone! Walker

Re: [DISCUSS] KIP-1024: Make the restore behavior of GlobalKTables with custom processors configureable

Hey Bruno, 1) I'm actually not sure why that is in there. It certainly doesn't match the convention. Best to remove it and match the other methods. 2) Yeah, I thought about it but I'm not convinced it is a necessary restriction. It might be useful for the already defined processors but then they

[jira] [Resolved] (KAFKA-15950) Serialize broker heartbeat requests

[ https://issues.apache.org/jira/browse/KAFKA-15950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15950. - Fix Version/s: 3.8.0 Resolution: Fixed merged the PR to trunk. > Serialize broker heartbeat

[jira] [Created] (KAFKA-16422) Flaky test org.apache.kafka.controller.QuorumControllerMetricsIntegrationTest."testFailingOverIncrementsNewActiveControllerCount(boolean).true"

Igor Soarez created KAFKA-16422: --- Summary: Flaky test org.apache.kafka.controller.QuorumControllerMetricsIntegrationTest."testFailingOverIncrementsNewActiveControllerCount(boolean).true" Key: KAFKA-16422 URL:

[jira] [Resolved] (KAFKA-14246) Update threading model for Consumer

[ https://issues.apache.org/jira/browse/KAFKA-14246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-14246. --- Resolution: Fixed > Update threading model for Consumer > --- > >

[jira] [Created] (KAFKA-16421) Refactor CommandDefaultOptions subclasses to throw exceptions instead of calling exit.

Greg Harris created KAFKA-16421: --- Summary: Refactor CommandDefaultOptions subclasses to throw exceptions instead of calling exit. Key: KAFKA-16421 URL: https://issues.apache.org/jira/browse/KAFKA-16421

[jira] [Created] (KAFKA-16420) Replace utils.Exit with a thread-safe alternative

Greg Harris created KAFKA-16420: --- Summary: Replace utils.Exit with a thread-safe alternative Key: KAFKA-16420 URL: https://issues.apache.org/jira/browse/KAFKA-16420 Project: Kafka Issue Type:

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #164

See Changes: -- [...truncated 373413 lines...] [2024-03-25T15:05:09.623Z] Gradle Test Run :core:test > Gradle Test Executor 92 > ZkMigrationClientTest > testEmptyWrite()

[jira] [Created] (KAFKA-16419) Abstract validateMessagesAndAssignOffsetsCompressed of LogValidator to simply the process

Johnny Hsu created KAFKA-16419: -- Summary: Abstract validateMessagesAndAssignOffsetsCompressed of LogValidator to simply the process Key: KAFKA-16419 URL: https://issues.apache.org/jira/browse/KAFKA-16419

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2748

See

Re: [VOTE] 3.6.2 RC1

Hi, Thanks for letting me know. Pls let me know after merging the PR. I will generate RC2. Thanks On Sat, Mar 23, 2024 at 1:58 AM Colin McCabe wrote: > Sorry but I have to vote -1 > > I tried verifying that the migration quotas bug described in >

[jira] [Created] (KAFKA-16418) Split long-running admin client integration tests

Lianet Magrans created KAFKA-16418: -- Summary: Split long-running admin client integration tests Key: KAFKA-16418 URL: https://issues.apache.org/jira/browse/KAFKA-16418 Project: Kafka Issue

Re: KRaft Observer Nodes

Hi Sanaa, yes it's enough NOT having the "controller" role to be just an "observer". As soon as your node has "controller" role configured (in addition to "broker" or alone) it acts as a "voter" and then being a leader or "follower" based on the election result. Thanks Paolo On Mon, 25 Mar 2024,

[jira] [Resolved] (KAFKA-16375) Fix logic for discarding reconciliation if member rejoined

[ https://issues.apache.org/jira/browse/KAFKA-16375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-16375. Resolution: Fixed > Fix logic for discarding reconciliation if member rejoined >

Re: KRaft Observer Nodes

Hi Paolo, If I'm understanding correctly, a kafka broker (aside from the controller quorum) can be the observer? Do we need to set the process role to anything in this case to indicate that we want a broker to be an observer? On Sun, Mar 24, 2024 at 3:01 PM Paolo Patierno wrote: > Hi Sanaa, >

[Confluence] Request for an account

Hi all, I have sent a email to infrastruct...@apache.org for registering an account of Confluence, I am contributing to Kafka and would like to update some wiki. May I know if anyone can help with this? Thanks in advance! Best, Johnny

[jira] [Created] (KAFKA-16417) When initializeResources throws an exception in TopicBasedRemoteLogMetadataManager.scala, initializationFailed needs to be set to true

zhaobo created KAFKA-16417: -- Summary: When initializeResources throws an exception in TopicBasedRemoteLogMetadataManager.scala, initializationFailed needs to be set to true Key: KAFKA-16417 URL:

Re: Request to join

Hi, Please send an email to dev-subscr...@kafka.apache.org to subscribe to the group. Thanks. Luke On Mon, Mar 25, 2024 at 4:19 PM durairaj t wrote: > >

Re: [PR] Update Bruno's picture [kafka-site]

C0urante commented on PR #592: URL: https://github.com/apache/kafka-site/pull/592#issuecomment-2017751127 I was wondering who that bearded gentleman was at Kafka Summit! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [DISCUSS] KIP-932: Queues for Kafka

Hi Justine, Thanks for your questions. There are several limits in this KIP. With consumer groups, we see problems where there are huge numbers of consumer groups, and we also see problems when there are huge number of members in a consumer group. There’s a limit on the number of members in

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2747

See Changes: -- [...truncated 469275 lines...] [2024-03-25T09:45:39.013Z] [2024-03-25T09:45:39.013Z] Gradle Test Run :core:test > Gradle Test Executor 96 >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #117

See

[jira] [Resolved] (KAFKA-15882) Scheduled nightly github actions workflow for CVE reports on published docker images

[ https://issues.apache.org/jira/browse/KAFKA-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15882. Fix Version/s: 3.8.0 Resolution: Fixed > Scheduled nightly github actions workflow

[jira] [Resolved] (KAFKA-16374) High watermark updates should have a higher priority

[ https://issues.apache.org/jira/browse/KAFKA-16374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16374. - Fix Version/s: 3.8.0 Resolution: Fixed > High watermark updates should have a higher

Request to join

Re: [DISCUSS] KIP-950: Tiered Storage Disablement

Hi Christo and Luke, I think the KRaft section of the KIP requires slight improvement. The metadata propagation in KRaft is handled by the RAFT layer instead of sending Controller -> Broker RPCs. In fact, KIP-631 deprecated these RPCs

[jira] [Created] (KAFKA-16416) Use NetworkClientTest to replace RequestResponseTest to be the example of log4j output

Chia-Ping Tsai created KAFKA-16416: -- Summary: Use NetworkClientTest to replace RequestResponseTest to be the example of log4j output Key: KAFKA-16416 URL: https://issues.apache.org/jira/browse/KAFKA-16416