Re: Security for Kafka

Hey Walchester, There's a confluent community slack Workspace having a #security channel where you can post your question. Also, have you filed a bug in AK JIRA which can also help you get the traction of some of the community members who have expertise in this area. Thanks! Sagar. On Thu, Oct 1

[jira] [Created] (KAFKA-15644) Fix CVE-2023-4586 in netty:handler

Atul Sharma created KAFKA-15644: --- Summary: Fix CVE-2023-4586 in netty:handler Key: KAFKA-15644 URL: https://issues.apache.org/jira/browse/KAFKA-15644 Project: Kafka Issue Type: Bug

Re: Security for Kafka

Hello. Is there something like a community page for Kafka where I can reach out to the community where hopefully someone with a similar setup can help? Thanks, Chester On Thu, Oct 12, 2023 at 10:48 AM Walchester Gaw wrote: > Hello. > > I am trying to implement Quorum TLS by following the inst

[jira] [Created] (KAFKA-15643) Improve unloading logging

David Jacot created KAFKA-15643: --- Summary: Improve unloading logging Key: KAFKA-15643 URL: https://issues.apache.org/jira/browse/KAFKA-15643 Project: Kafka Issue Type: Sub-task Repo

[jira] [Created] (KAFKA-15642) Ensure offset fetcher behaves correctly when the request is Timeout

Philip Nee created KAFKA-15642: -- Summary: Ensure offset fetcher behaves correctly when the request is Timeout Key: KAFKA-15642 URL: https://issues.apache.org/jira/browse/KAFKA-15642 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #93

See Changes: -- [...truncated 307037 lines...] > Task :connect:json:generateMetadataFileForMavenJavaPublication > Task :connect:json:testClasses UP-TO-DATE > Task :connect:json

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2304

See Changes: -- [...truncated 316163 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultStateUpdaterTest > shouldDrainRestoredActiveTasks() PASSED

[jira] [Resolved] (KAFKA-15620) Duplicate remote log DELETE_SEGMENT metadata is generated when there are multiple leader epochs in the segment

[ https://issues.apache.org/jira/browse/KAFKA-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15620. --- Fix Version/s: 3.7.0 Resolution: Duplicate > Duplicate remote log DELETE_SEGMENT metadata is

[jira] [Created] (KAFKA-15641) Investigate CompletedFetch handleInitializeErrors for accuracy

Kirk True created KAFKA-15641: - Summary: Investigate CompletedFetch handleInitializeErrors for accuracy Key: KAFKA-15641 URL: https://issues.apache.org/jira/browse/KAFKA-15641 Project: Kafka Iss

Re: [PR] MINOR: add KIP-941 to Kafka Streams upgrade docs [kafka-site]

mjsax merged PR #563: URL: https://github.com/apache/kafka-site/pull/563 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.or

[PR] MINOR: add KIP-941 to Kafka Streams upgrade docs [kafka-site]

mjsax opened a new pull request, #563: URL: https://github.com/apache/kafka-site/pull/563 Porting https://github.com/apache/kafka/pull/14577 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [DISCUSS] KIP-988 Streams Standby Task Update Listener

Thanks for the KIP. Seems I am almost late to the party. About naming (fun, fun, fun): I like the current proposal overall, except `onBachLoaded`, but would prefer `onBatchUpdated`. It better aligns to everything else: - it's an update-listener, not loaded-listener - `StateRestoreListener`

[jira] [Created] (KAFKA-15640) Refactor CompletedFetch initialization

Kirk True created KAFKA-15640: - Summary: Refactor CompletedFetch initialization Key: KAFKA-15640 URL: https://issues.apache.org/jira/browse/KAFKA-15640 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-15639) Investigate ConsumerNetworkThread's testResetPositionsProcessFailureIsIgnored

Kirk True created KAFKA-15639: - Summary: Investigate ConsumerNetworkThread's testResetPositionsProcessFailureIsIgnored Key: KAFKA-15639 URL: https://issues.apache.org/jira/browse/KAFKA-15639 Project: Kafk

[jira] [Created] (KAFKA-15638) Investigate ConsumerNetworkThread's testPollResultTimer

Kirk True created KAFKA-15638: - Summary: Investigate ConsumerNetworkThread's testPollResultTimer Key: KAFKA-15638 URL: https://issues.apache.org/jira/browse/KAFKA-15638 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-15637) CLONE - Investigate FetcherTest's/FetchRequestManager's testFetchCompletedBeforeHandlerAdded

Kirk True created KAFKA-15637: - Summary: CLONE - Investigate FetcherTest's/FetchRequestManager's testFetchCompletedBeforeHandlerAdded Key: KAFKA-15637 URL: https://issues.apache.org/jira/browse/KAFKA-15637

[jira] [Created] (KAFKA-15636) Investigate FetcherTest's/FetchRequestManager's testFetchResponseMetrics

Kirk True created KAFKA-15636: - Summary: Investigate FetcherTest's/FetchRequestManager's testFetchResponseMetrics Key: KAFKA-15636 URL: https://issues.apache.org/jira/browse/KAFKA-15636 Project: Kafka

[jira] [Created] (KAFKA-15635) Investigate FetcherTest's/FetchRequestManager's testFetcherLeadMetric

Kirk True created KAFKA-15635: - Summary: Investigate FetcherTest's/FetchRequestManager's testFetcherLeadMetric Key: KAFKA-15635 URL: https://issues.apache.org/jira/browse/KAFKA-15635 Project: Kafka

[jira] [Created] (KAFKA-15634) Investigate FetcherTest's/FetchRequestManager's testQuotaMetrics

Kirk True created KAFKA-15634: - Summary: Investigate FetcherTest's/FetchRequestManager's testQuotaMetrics Key: KAFKA-15634 URL: https://issues.apache.org/jira/browse/KAFKA-15634 Project: Kafka I

[jira] [Created] (KAFKA-15633) Bug: Generated Persistent Directory IDs are overwritten on startup.

Proven Provenzano created KAFKA-15633: - Summary: Bug: Generated Persistent Directory IDs are overwritten on startup. Key: KAFKA-15633 URL: https://issues.apache.org/jira/browse/KAFKA-15633 Project

Re: [DISCUSS] KIP-987: Connect Static Assignments

Hey Sagar, Thanks for the questions. I hope you find the answers satisfying: 1. This is detailed in the KIP two sentences earlier: "If the connect.protocol is set to static, each worker will send it's static.connectors and static.tasks to the coordinator during rebalances." 2. If you have a stat

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2303

See Changes: -- [...truncated 316860 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultTaskExecutorTest > shouldRespectProcessingDisabledByTaskE

[jira] [Created] (KAFKA-15632) Drop the invalid remote log metadata events

Kamal Chandraprakash created KAFKA-15632: Summary: Drop the invalid remote log metadata events Key: KAFKA-15632 URL: https://issues.apache.org/jira/browse/KAFKA-15632 Project: Kafka

UncleanLeaderElectionsPerSec metric and Raft

Development, with Raft controllers, is the unclean leader election / sec metric supose to be available? kafka.controller:type=ControllerStats,name=UncleanLeaderElectionsPerSec Nothing in documentation indicates that it isn’t as well as in code navigation nothing indicates to me that it wouldn’t

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

Hi Federico, Thanks for the feedback and apologies for the delay. I've included a section in the KIP on the release process. I would greatly appreciate your insights after reviewing it. Regards, Krishna On Fri, Sep 8, 2023 at 3:08 PM Federico Valeri wrote: > Hi Krishna, thanks for opening this

[jira] [Created] (KAFKA-15631) Do not send new heartbeat request while another one in-flight

Lianet Magrans created KAFKA-15631: -- Summary: Do not send new heartbeat request while another one in-flight Key: KAFKA-15631 URL: https://issues.apache.org/jira/browse/KAFKA-15631 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2302

See Changes: -- [...truncated 315602 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultStateUpdaterTest > shouldRemoveTasksFromAndClearInputQueueO

[jira] [Resolved] (KAFKA-15554) Update client state machine to align with protocol sending one assignment at a time

[ https://issues.apache.org/jira/browse/KAFKA-15554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15554. - Resolution: Fixed > Update client state machine to align with protocol sending one assignment at

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

Hi Ismael, Thanks for the feedback. I noticed that the graalvm-reachability-metadata project now includes > kafka-clients[1]. Worth checking if the metadata over there matches what > we've observed for our own attempt. > After reviewing the graalvm-reachability-metadata, I observed that they have

[jira] [Created] (KAFKA-15630) Improve documentation of offset.lag.max

Mickael Maison created KAFKA-15630: -- Summary: Improve documentation of offset.lag.max Key: KAFKA-15630 URL: https://issues.apache.org/jira/browse/KAFKA-15630 Project: Kafka Issue Type: Impro

Re: [DISCUSS] KIP-989: RocksDB Iterator Metrics

Hi Nick, I did not think in detail about how to implement it, just about what metrics would be nice to have. You are right, we'd have to register/deregister the iterators during open/close. This would be more complicated to implement than the other metrics, but I do not see a fundamental problem w

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

Hi Lucas, TaskCorruptedException is how Streams signals that the Task state needs to be wiped, so we can't retain that exception without also wiping state on timeouts. Regards, Nick On Wed, 18 Oct 2023 at 14:48, Lucas Brutschy wrote: > Hi Nick, > > I think indeed the better behavior would be t

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

Hi Nick, I think indeed the better behavior would be to retry commitTransaction until we risk running out of time to meet `max.poll.interval.ms`. However, if it's handled as a `TaskCorruptedException` at the moment, I would do the same in this KIP, and leave exception handling improvements to fut

Re: [DISCUSS] KIP-987: Connect Static Assignments

Hi Greg, Thanks for the KIP. I have a few questions/comments: 1) You mentioned that during a rebalance if all the members of the cluster support the static protocol, then it would use the steps outlined in the Proposed Section to do the assignments. In those steps, the leader identifies the stati

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2301

See Changes: -- [...truncated 314742 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultStateUpdaterTest > shouldPauseStandbyTask() STARTED Gradle

Re: [PR] MINOR: add docs for tiered storage quick start [kafka-site]

showuon merged PR #562: URL: https://github.com/apache/kafka-site/pull/562 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2300

See