Re: [DISCUSS] KIP-770: Replace "buffered.records.per.partition" with "input.buffer.max.bytes"

2021-08-27 Thread Sophie Blee-Goldman
1) I agree that we should just distribute the bytes evenly, at least for now. It's simpler to understand and we can always change it later, plus it makes sense to keep this aligned with how the cache works today 2) +1 to being conservative in the generous sense, it's just not something we can

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #436

2021-08-27 Thread Apache Jenkins Server
See Changes: -- [...truncated 489794 lines...] [2021-08-28T05:02:01.178Z] > Task :raft:testClasses UP-TO-DATE [2021-08-28T05:02:01.178Z] > Task :connect:json:testJar

[jira] [Resolved] (KAFKA-13128) Flaky Test StoreQueryIntegrationTest.shouldQueryStoresAfterAddingAndRemovingStreamThread

2021-08-27 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-13128. Resolution: Fixed > Flaky Test >

[jira] [Resolved] (KAFKA-12963) Improve error message for Class cast exception

2021-08-27 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-12963. Fix Version/s: 3.1.0 Resolution: Fixed > Improve error message for

[jira] [Created] (KAFKA-13246) StoreQueryIntegrationTest#shouldQueryStoresAfterAddingAndRemovingStreamThread does not gate on stream state well

2021-08-27 Thread Walker Carlson (Jira)
Walker Carlson created KAFKA-13246: -- Summary: StoreQueryIntegrationTest#shouldQueryStoresAfterAddingAndRemovingStreamThread does not gate on stream state well Key: KAFKA-13246 URL:

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 2.8 #73

2021-08-27 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #435

2021-08-27 Thread Apache Jenkins Server
See Changes: -- [...truncated 489690 lines...] [2021-08-27T21:49:16.134Z] > Task :raft:testClasses UP-TO-DATE [2021-08-27T21:49:16.134Z] > Task :connect:json:testJar

Re: [DISCUSS] KIP-771: KRaft broker should not expose controller metrics

2021-08-27 Thread Ron Dagostino
Thanks for the KIP, Ryan. I agree this makes sense. It also reflects the state of affairs right now: KRaft nodes that do not have the controller role currently do not expose these metrics. Assuming this KIP ends up being accepted, we would then close KAFKA-13140 and its associated PR

[DISCUSS] KIP-771: KRaft broker should not expose controller metrics

2021-08-27 Thread Ryan Dielhenn
Hello kafka devs, I would like to start a discussion on a KIP I have created to change how controller metrics are exposed for KRaft brokers. Here is the KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP+771%3A+KRaft+brokers+should+not+expose+controller+metrics Regards, Ryan Dielhenn

[jira] [Created] (KAFKA-13245) KIP 771: Change behavior of how controller metrics are exposed when using KRaft.

2021-08-27 Thread Ryan Dielhenn (Jira)
Ryan Dielhenn created KAFKA-13245: - Summary: KIP 771: Change behavior of how controller metrics are exposed when using KRaft. Key: KAFKA-13245 URL: https://issues.apache.org/jira/browse/KAFKA-13245

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 2.8 #72

2021-08-27 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #434

2021-08-27 Thread Apache Jenkins Server
See Changes: -- [...truncated 43 lines...] [2021-08-27T19:42:44.087Z] [2021-08-27T19:42:44.087Z] ControllerIntegrationTest > testTopicIdsAreAdded() STARTED

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #433

2021-08-27 Thread Apache Jenkins Server
See Changes: -- [...truncated 489922 lines...] [2021-08-27T17:31:30.746Z] ControllerIntegrationTest > testControllerMoveIncrementsControllerEpoch() STARTED

[jira] [Created] (KAFKA-13244) Control Which Brokers Host Partitions of Newly Created Topics

2021-08-27 Thread Michael Jaschob (Jira)
Michael Jaschob created KAFKA-13244: --- Summary: Control Which Brokers Host Partitions of Newly Created Topics Key: KAFKA-13244 URL: https://issues.apache.org/jira/browse/KAFKA-13244 Project: Kafka

[jira] [Created] (KAFKA-13243) Differentiate metric latency measured in millis and nanos

2021-08-27 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-13243: - Summary: Differentiate metric latency measured in millis and nanos Key: KAFKA-13243 URL: https://issues.apache.org/jira/browse/KAFKA-13243 Project: Kafka

[jira] [Resolved] (KAFKA-13079) Forgotten Topics in Fetch Requests may incorrectly use topic IDs

2021-08-27 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-13079. - Fix Version/s: 3.1.0 Reviewer: David Jacot Resolution: Fixed > Forgotten Topics

[jira] [Created] (KAFKA-13242) KRaft Controller doesn't handle UpdateFeaturesRequest

2021-08-27 Thread dengziming (Jira)
dengziming created KAFKA-13242: -- Summary: KRaft Controller doesn't handle UpdateFeaturesRequest Key: KAFKA-13242 URL: https://issues.apache.org/jira/browse/KAFKA-13242 Project: Kafka Issue

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #432

2021-08-27 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #431

2021-08-27 Thread Apache Jenkins Server
See Changes: -- [...truncated 488910 lines...] [2021-08-27T10:27:37.072Z] ControllerIntegrationTest > testIdempotentAlterIsr() PASSED [2021-08-27T10:27:37.072Z]

[jira] [Created] (KAFKA-13241) Name resolution should be disabled during SASL authentication

2021-08-27 Thread AndrewDi (Jira)
AndrewDi created KAFKA-13241: Summary: Name resolution should be disabled during SASL authentication Key: KAFKA-13241 URL: https://issues.apache.org/jira/browse/KAFKA-13241 Project: Kafka Issue

[jira] [Created] (KAFKA-13240) HTTP TRACE should be disabled in Connect

2021-08-27 Thread Viktor Somogyi-Vass (Jira)
Viktor Somogyi-Vass created KAFKA-13240: --- Summary: HTTP TRACE should be disabled in Connect Key: KAFKA-13240 URL: https://issues.apache.org/jira/browse/KAFKA-13240 Project: Kafka Issue

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.0 #121

2021-08-27 Thread Apache Jenkins Server
See

Jenkins build is unstable: Kafka » Kafka Branch Builder » 2.8 #71

2021-08-27 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #430

2021-08-27 Thread Apache Jenkins Server
See Changes: -- [...truncated 417188 lines...] [2021-08-27T08:23:30.703Z] [2021-08-27T08:23:30.703Z] TopicCommandIntegrationTest > testListTopicsWithIncludeList() PASSED

[jira] [Created] (KAFKA-13239) Use RocksDB.ingestExternalFile for restoration

2021-08-27 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-13239: - Summary: Use RocksDB.ingestExternalFile for restoration Key: KAFKA-13239 URL: https://issues.apache.org/jira/browse/KAFKA-13239 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-13238) Add ActiveBrokerCount and FencedBrokerCount metrics to the KRaft controller (KIP-748)

2021-08-27 Thread David Jacot (Jira)
David Jacot created KAFKA-13238: --- Summary: Add ActiveBrokerCount and FencedBrokerCount metrics to the KRaft controller (KIP-748) Key: KAFKA-13238 URL: https://issues.apache.org/jira/browse/KAFKA-13238

[jira] [Created] (KAFKA-13237) Add ActiveBrokerCount and FencedBrokerCount metrics to the ZK controller (KIP-748)

2021-08-27 Thread David Jacot (Jira)
David Jacot created KAFKA-13237: --- Summary: Add ActiveBrokerCount and FencedBrokerCount metrics to the ZK controller (KIP-748) Key: KAFKA-13237 URL: https://issues.apache.org/jira/browse/KAFKA-13237

[jira] [Resolved] (KAFKA-13231) `TransactionalMessageCopier.start_node` should wait until the process if fully started

2021-08-27 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-13231. - Fix Version/s: 3.0.1 2.8.1 3.1.0 Reviewer: Jason