Re: [DISCUSS] KIP-581: add tag "partition" to BrokerTopicMetrics so as to observe the partition metrics on the same broker

Hi Chai-Ping, Thank you for bringing up this proposal. My team also has the need to have per partition metrics on traffic, which would be used by our partition rebalancer, I have a prototype running in test cluster that looks good so far. Some thoughts on bringing this to larger scale: 1.

Re: [DISCUSS] KIP-576 Support dynamic update of more broker configs related to replication

Hey Cheng, the KIP link seems to be wrong, should be: https://cwiki.apache.org/confluence/display/KAFKA/KIP-576%3A+Support+dynamic+update+of+more+broker+configs+related+to+replication On Mon, Mar 23, 2020 at 7:33 PM Cheng Tan wrote: > Hi Everyone, > > KIP-226 added support for dynamic update

Re: [DISCUSS] KIP-580: Exponential Backoff for Kafka Clients

Got it, although I would still like to be aware of the actual backoff I will be using in production, having the app crash seems like an over-reaction. I don't think I have further questions :) On Mon, Mar 23, 2020 at 7:36 PM Sanjana Kaundinya wrote: > Hey Sanjana, > > Hey Boyang, > > If a user

[jira] [Resolved] (KAFKA-8230) Add static membership support in librd consumer client

[ https://issues.apache.org/jira/browse/KAFKA-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-8230. Resolution: Fixed Will be tracked on the librdKafka side, which seems to be done > Add static

Jenkins build is back to normal : kafka-trunk-jdk11 #1280

See

Build failed in Jenkins: kafka-trunk-jdk8 #4360

See Changes: [github] KAFKA-9407: Return an immutable list from poll in SchemaSourceTask -- [...truncated 2.94 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

[jira] [Created] (KAFKA-9752) Consumer rebalance can be stuck after new member timeout with old JoinGroup version

Jason Gustafson created KAFKA-9752: -- Summary: Consumer rebalance can be stuck after new member timeout with old JoinGroup version Key: KAFKA-9752 URL: https://issues.apache.org/jira/browse/KAFKA-9752

Re: [DISCUSS] KIP-580: Exponential Backoff for Kafka Clients

Hey Sanjana, Hey Boyang, If a user provides no config at all then as you mentioned they will be default be able to make use of the exponential back off feature introduced by the KIP. If the backoff.ms is overriden to 2000 ms, the lesser of either the max or the computed back off will be chosen,

[DISCUSS] KIP-576 Support dynamic update of more broker configs related to replication

Hi Everyone, KIP-226 added support for dynamic update of broker configuration. In this KIP, we propose to extend the support to dynamic update of a group of new dynamic broker configs which will benefit the replication process. The proposed support for new dynamic configs looks like

[jira] [Created] (KAFKA-9751) Admin `FindCoordinator` call should go to controller instead of ZK

Boyang Chen created KAFKA-9751: -- Summary: Admin `FindCoordinator` call should go to controller instead of ZK Key: KAFKA-9751 URL: https://issues.apache.org/jira/browse/KAFKA-9751 Project: Kafka

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

Hi Rajini When I configure the Default value for ssl.engine.factory.class as Type Class, it is resulting into lot of test cases failures since in many places - tests and actual classes/scala code it is converting the configuration maps value to value.toString(). I verified that was the issues by

Re: [DISCUSS] KIP-580: Exponential Backoff for Kafka Clients

Hey Sanjana, my understanding with the update is that if a user provides no config at all, a Producer/Consumer/Admin client user would by default enjoying a starting backoff.ms as 100 ms and max.backoff.ms as 1000 ms? If I already override the backoff.ms to 2000 ms for instance, will I be

[jira] [Created] (KAFKA-9750) Flaky test kafka.server.ReplicaManagerTest.testFencedErrorCausedByBecomeLeader

Bob Barrett created KAFKA-9750: -- Summary: Flaky test kafka.server.ReplicaManagerTest.testFencedErrorCausedByBecomeLeader Key: KAFKA-9750 URL: https://issues.apache.org/jira/browse/KAFKA-9750 Project:

Build failed in Jenkins: kafka-trunk-jdk8 #4359

See Changes: [github] KAFKA-9742: Fix broken StandbyTaskEOSIntegrationTest (#8330) -- [...truncated 2.94 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

[jira] [Resolved] (KAFKA-9732) Kafka Foreign-Key Joiner has unexpected default value used when a table is created via a stream+groupByKey+reduce

[ https://issues.apache.org/jira/browse/KAFKA-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Bellemare resolved KAFKA-9732. --- Resolution: Not A Problem Issue was with reporter's usage of the API. > Kafka Foreign-Key

[jira] [Resolved] (KAFKA-9407) Return Immutable List from SchemaSourceTask

[ https://issues.apache.org/jira/browse/KAFKA-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-9407. --- Resolution: Fixed > Return Immutable List from SchemaSourceTask >

[jira] [Resolved] (KAFKA-9742) StandbyTaskEOSIntegrationTest broken

[ https://issues.apache.org/jira/browse/KAFKA-9742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-9742. - Resolution: Fixed > StandbyTaskEOSIntegrationTest broken >

Build failed in Jenkins: kafka-trunk-jdk8 #4358

See Changes: [github] MINOR: Add clarifying "additionally" to streams aggregator docs that is -- [...truncated 2.94 MB...]

Build failed in Jenkins: kafka-trunk-jdk11 #1279

See Changes: [github] MINOR: Add clarifying "additionally" to streams aggregator docs that is -- [...truncated 2.96 MB...]

[jira] [Created] (KAFKA-9749) TransactionMarkerRequestCompletionHandler should treat storage exceptions as retriable

Bob Barrett created KAFKA-9749: -- Summary: TransactionMarkerRequestCompletionHandler should treat storage exceptions as retriable Key: KAFKA-9749 URL: https://issues.apache.org/jira/browse/KAFKA-9749

Build failed in Jenkins: kafka-trunk-jdk11 #1278

See Changes: [github] KAFKA-9651: Fix ArithmeticException (÷ by 0) in DefaultStreamPartitioner -- [...truncated 2.96 MB...]

Build failed in Jenkins: kafka-trunk-jdk8 #4357

See Changes: [github] KAFKA-9651: Fix ArithmeticException (÷ by 0) in DefaultStreamPartitioner -- [...truncated 2.94 MB...]

Re: [DISCUSS] KIP-580: Exponential Backoff for Kafka Clients

+1 (non-binding) > On Mar 19, 2020, at 7:27 PM, Sanjana Kaundinya wrote: > > Ah yes that makes sense. I’ll update the KIP to reflect this. > > Thanks, > Sanjana > > On Thu, Mar 19, 2020 at 5:48 PM Guozhang Wang wrote: > >> Following the formula you have in the KIP, if it is simply: >> >>

[jira] [Resolved] (KAFKA-9736) Use internal consumer config to fail for unsupported protocol

[ https://issues.apache.org/jira/browse/KAFKA-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-9736. Resolution: Duplicate > Use internal consumer config to fail for unsupported protocol >

[jira] [Created] (KAFKA-9748) Extend EOS integration test for EOS-beta

Matthias J. Sax created KAFKA-9748: -- Summary: Extend EOS integration test for EOS-beta Key: KAFKA-9748 URL: https://issues.apache.org/jira/browse/KAFKA-9748 Project: Kafka Issue Type:

[VOTE] KIP-580: Exponential Backoff for Kafka Clients

Hi Everyone, I’d like to start a vote for KIP-580: Exponential Backoff for Kafka Clients. The link to the KIP can be found here:  https://cwiki.apache.org/confluence/display/KAFKA/KIP-580%3A+Exponential+Backoff+for+Kafka+Clients. Thanks, Sanjana

[jira] [Created] (KAFKA-9747) No tasks created for a connector

Vit Koma created KAFKA-9747: --- Summary: No tasks created for a connector Key: KAFKA-9747 URL: https://issues.apache.org/jira/browse/KAFKA-9747 Project: Kafka Issue Type: Bug Components:

Jenkins build is back to normal : kafka-2.4-jdk8 #174

See

[jira] [Created] (KAFKA-9746) MM2 produces messages in the wrong cluster

Marcel Renders created KAFKA-9746: - Summary: MM2 produces messages in the wrong cluster Key: KAFKA-9746 URL: https://issues.apache.org/jira/browse/KAFKA-9746 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-9745) Attribute is missed in kafka mirror maker metrics

Nikita Krasnov created KAFKA-9745: - Summary: Attribute is missed in kafka mirror maker metrics Key: KAFKA-9745 URL: https://issues.apache.org/jira/browse/KAFKA-9745 Project: Kafka Issue

[jira] [Created] (KAFKA-9744) SchemaProjector fails to handle backwards-compatible schema change

Jurgis Pods created KAFKA-9744: -- Summary: SchemaProjector fails to handle backwards-compatible schema change Key: KAFKA-9744 URL: https://issues.apache.org/jira/browse/KAFKA-9744 Project: Kafka

Build failed in Jenkins: kafka-2.5-jdk8 #73

See Changes: [konstantine] KAFKA-9563: Fix Kafka Connect documentation around consumer and producer -- [...truncated 5.88 MB...]

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

still working on the pull request. hopefully will be done soon. On Wed, Mar 11, 2020 at 11:48 AM Maulin Vasavada wrote: > Thanks Rajini. Sounds good. I'll make changes and update this thread. > > On Wed, Mar 11, 2020 at 6:41 AM Rajini Sivaram > wrote: > >> Hi Maulin, >> >> I have reviewed the