[jira] [Resolved] (KAFKA-8827) kafka brokers intermittent traffic
[ https://issues.apache.org/jira/browse/KAFKA-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frid resolved KAFKA-8827. - Resolution: Fixed > kafka brokers intermittent traffic > -- > > Key: KAFKA-8827 > URL: https://issues.apache.org/jira/browse/KAFKA-8827 > Project: Kafka > Issue Type: Bug >Affects Versions: 0.10.2.0 >Reporter: frid >Priority: Critical > > i have kafka cluster with version 0.10.2, 3 brokers an 3 zookeeper i try to > generete 25 mb/sec to my topic wich have 400 partitions, the cluster behavior > is very strange > the followers stop receiving messages each 5 min but the leader still receive > messages, which generates lag so underreplicated partitions and the cluster > become unstable. cpu reache 80% in 2 brokers but in the first still in 20 % > Could someone explain this phenomenon? thanks in advance find here some > metric > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KAFKA-8827) kafka brokers intermittent traffic
[ https://issues.apache.org/jira/browse/KAFKA-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frid updated KAFKA-8827: Description: i have kafka cluster with version 0.10.2, 3 brokers an 3 zookeeper i try to generete 25 mb/sec to my topic wich have 400 partitions, the cluster behavior is very strange the followers stop receiving messages each 5 min but the leader still receive messages, which generates lag so underreplicated partitions and the cluster become unstable. cpu reache 80% in 2 brokers but in the first still in 20 % Could someone explain this phenomenon? thanks in advance find here some metric was: i have kafka cluster with version 0.10.2, 3 brokers an 3 zookeeper i try to generete 25 mb/sec to my topic wich have 400 partitions, the cluster behavior is very strange the followers stop receiving messages each 5 min but the leader still receive messages, which generates lag so underreplicated partitions and the cluster become unstable. cpu reache 80% in 2 brokers but in the first still in 20 % Could someone explain this phenomenon? thanks in advance find here some metric !image-2019-08-23-15-35-17-558.png! > kafka brokers intermittent traffic > -- > > Key: KAFKA-8827 > URL: https://issues.apache.org/jira/browse/KAFKA-8827 > Project: Kafka > Issue Type: Bug >Affects Versions: 0.10.2.0 >Reporter: frid >Priority: Critical > > i have kafka cluster with version 0.10.2, 3 brokers an 3 zookeeper i try to > generete 25 mb/sec to my topic wich have 400 partitions, the cluster behavior > is very strange > the followers stop receiving messages each 5 min but the leader still receive > messages, which generates lag so underreplicated partitions and the cluster > become unstable. cpu reache 80% in 2 brokers but in the first still in 20 % > Could someone explain this phenomenon? thanks in advance find here some > metric > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KAFKA-8827) kafka brokers intermittent traffic
[ https://issues.apache.org/jira/browse/KAFKA-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frid updated KAFKA-8827: Attachment: (was: image-2019-08-23-15-35-17-558.png) > kafka brokers intermittent traffic > -- > > Key: KAFKA-8827 > URL: https://issues.apache.org/jira/browse/KAFKA-8827 > Project: Kafka > Issue Type: Bug >Affects Versions: 0.10.2.0 >Reporter: frid >Priority: Critical > > i have kafka cluster with version 0.10.2, 3 brokers an 3 zookeeper i try to > generete 25 mb/sec to my topic wich have 400 partitions, the cluster behavior > is very strange > the followers stop receiving messages each 5 min but the leader still receive > messages, which generates lag so underreplicated partitions and the cluster > become unstable. cpu reache 80% in 2 brokers but in the first still in 20 % > Could someone explain this phenomenon? thanks in advance find here some > metric > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KAFKA-9011) Add KStream#flatTransform and KStream#flatTransformValues to Scala API
[ https://issues.apache.org/jira/browse/KAFKA-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972568#comment-16972568 ] frid commented on KAFKA-9011: - bill Bejeck could take a look here please we are blocked https://stackoverflow.com/questions/58815493/bug-cannot-change-retention-bytes-of-changelog-kafka-topic > Add KStream#flatTransform and KStream#flatTransformValues to Scala API > -- > > Key: KAFKA-9011 > URL: https://issues.apache.org/jira/browse/KAFKA-9011 > Project: Kafka > Issue Type: Improvement > Components: streams >Affects Versions: 2.3.0 >Reporter: Alex Kokachev >Assignee: Alex Kokachev >Priority: Major > Labels: scala, streams > Fix For: 2.5.0 > > > Part of KIP-313: > [https://cwiki.apache.org/confluence/display/KAFKA/KIP-313%3A+Add+KStream.flatTransform+and+KStream.flatTransformValues] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KAFKA-8827) kafka brokers intermittent traffic
[ https://issues.apache.org/jira/browse/KAFKA-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frid updated KAFKA-8827: Description: i have kafka cluster with version 0.10.2, 3 brokers an 3 zookeeper i try to generete 25 mb/sec to my topic wich have 400 partitions, the cluster behavior is very strange the followers stop receiving messages each 5 min but the leader still receive messages, which generates lag so underreplicated partitions and the cluster become unstable. cpu reache 80% in 2 brokers but in the first still in 20 % Could someone explain this phenomenon? thanks in advance find here some metric !image-2019-08-23-15-35-17-558.png! was: i have kafka cluster with version 0.10.2, 3brokers an 3 zookeeper i try to generete 25 mb/sec to my topic wich have 400 partitions, the cluster behavior is very strange the followers stop receiving messages each 5 min but the leader still receive messages, which generates lag so underreplicated partitions and the cluster become unstable. cpu reache 80% in followers brokers but in leadear still in 20 % Could someone explain this phenomenon? thanks in advance find here some metric !image-2019-08-23-15-35-17-558.png! Summary: kafka brokers intermittent traffic (was: kafka followers intermittent traffic) > kafka brokers intermittent traffic > -- > > Key: KAFKA-8827 > URL: https://issues.apache.org/jira/browse/KAFKA-8827 > Project: Kafka > Issue Type: Bug >Affects Versions: 0.10.2.0 >Reporter: frid >Priority: Critical > Attachments: image-2019-08-23-15-35-17-558.png > > > i have kafka cluster with version 0.10.2, 3 brokers an 3 zookeeper i try to > generete 25 mb/sec to my topic wich have 400 partitions, the cluster behavior > is very strange > the followers stop receiving messages each 5 min but the leader still receive > messages, which generates lag so underreplicated partitions and the cluster > become unstable. cpu reache 80% in 2 brokers but in the first still in 20 % > Could someone explain this phenomenon? thanks in advance find here some > metric > !image-2019-08-23-15-35-17-558.png! -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (KAFKA-8827) kafka followers intermittent traffic
frid created KAFKA-8827: --- Summary: kafka followers intermittent traffic Key: KAFKA-8827 URL: https://issues.apache.org/jira/browse/KAFKA-8827 Project: Kafka Issue Type: Bug Affects Versions: 0.10.2.0 Reporter: frid Attachments: image-2019-08-23-15-35-17-558.png i have kafka cluster with version 0.10.2, 3brokers an 3 zookeeper i try to generete 25 mb/sec to my topic wich have 400 partitions, the cluster behavior is very strange the followers stop receiving messages each 5 min but the leader still receive messages, which generates lag so underreplicated partitions and the cluster become unstable. cpu reache 80% in followers brokers but in leadear still in 20 % Could someone explain this phenomenon? thanks in advance find here some metric !image-2019-08-23-15-35-17-558.png! -- This message was sent by Atlassian Jira (v8.3.2#803003)
