[jira] [Created] (KAFKA-5780) Long shutdown time when updated to 0.11.0

Raoufeh Hashemian created KAFKA-5780: Summary: Long shutdown time when updated to 0.11.0 Key: KAFKA-5780 URL: https://issues.apache.org/jira/browse/KAFKA-5780 Project: Kafka Issue Type: B

[jira] [Updated] (KAFKA-5780) Long shutdown time when updated to 0.11.0

[ https://issues.apache.org/jira/browse/KAFKA-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raoufeh Hashemian updated KAFKA-5780: - Description: When we switched from Kafka 0.10.2 to Kafka 0.11.0 , We faced a problem with

[jira] [Commented] (KAFKA-5780) Long shutdown time when updated to 0.11.0

[ https://issues.apache.org/jira/browse/KAFKA-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16140173#comment-16140173 ] Raoufeh Hashemian commented on KAFKA-5780: -- broker 1002 is the same broker that i

[jira] [Created] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

Raoufeh Hashemian created KAFKA-5781: Summary: Frequent long produce latency periods that result in reduced produce rate. Key: KAFKA-5781 URL: https://issues.apache.org/jira/browse/KAFKA-5781 Proj

[jira] [Updated] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raoufeh Hashemian updated KAFKA-5781: - Description: When we upgraded from Kafka 0.10,2 to 0.11.0 , I started to see frequent thr

[jira] [Updated] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raoufeh Hashemian updated KAFKA-5781: - Description: When we upgraded from Kafka 0.10,2 to 0.11.0 , I started to see frequent thr

[jira] [Commented] (KAFKA-5780) Long shutdown time when updated to 0.11.0

[ https://issues.apache.org/jira/browse/KAFKA-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16140315#comment-16140315 ] Raoufeh Hashemian commented on KAFKA-5780: -- I think I missed part of your last qu

[jira] [Commented] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16140379#comment-16140379 ] Raoufeh Hashemian commented on KAFKA-5781: -- We upgraded the broker and producer i

[jira] [Commented] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16140386#comment-16140386 ] Raoufeh Hashemian commented on KAFKA-5781: -- Can you please guide me to the list o

[jira] [Commented] (KAFKA-5780) Long shutdown time when updated to 0.11.0

[ https://issues.apache.org/jira/browse/KAFKA-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16140844#comment-16140844 ] Raoufeh Hashemian commented on KAFKA-5780: -- Thanks [~apurva], I guess the size of

[jira] [Updated] (KAFKA-5780) Long shutdown time when updated to 0.11.0

[ https://issues.apache.org/jira/browse/KAFKA-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raoufeh Hashemian updated KAFKA-5780: - Attachment: shutdown.log shutdown_statechange.log shutdown_

[jira] [Commented] (KAFKA-5780) Long shutdown time when updated to 0.11.0

[ https://issues.apache.org/jira/browse/KAFKA-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16141652#comment-16141652 ] Raoufeh Hashemian commented on KAFKA-5780: -- I was doing the shutdown more freque

[jira] [Updated] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raoufeh Hashemian updated KAFKA-5781: - Attachment: GC time.png > Frequent long produce latency periods that result in reduced pro

[jira] [Commented] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145844#comment-16145844 ] Raoufeh Hashemian commented on KAFKA-5781: -- Sorry for late response, I was waitin

[jira] [Commented] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145846#comment-16145846 ] Raoufeh Hashemian commented on KAFKA-5781: -- I should also mention that we use kaf

[jira] [Updated] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raoufeh Hashemian updated KAFKA-5781: - Attachment: server.log gc0.log controler.log

[jira] [Commented] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150090#comment-16150090 ] Raoufeh Hashemian commented on KAFKA-5781: -- Just attached the log files and a plo

[jira] [Comment Edited] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157398#comment-16157398 ] Raoufeh Hashemian edited comment on KAFKA-5781 at 9/7/17 6:29 PM: --

[jira] [Commented] (KAFKA-5781) Frequent long produce latency periods that result in reduced produce rate.

[ https://issues.apache.org/jira/browse/KAFKA-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157398#comment-16157398 ] Raoufeh Hashemian commented on KAFKA-5781: -- HAs anyone got a chance to look into

[jira] [Created] (KAFKA-5857) Excessive heap usage on controller node during reassignment

Raoufeh Hashemian created KAFKA-5857: Summary: Excessive heap usage on controller node during reassignment Key: KAFKA-5857 URL: https://issues.apache.org/jira/browse/KAFKA-5857 Project: Kafka

[jira] [Updated] (KAFKA-5857) Excessive heap usage on controller node during reassignment

[ https://issues.apache.org/jira/browse/KAFKA-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raoufeh Hashemian updated KAFKA-5857: - Description: I was trying to expand our kafka cluster of 6 broker nodes to 12 broker nodes

[jira] [Updated] (KAFKA-5857) Excessive heap usage on controller node during reassignment

[ https://issues.apache.org/jira/browse/KAFKA-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raoufeh Hashemian updated KAFKA-5857: - Description: I was trying to expand our kafka cluster of 6 broker nodes to 12 broker nodes

[jira] [Updated] (KAFKA-5857) Excessive heap usage on controller node during reassignment

[ https://issues.apache.org/jira/browse/KAFKA-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raoufeh Hashemian updated KAFKA-5857: - Description: I was trying to expand our kafka cluster of 6 broker nodes to 12 broker nodes

[jira] [Commented] (KAFKA-5857) Excessive heap usage on controller node during reassignment

[ https://issues.apache.org/jira/browse/KAFKA-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158763#comment-16158763 ] Raoufeh Hashemian commented on KAFKA-5857: -- [~tedyu] Corrected the step number, I

[jira] [Commented] (KAFKA-5857) Excessive heap usage on controller node during reassignment

[ https://issues.apache.org/jira/browse/KAFKA-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158905#comment-16158905 ] Raoufeh Hashemian commented on KAFKA-5857: -- Also I should add that I just realize

[jira] [Commented] (KAFKA-5857) Excessive heap usage on controller node during reassignment

[ https://issues.apache.org/jira/browse/KAFKA-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161757#comment-16161757 ] Raoufeh Hashemian commented on KAFKA-5857: -- We have 960 partition for this topic,

[jira] [Comment Edited] (KAFKA-5857) Excessive heap usage on controller node during reassignment

[ https://issues.apache.org/jira/browse/KAFKA-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161757#comment-16161757 ] Raoufeh Hashemian edited comment on KAFKA-5857 at 9/11/17 6:41 PM: -

[jira] [Commented] (KAFKA-5857) Excessive heap usage on controller node during reassignment

[ https://issues.apache.org/jira/browse/KAFKA-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168063#comment-16168063 ] Raoufeh Hashemian commented on KAFKA-5857: -- I was able to reproduce the problem w