[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Evan Williams (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030379#comment-17030379 ] Evan Williams edited comment on KAFKA-4084 at 2/5/20 6:27 AM: -

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Evan Williams (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030379#comment-17030379 ] Evan Williams edited comment on KAFKA-4084 at 2/5/20 6:22 AM: -

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Evan Williams (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030379#comment-17030379 ] Evan Williams edited comment on KAFKA-4084 at 2/5/20 6:21 AM: -

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Evan Williams (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030379#comment-17030379 ] Evan Williams edited comment on KAFKA-4084 at 2/5/20 6:13 AM: -

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Evan Williams (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030379#comment-17030379 ] Evan Williams commented on KAFKA-4084: -- Thanks a lot guys. [~sql_consulting] I have

[jira] [Commented] (KAFKA-9113) Clean up task management

2020-02-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030362#comment-17030362 ] ASF GitHub Bot commented on KAFKA-9113: --- guozhangwang commented on pull request #79

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030298#comment-17030298 ] Jun Rao commented on KAFKA-4084: [~sriharsha], hmm, if one sets follower.replication.thro

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Harsha (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030290#comment-17030290 ] Harsha commented on KAFKA-4084: --- [~junrao] I am not sure if we can avoid a broker overload

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Harsha (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030290#comment-17030290 ] Harsha edited comment on KAFKA-4084 at 2/5/20 1:41 AM: --- [~junrao] I

[jira] [Commented] (KAFKA-6607) Consumer Client and Kafka Streams lag not zero when input topic transactional

2020-02-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030273#comment-17030273 ] ASF GitHub Bot commented on KAFKA-6607: --- mjsax commented on pull request #8040: KAF

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030265#comment-17030265 ] Jun Rao commented on KAFKA-4084: [~evanjpw] : Yes, for now, you can potentially set up re

[jira] [Updated] (KAFKA-9381) kafka-streams-scala: Javadocs + Scaladocs not published on maven central

2020-02-04 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-9381: --- Priority: Blocker (was: Major) > kafka-streams-scala: Javadocs + Scaladocs not published on

[jira] [Updated] (KAFKA-9381) kafka-streams-scala: Javadocs + Scaladocs not published on maven central

2020-02-04 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-9381: --- Fix Version/s: 2.5.0 > kafka-streams-scala: Javadocs + Scaladocs not published on maven centr

[jira] [Commented] (KAFKA-9381) kafka-streams-scala: Javadocs + Scaladocs not published on maven central

2020-02-04 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030242#comment-17030242 ] Matthias J. Sax commented on KAFKA-9381: Thanks for picking this one up [~mumrah]

[jira] [Commented] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-02-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030241#comment-17030241 ] Guozhang Wang commented on KAFKA-9430: -- Your analysis is correct, I think it is just

[jira] [Commented] (KAFKA-9505) InternalTopicManager may falls into infinite loop with partially created topics

2020-02-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030221#comment-17030221 ] ASF GitHub Bot commented on KAFKA-9505: --- guozhangwang commented on pull request #80

[jira] [Commented] (KAFKA-9491) Fast election during reassignment can lead to replica fetcher failures

2020-02-04 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030206#comment-17030206 ] Jason Gustafson commented on KAFKA-9491: After reviewing the previous logic, it l

[jira] [Resolved] (KAFKA-9491) Fast election during reassignment can lead to replica fetcher failures

2020-02-04 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-9491. Resolution: Fixed > Fast election during reassignment can lead to replica fetcher failures

[jira] [Updated] (KAFKA-9491) Fast election during reassignment can lead to replica fetcher failures

2020-02-04 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-9491: --- Affects Version/s: 2.4.0 > Fast election during reassignment can lead to replica fetcher fail

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread GEORGE LI (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030183#comment-17030183 ] GEORGE LI commented on KAFKA-4084: -- [~evanjpw] One solution we have in-house is a too

[jira] [Commented] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-02-04 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030170#comment-17030170 ] Vinoth Chandar commented on KAFKA-9430: --- The right way to compute the endOffsets wo

[jira] [Commented] (KAFKA-9455) Consider using TreeMap for in-memory stores of Streams

2020-02-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030153#comment-17030153 ] Guozhang Wang commented on KAFKA-9455: -- [~high.lee] Sure please feel free to pick it

[jira] [Updated] (KAFKA-9501) Promote Standby tasks to active tasks without closing them

2020-02-04 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-9501: Fix Version/s: (was: 2.5.0) > Promote Standby tasks to active tasks without closing them >

[jira] [Updated] (KAFKA-9501) Promote Standby tasks to active tasks without closing them

2020-02-04 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-9501: Priority: Critical (was: Blocker) > Promote Standby tasks to active tasks without closing them > -

[jira] [Created] (KAFKA-9505) InternalTopicManager may falls into infinite loop with partially created topics

2020-02-04 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9505: Summary: InternalTopicManager may falls into infinite loop with partially created topics Key: KAFKA-9505 URL: https://issues.apache.org/jira/browse/KAFKA-9505 Project

[jira] [Resolved] (KAFKA-5868) Kafka Consumer Rebalancing takes too long

2020-02-04 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-5868. Fix Version/s: 2.5.0 Resolution: Fixed > Kafka Consumer Rebalancing takes to

[jira] [Updated] (KAFKA-9501) Promote Standby tasks to active tasks without closing them

2020-02-04 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-9501: Fix Version/s: 2.5.0 > Promote Standby tasks to active tasks without closing them > ---

[jira] [Updated] (KAFKA-9501) Promote Standby tasks to active tasks without closing them

2020-02-04 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-9501: Priority: Blocker (was: Critical) > Promote Standby tasks to active tasks without closing them > -

[jira] [Updated] (KAFKA-9501) Promote Standby tasks to active tasks without closing them

2020-02-04 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman updated KAFKA-9501: --- Description: The purpose of StandbyTasks in Kafka Streams is fast failover. However,

[jira] [Reopened] (KAFKA-9491) Fast election during reassignment can lead to replica fetcher failures

2020-02-04 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reopened KAFKA-9491: Reopening as we are still considering a cherry-pick to 2.3. > Fast election during reassignment can le

[jira] [Resolved] (KAFKA-9491) Fast election during reassignment can lead to replica fetcher failures

2020-02-04 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-9491. Fix Version/s: 2.4.1 2.5.0 Resolution: Fixed > Fast election during reass

[jira] [Commented] (KAFKA-9491) Fast election during reassignment can lead to replica fetcher failures

2020-02-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030074#comment-17030074 ] ASF GitHub Bot commented on KAFKA-9491: --- ijuma commented on pull request #8037: KAF

[jira] [Commented] (KAFKA-9376) Plugin class loader not found using MM2

2020-02-04 Thread Irina (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030062#comment-17030062 ] Irina commented on KAFKA-9376: -- Hello, I'm experiencing the same issue, any update on this?

[jira] [Assigned] (KAFKA-9455) Consider using TreeMap for in-memory stores of Streams

2020-02-04 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman reassigned KAFKA-9455: -- Assignee: highluck > Consider using TreeMap for in-memory stores of Streams >

[jira] [Commented] (KAFKA-9455) Consider using TreeMap for in-memory stores of Streams

2020-02-04 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030057#comment-17030057 ] Sophie Blee-Goldman commented on KAFKA-9455: [~high.lee] I'm pretty certain G

[jira] [Updated] (KAFKA-9074) Connect's Values class does not parse time or timestamp values from string literals

2020-02-04 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch updated KAFKA-9074: - Fix Version/s: 2.6.0 > Connect's Values class does not parse time or timestamp values from string

[jira] [Resolved] (KAFKA-9074) Connect's Values class does not parse time or timestamp values from string literals

2020-02-04 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-9074. -- Fix Version/s: 2.4.1 2.3.2 2.5.0 Reviewer: Jason

[jira] [Commented] (KAFKA-9477) Doc: Add RoundRobinAssignor as an option to consumer configs

2020-02-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030015#comment-17030015 ] ASF GitHub Bot commented on KAFKA-9477: --- cmccabe commented on pull request #8007: K

[jira] [Resolved] (KAFKA-9492) ProducerResponse with record-level errors throw NPE with older client version

2020-02-04 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-9492. --- Fix Version/s: 2.4.1 Resolution: Fixed > ProducerResponse with record-level errors thr

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Evan Williams (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17029638#comment-17029638 ] Evan Williams edited comment on KAFKA-4084 at 2/4/20 5:16 PM: -

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Evan Williams (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17029638#comment-17029638 ] Evan Williams edited comment on KAFKA-4084 at 2/4/20 5:15 PM: -

[jira] [Commented] (KAFKA-9074) Connect's Values class does not parse time or timestamp values from string literals

2020-02-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1703#comment-1703 ] ASF GitHub Bot commented on KAFKA-9074: --- rhauch commented on pull request #7568: KA

[jira] [Commented] (KAFKA-9492) ProducerResponse with record-level errors throw NPE with older client version

2020-02-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17029992#comment-17029992 ] ASF GitHub Bot commented on KAFKA-9492: --- rajinisivaram commented on pull request #8

[jira] [Assigned] (KAFKA-9381) kafka-streams-scala: Javadocs + Scaladocs not published on maven central

2020-02-04 Thread David Arthur (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur reassigned KAFKA-9381: --- Assignee: David Arthur > kafka-streams-scala: Javadocs + Scaladocs not published on maven ce

[jira] [Commented] (KAFKA-9455) Consider using TreeMap for in-memory stores of Streams

2020-02-04 Thread highluck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17029848#comment-17029848 ] highluck commented on KAFKA-9455: - [~ableegoldman]  Thanks for the explanation! [~guozh

[jira] [Commented] (KAFKA-9319) Run some system tests using TLSv1.3

2020-02-04 Thread Nikolay Izhikov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17029769#comment-17029769 ] Nikolay Izhikov commented on KAFKA-9319: Hello, [~rsivaram]. Sorry, for the firs

[jira] [Commented] (KAFKA-7663) Custom Processor supplied on addGlobalStore is not used when restoring state from topic

2020-02-04 Thread Ricardo Moreira (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17029751#comment-17029751 ] Ricardo Moreira commented on KAFKA-7663: Hi all, I'm currently facing the same "

[jira] [Created] (KAFKA-9504) Memory leak in KafkaMetrics registered to MBean

2020-02-04 Thread Jira
Andreas Holmén created KAFKA-9504: - Summary: Memory leak in KafkaMetrics registered to MBean Key: KAFKA-9504 URL: https://issues.apache.org/jira/browse/KAFKA-9504 Project: Kafka Issue Type: B

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Evan Williams (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17029638#comment-17029638 ] Evan Williams edited comment on KAFKA-4084 at 2/4/20 8:27 AM: -

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

2020-02-04 Thread Evan Williams (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17029638#comment-17029638 ] Evan Williams commented on KAFKA-4084: -- [~sql_consulting] Many thanks for the explan