[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2016-03-19 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201709#comment-15201709 ] Jun Rao commented on KAFKA-1215: [~allenxwang], could you also update the changes to ZK st

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2016-03-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202369#comment-15202369 ] Jun Rao commented on KAFKA-1215: Great, thanks Allen. > Rack-Aware replica assignment opt

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2016-03-18 Thread Allen Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202362#comment-15202362 ] Allen Wang commented on KAFKA-1215: --- [~junrao] Updated. > Rack-Aware replica assignmen

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2016-03-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195674#comment-15195674 ] ASF GitHub Bot commented on KAFKA-1215: --- Github user asfgit closed the pull request

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2016-03-01 Thread Aditya Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15174090#comment-15174090 ] Aditya Auradkar commented on KAFKA-1215: Thanks Allan. I'll review it this week.

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2016-02-26 Thread Allen Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15169592#comment-15169592 ] Allen Wang commented on KAFKA-1215: --- [~aauradkar] Yes it is ready for review. > Rack-A

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2016-02-23 Thread Aditya Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15159491#comment-15159491 ] Aditya Auradkar commented on KAFKA-1215: [~allenxwang] - Is this patch ready for r

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-11-05 Thread Vidhya Arvind (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993035#comment-14993035 ] Vidhya Arvind commented on KAFKA-1215: -- Is there anyway this patch can be part of 0.9

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-09-27 Thread Allen Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14909911#comment-14909911 ] Allen Wang commented on KAFKA-1215: --- Started the work on KIP: https://cwiki.apache.org/

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-09-25 Thread Aditya Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14908460#comment-14908460 ] Aditya Auradkar commented on KAFKA-1215: [~allenxwang] - bump. > Rack-Aware repl

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-09-17 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804835#comment-14804835 ] Joel Koshy commented on KAFKA-1215: --- [~allenxwang] you should have access now. > Rack-A

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-09-15 Thread Allen Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14746264#comment-14746264 ] Allen Wang commented on KAFKA-1215: --- [~aauradkar] [~junrao] [~jkreps] My apache confluen

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-09-15 Thread Aditya Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14745803#comment-14745803 ] Aditya Auradkar commented on KAFKA-1215: [~allenxwang] One of the committers can p

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-09-14 Thread Allen Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14744465#comment-14744465 ] Allen Wang commented on KAFKA-1215: --- [~aauradkar] Sure I can create a KIP. However, afte

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-09-09 Thread Aditya Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737918#comment-14737918 ] Aditya Auradkar commented on KAFKA-1215: [~allenxwang] Hi Allen. Thanks for the pa

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-08-13 Thread Allen Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696026#comment-14696026 ] Allen Wang commented on KAFKA-1215: --- [~junrao] Can you review the GitHub pull request or

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-08-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682185#comment-14682185 ] ASF GitHub Bot commented on KAFKA-1215: --- GitHub user allenxwang opened a pull reques

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-06-29 Thread Allen Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606043#comment-14606043 ] Allen Wang commented on KAFKA-1215: --- [~junrao] AWS region (for example us-east-1) can be

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-06-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604154#comment-14604154 ] Jun Rao commented on KAFKA-1215: [~allenxwang], thanks for the update. How do you model th

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-06-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14598643#comment-14598643 ] Jay Kreps commented on KAFKA-1215: -- This is great! > Rack-Aware replica assignment optio

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-06-23 Thread Allen Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14598615#comment-14598615 ] Allen Wang commented on KAFKA-1215: --- We have a working solution now for rack aware assig

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-03-29 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386037#comment-14386037 ] Neha Narkhede commented on KAFKA-1215: -- [~allenxwang] This was inactive for a while,

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2015-03-20 Thread Allen Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14372058#comment-14372058 ] Allen Wang commented on KAFKA-1215: --- What's the status of this JIRA? I have two questio

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-09-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122028#comment-14122028 ] Guozhang Wang commented on KAFKA-1215: -- Moving out of 0.8.2 for now.. > Rack-Aware r

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-06-13 Thread Joris Van Remoortere (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030981#comment-14030981 ] Joris Van Remoortere commented on KAFKA-1215: - [~jjkoshy] I am out till the en

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-06-10 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026828#comment-14026828 ] Joel Koshy commented on KAFKA-1215: --- [~jvanremoortere] did you get a chance to follow-up

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-05-29 Thread Jorge Ortiz (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14013151#comment-14013151 ] Jorge Ortiz commented on KAFKA-1215: Any update on this? We're deploying Kafka on AWS

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-04-02 Thread Joris Van Remoortere (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13958242#comment-13958242 ] Joris Van Remoortere commented on KAFKA-1215: - Since there is further interest

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-03-03 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13918391#comment-13918391 ] Guozhang Wang commented on KAFKA-1215: -- Some more comments on the RB. > Rack-Aware r

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-02-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13910578#comment-13910578 ] Jun Rao commented on KAFKA-1215: Sorry for not getting to this earlier, commented on the R

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-02-06 Thread Joris Van Remoortere (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13893535#comment-13893535 ] Joris Van Remoortere commented on KAFKA-1215: - [~junrao] could you please look

Re: [jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-01-26 Thread Jun Rao
Thanks for the update. This proposal looks reasonable to me. One issue that needs a bit more thinking is what happens when a broker is moved from one rack to another. After the move, constraints on max-rack-replication could be violated. The question is what we should do when this happens. A less

Re: [jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-01-26 Thread Joris VanRemoortere
Thanks Jun, As you said, rack-aware assignment needs to be supported during topic creation, adding of partitions, and partition re-assignment. In order to reduce the risk of using a different value of max-rack-replication during different calls to those functions, I'd like to carry / persist that

Re: [jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-01-26 Thread Jun Rao
Replica assignments can change during topic creation, adding partitions, and reassign partitions. So, it would be good to integrate rack-aware assignment in those cases. For compatibility, to do a rolling upgrade of a Kafka cluster means that at a given point of time, some brokers could be registe

Re: [jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-01-24 Thread Joris VanRemoortere
Working on the above. Since trunk currently allows Topic configs, and altering topics, does it make sense to you to make this a topic config so that it is kept in sync between topic alterations and partition adds? For compatibility: I can make the zookeeper state parsing backwards / forwards comp

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

2014-01-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881193#comment-13881193 ] Jun Rao commented on KAFKA-1215: Thanks for the patch. Looks good over all. Some comments.