[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775000#comment-16775000 ] Junping Du commented on HADOOP-8468: Agree. Mark it as resolved. > Umbrella of enhancements to

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774975#comment-16774975 ] Lars Francke commented on HADOOP-8468: -- Wouldn't it make sense to close this issue and open a new

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371950#comment-14371950 ] Junping Du commented on HADOOP-8468: Hi [~aw], most of work get committed (1.2.0 for

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132878#comment-14132878 ] Allen Wittenauer commented on HADOOP-8468: -- Was this actually ever committed?

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13672764#comment-13672764 ] Sheng Liu commented on HADOOP-8468: --- Thank you for your work, Junping

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13672792#comment-13672792 ] Tsz Wo (Nicholas), SZE commented on HADOOP-8468: Thanks Junping, I will

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13672801#comment-13672801 ] Junping Du commented on HADOOP-8468: Great. Thanks! Umbrella of

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13672096#comment-13672096 ] Junping Du commented on HADOOP-8468: All JIRAs above are reopened and patches already

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666454#comment-13666454 ] Junping Du commented on HADOOP-8468: I start the work to backport NodeGroup-aware

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13608852#comment-13608852 ] Jan Kunigk commented on HADOOP-8468: Junping, thank you your explanations. Beyond

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13606171#comment-13606171 ] Junping Du commented on HADOOP-8468: Jan, Thanks for the questions. It doesn't have

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13605252#comment-13605252 ] Jan Kunigk commented on HADOOP-8468: Junping, Referring to one of your earlier

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13563815#comment-13563815 ] Junping Du commented on HADOOP-8468: Andy, you can just simply start TaskTracker

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13563722#comment-13563722 ] Andy Yang commented on HADOOP-8468: --- Could anyone give me some advice about how to

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13562678#comment-13562678 ] Andy Yang commented on HADOOP-8468: --- I try to patch the HADOOP-8468-total.patch to the

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13562777#comment-13562777 ] Junping Du commented on HADOOP-8468: Hi Andy, HADOOP-8468-total.patch is a patch

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13503100#comment-13503100 ] Junping Du commented on HADOOP-8468: Hi Konstantin, Thanks for your question and

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13503097#comment-13503097 ] Konstantin Shvachko commented on HADOOP-8468: - Junping, Checked your article

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13489593#comment-13489593 ] Junping Du commented on HADOOP-8468: Hi, Anyone can take a look at recent patch of

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13489601#comment-13489601 ] Tsz Wo (Nicholas), SZE commented on HADOOP-8468: Hi Junping, I would be

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13489608#comment-13489608 ] Junping Du commented on HADOOP-8468: Great!Thanks.Nicholas!

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13487053#comment-13487053 ] Junping Du commented on HADOOP-8468: As some followup with meetup, I quickly

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13487059#comment-13487059 ] Junping Du commented on HADOOP-8468: Also, a white paper on reliability and

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13456891#comment-13456891 ] Junping Du commented on HADOOP-8468: Thanks for great comments. Konstantin. the doc

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13399536#comment-13399536 ] Konstantin Shvachko commented on HADOOP-8468: - It's good that you formulated

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13398269#comment-13398269 ] Konstantin Shvachko commented on HADOOP-8468: - 3rd on local node of 2nd How

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13398294#comment-13398294 ] Junping Du commented on HADOOP-8468: Hi Konstantin, Thanks for your comments.

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13398316#comment-13398316 ] Junping Du commented on HADOOP-8468: What changed your mind? Sounds like the right

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13396698#comment-13396698 ] Hudson commented on HADOOP-8468: Integrated in Hadoop-Hdfs-trunk #1081 (See

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13396783#comment-13396783 ] Hudson commented on HADOOP-8468: Integrated in Hadoop-Mapreduce-trunk #1114 (See

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13395831#comment-13395831 ] Hudson commented on HADOOP-8468: Integrated in Hadoop-Hdfs-trunk #1080 (See

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13395911#comment-13395911 ] Hudson commented on HADOOP-8468: Integrated in Hadoop-Mapreduce-trunk #1113 (See

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13396122#comment-13396122 ] Hudson commented on HADOOP-8468: Integrated in Hadoop-Common-trunk-Commit #2367 (See

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13396139#comment-13396139 ] Hudson commented on HADOOP-8468: Integrated in Hadoop-Hdfs-trunk-Commit #2438 (See

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13396199#comment-13396199 ] Hudson commented on HADOOP-8468: Integrated in Hadoop-Mapreduce-trunk-Commit #2387 (See

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13393612#comment-13393612 ] Hudson commented on HADOOP-8468: Integrated in Hadoop-Hdfs-trunk-Commit #2435 (See

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13393613#comment-13393613 ] Hudson commented on HADOOP-8468: Integrated in Hadoop-Common-trunk-Commit #2363 (See

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13296131#comment-13296131 ] Junping Du commented on HADOOP-8468: Update proposal to address Luke and Konstantin's

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13296139#comment-13296139 ] Junping Du commented on HADOOP-8468: Hi Konstantin, That's good suggestions.

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13295990#comment-13295990 ] Konstantin Shvachko commented on HADOOP-8468: - Sorry, got distracted with the

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13291584#comment-13291584 ] Konstantin Shvachko commented on HADOOP-8468: - Junping, I went over the

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13291638#comment-13291638 ] Junping Du commented on HADOOP-8468: Hey Konstantin, Thanks for a lot of good

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13290043#comment-13290043 ] Luke Lu commented on HADOOP-8468: - Yes, noting the new approach and its impact on overall

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13289335#comment-13289335 ] Junping Du commented on HADOOP-8468: I would update proposal a bit with listing the

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13289747#comment-13289747 ] Luke Lu commented on HADOOP-8468: - Actually, the two approaches are orthogonal. Avoiding

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13289903#comment-13289903 ] Junping Du commented on HADOOP-8468: Hi Luke, Yes. I agree with you that when

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13288596#comment-13288596 ] Junping Du commented on HADOOP-8468: Patch is divided into 7 patches and attached to

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13288604#comment-13288604 ] Junping Du commented on HADOOP-8468: I mark P1,P3 and P6 as patch available, P2, P4,

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13288643#comment-13288643 ] Robert Joseph Evans commented on HADOOP-8468: - Junping Du, I have been

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13288666#comment-13288666 ] Robert Joseph Evans commented on HADOOP-8468: - You can move the JIRAs. More

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13288687#comment-13288687 ] Junping Du commented on HADOOP-8468: It looks like this move action will actually

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13288761#comment-13288761 ] Robert Joseph Evans commented on HADOOP-8468: - Having the other links like

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13288791#comment-13288791 ] Junping Du commented on HADOOP-8468: Finished! The code separation following JIRA

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13288906#comment-13288906 ] Luke Lu commented on HADOOP-8468: - This is a comment on the proposal, IMO, is missing a

[jira] [Commented] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

[ https://issues.apache.org/jira/browse/HADOOP-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13289164#comment-13289164 ] Junping Du commented on HADOOP-8468: Hi Luke, Thanks for good comments. Will