[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577562#comment-16577562 ] Hudson commented on HDFS-10467: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16199097#comment-16199097 ] Hudson commented on HDFS-10467: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16197695#comment-16197695 ] Íñigo Goiri commented on HDFS-10467: Thanks [~andrew.wang]. I updated the release note

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16197575#comment-16197575 ] Andrew Wang commented on HDFS-10467: Thanks for working on this Inigo. Do you mind add

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16195522#comment-16195522 ] Hudson commented on HDFS-10467: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16195513#comment-16195513 ] Íñigo Goiri commented on HDFS-10467: The vote passed so I merged HDFS-10467 into trunk

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193982#comment-16193982 ] Íñigo Goiri commented on HDFS-10467: The [vote for merging|http://mail-archives.apach

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172141#comment-16172141 ] Íñigo Goiri commented on HDFS-10467: There are a couple of improvements for HDFS-12273

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152045#comment-16152045 ] Tao Li commented on HDFS-10467: --- Tao Li liked your email Spark by Readdle > Router-based H

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152037#comment-16152037 ] He Tianyi commented on HDFS-10467: -- [~elgoiri], thanks for asking. our federated cluster

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16151369#comment-16151369 ] Íñigo Goiri commented on HDFS-10467: [~He Tianyi], now that we start to have most of t

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983422#comment-15983422 ] Inigo Goiri commented on HDFS-10467: [~fabbri], the tasks in the current JIRA are the

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983390#comment-15983390 ] Aaron Fabbri commented on HDFS-10467: - Thanks for the update [~elgoiri]. I'm trying t

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15933260#comment-15933260 ] Hadoop QA commented on HDFS-10467: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727451#comment-15727451 ] Hadoop QA commented on HDFS-10467: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727440#comment-15727440 ] Inigo Goiri commented on HDFS-10467: Created fork to branch-2.6.1: https://github.com/

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15665202#comment-15665202 ] Inigo Goiri commented on HDFS-10467: I will do a fork in GitHub to place our code runn

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514336#comment-15514336 ] Jason Kace commented on HDFS-10467: --- [~subru], than you for the feedback! 1) Using jcac

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514209#comment-15514209 ] Inigo Goiri commented on HDFS-10467: [~subru], I agree on {{RecordFactory}}. I just cr

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15511886#comment-15511886 ] Hadoop QA commented on HDFS-10467: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15511831#comment-15511831 ] Subru Krishnan commented on HDFS-10467: --- Thanks [~jakace] and [~goiri] for the refac

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15403257#comment-15403257 ] Inigo Goiri commented on HDFS-10467: Regarding the rebalancing operations, currently w

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382547#comment-15382547 ] Inigo Goiri commented on HDFS-10467: Thanks [~vinayrpet] for the comments. bq. Why ca

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382535#comment-15382535 ] Inigo Goiri commented on HDFS-10467: [~mingma], thank you for the comments. A few answ

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382072#comment-15382072 ] Vinayakumar B commented on HDFS-10467: -- Hi, This will be nice addition to Federation

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381726#comment-15381726 ] Ming Ma commented on HDFS-10467: [~elgoiri], nice work! Here are couple more questions abo

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377362#comment-15377362 ] Jing Zhao commented on HDFS-10467: -- Assigned the jira to [~elgoiri]. bq. Probably, it's

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376170#comment-15376170 ] Inigo Goiri commented on HDFS-10467: After checking the code, I think there might a bu

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373984#comment-15373984 ] Inigo Goiri commented on HDFS-10467: This optimization increases significantly the per

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15359625#comment-15359625 ] Hadoop QA commented on HDFS-10467: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332455#comment-15332455 ] Inigo Goiri commented on HDFS-10467: [~zhz], thanks for the feedback. Some clarificati

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332129#comment-15332129 ] Zhe Zhang commented on HDFS-10467: -- Read more about the design and patch. Looks really in

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319822#comment-15319822 ] Inigo Goiri commented on HDFS-10467: And we targeted to minimize the impact on those 1

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319564#comment-15319564 ] Zhe Zhang commented on HDFS-10467: -- Thanks. Impressive that only {{12 deletions(-)}} :)

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319411#comment-15319411 ] Hadoop QA commented on HDFS-10467: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319098#comment-15319098 ] Inigo Goiri commented on HDFS-10467: I went through the rebase into trunk and there ar

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317952#comment-15317952 ] Zhe Zhang commented on HDFS-10467: -- Thanks [~elgoiri]! I think most likely we will cut a

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317941#comment-15317941 ] Inigo Goiri commented on HDFS-10467: [~zhz], true, it was done on our internal 2.6 bra

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317925#comment-15317925 ] Zhe Zhang commented on HDFS-10467: -- Thanks for the design doc and patch [~elgoiri], very

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317636#comment-15317636 ] He Tianyi commented on HDFS-10467: -- +1. This also reduces latency for first request from

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317626#comment-15317626 ] Inigo Goiri commented on HDFS-10467: Another advantage about the proposed approach is

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15310998#comment-15310998 ] Inigo Goiri commented on HDFS-10467: [~He Tianyi], our proposal requires additional co

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305716#comment-15305716 ] He Tianyi commented on HDFS-10467: -- Thanks for sharing. I've implemented similar approac

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304679#comment-15304679 ] Inigo Goiri commented on HDFS-10467: Thanks for early feedback to [~chris.douglas], [~

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304670#comment-15304670 ] Inigo Goiri commented on HDFS-10467: [~He Tianyi] for awareness. > Router-based HDFS

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304668#comment-15304668 ] Inigo Goiri commented on HDFS-10467: This approach should support the scenarios in the

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304646#comment-15304646 ] Chris Nauroth commented on HDFS-10467: -- [~elgoiri], thank you for sharing this. A si

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304441#comment-15304441 ] Inigo Goiri commented on HDFS-10467: The advantages of this approach are: * Transparen