[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-30 Thread Dhruve Ashar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852365#comment-16852365 ] Dhruve Ashar commented on SPARK-24149: -- IMHO having a consistent way to reason about a behavior is

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-30 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851896#comment-16851896 ] Marco Gaido commented on SPARK-24149: - That's true, the point is: if you want to access a different

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-28 Thread Dhruve Ashar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850096#comment-16850096 ] Dhruve Ashar commented on SPARK-24149: -- Thanks for the missing context. The current behavior

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-25 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848097#comment-16848097 ] Marco Gaido commented on SPARK-24149: - [~Dhruve Ashar] the use case for this change, for instance,

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-24 Thread Dhruve Ashar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847929#comment-16847929 ] Dhruve Ashar commented on SPARK-24149: -- I also think that HDFS client shouldn't be figuring out if

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-24 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847926#comment-16847926 ] Marcelo Vanzin commented on SPARK-24149: bq. If they are unrelated the user explicitly provides

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-24 Thread Dhruve Ashar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847923#comment-16847923 ] Dhruve Ashar commented on SPARK-24149: --   Spark should be agnostic about the namenodes for which

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-24 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847888#comment-16847888 ] Marcelo Vanzin commented on SPARK-24149: bq. I think we are duplicating the logic here Do you

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-24 Thread Dhruve Ashar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847854#comment-16847854 ] Dhruve Ashar commented on SPARK-24149: -- [~mgaido] [~vanzin], The change this PR introduced is

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2018-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536586#comment-16536586 ] Apache Spark commented on SPARK-24149: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2018-05-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461078#comment-16461078 ] Apache Spark commented on SPARK-24149: -- User 'mgaido91' has created a pull request for this issue: