[jira] [Commented] (SPARK-21819) UserGroupInformation initialization in SparkHadoopUtilwill overwrite user config

2017-08-24 Thread Keith Sun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139650#comment-16139650 ] Keith Sun commented on SPARK-21819: --- [~jerryshao] , yes. Thanks for your help and [~vanzin] :) >

[jira] [Commented] (SPARK-21819) UserGroupInformation initialization in SparkHadoopUtilwill overwrite user config

2017-08-23 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139590#comment-16139590 ] Saisai Shao commented on SPARK-21819: - Then I think there should no issue in Spark, right?

[jira] [Commented] (SPARK-21819) UserGroupInformation initialization in SparkHadoopUtilwill overwrite user config

2017-08-23 Thread Keith Sun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139586#comment-16139586 ] Keith Sun commented on SPARK-21819: --- [~vanzin], the third option works for my use case, i could add

[jira] [Commented] (SPARK-21819) UserGroupInformation initialization in SparkHadoopUtilwill overwrite user config

2017-08-23 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138550#comment-16138550 ] Marcelo Vanzin commented on SPARK-21819: There are a few ways to control which Hadoop

[jira] [Commented] (SPARK-21819) UserGroupInformation initialization in SparkHadoopUtilwill overwrite user config

2017-08-23 Thread Keith Sun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138461#comment-16138461 ] Keith Sun commented on SPARK-21819: --- [~jerryshao], i just attach the UGI update in SparkHadoopUtil >

[jira] [Commented] (SPARK-21819) UserGroupInformation initialization in SparkHadoopUtilwill overwrite user config

2017-08-23 Thread Keith Sun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138404#comment-16138404 ] Keith Sun commented on SPARK-21819: --- As the UGI is static and shared by all the component , is it

[jira] [Commented] (SPARK-21819) UserGroupInformation initialization in SparkHadoopUtilwill overwrite user config

2017-08-23 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138308#comment-16138308 ] Saisai Shao commented on SPARK-21819: - I'm not sure if Spark expose the user API to set

[jira] [Commented] (SPARK-21819) UserGroupInformation initialization in SparkHadoopUtilwill overwrite user config

2017-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138302#comment-16138302 ] Sean Owen commented on SPARK-21819: --- Would it suffice to add this configuration somehow after Spark

[jira] [Commented] (SPARK-21819) UserGroupInformation initialization in SparkHadoopUtilwill overwrite user config

2017-08-23 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138300#comment-16138300 ] Saisai Shao commented on SPARK-21819: - I think here because `Configuration` object created in the

[jira] [Commented] (SPARK-21819) UserGroupInformation initialization in SparkHadoopUtilwill overwrite user config

2017-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138223#comment-16138223 ] Sean Owen commented on SPARK-21819: --- Hm, can that be considered supported though? if you've initialized