[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14065 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-09 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r74104234 --- Diff: docs/running-on-yarn.md --- @@ -525,16 +524,23 @@ token for the cluster's HDFS filesystem, and potentially for HBase and Hive. An HBase t

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73931365 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -53,50 +53,58 @@ private[spark] class CredentialUpdater(

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73931312 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -53,50 +53,58 @@ private[spark] class CredentialUpdater(

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73931240 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -53,50 +53,58 @@ private[spark] class CredentialUpdater(

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73931146 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -53,50 +53,58 @@ private[spark] class CredentialUpdater(

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73931184 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -53,50 +53,58 @@ private[spark] class CredentialUpdater(

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73931091 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -53,50 +53,58 @@ private[spark] class CredentialUpdater(

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73930764 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -53,50 +53,58 @@ private[spark] class CredentialUpdater(

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73930614 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -53,50 +53,58 @@ private[spark] class CredentialUpdater(

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73930350 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -53,50 +53,58 @@ private[spark] class CredentialUpdater(

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73930244 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -53,50 +53,58 @@ private[spark] class CredentialUpdater(

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-03 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73424456 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/HiveCredentialProvider.scala --- @@ -0,0 +1,132 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-03 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73423485 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -41,16 +43,18 @@ private[spark] class ExecutorDelegationTo

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-03 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73420791 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/ConfigurableCredentialManager.scala --- @@ -0,0 +1,105 @@ +/* + * Licensed to the

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-03 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73419090 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/AMCredentialRenewer.scala --- @@ -27,39 +27,42 @@ import org.apache.hadoop.security.UserG

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-03 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73419026 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/AMCredentialRenewer.scala --- @@ -27,39 +27,42 @@ import org.apache.hadoop.security.UserG

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-03 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73418370 --- Diff: docs/running-on-yarn.md --- @@ -525,16 +534,23 @@ token for the cluster's HDFS filesystem, and potentially for HBase and Hive. An HBase t

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-03 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73418187 --- Diff: docs/running-on-yarn.md --- @@ -461,15 +461,24 @@ To use a custom metrics.properties for the application master and executors, upd

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-03 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73418133 --- Diff: docs/running-on-yarn.md --- @@ -461,15 +461,24 @@ To use a custom metrics.properties for the application master and executors, upd

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-03 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73417870 --- Diff: docs/running-on-yarn.md --- @@ -461,15 +461,24 @@ To use a custom metrics.properties for the application master and executors, upd

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-08-03 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r73417691 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -338,15 +312,15 @@ class SparkHadoopUtil extends Logging { }

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-29 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72752972 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/HDFSCredentialProvider.scala --- @@ -0,0 +1,118 @@ +/* + * Licensed to the Apa

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-29 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72750534 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/security/HDFSCredentialProviderSuite.scala --- @@ -0,0 +1,106 @@ +/* + * Licensed to th

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-29 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72750018 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -107,8 +110,16 @@ private[spark] class ExecutorDelegati

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-29 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72749483 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -41,16 +43,18 @@ private[spark] class ExecutorDelegatio

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-28 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72747890 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/ConfigurableCredentialManager.scala --- @@ -0,0 +1,96 @@ +/* + * Licensed to t

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72494408 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/security/HDFSCredentialProviderSuite.scala --- @@ -0,0 +1,106 @@ +/* + * Licensed to the A

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72492886 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/ServiceCredentialProvider.scala --- @@ -0,0 +1,51 @@ +/* + * Licensed to the Apac

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72493667 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/HDFSCredentialProvider.scala --- @@ -0,0 +1,118 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72493513 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/security/ConfigurableCredentialManagerSuite.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed t

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72493335 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/security/ConfigurableCredentialManagerSuite.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed t

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72492707 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/HiveCredentialProvider.scala --- @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72492363 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/HDFSCredentialProvider.scala --- @@ -0,0 +1,118 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72491288 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -107,8 +110,16 @@ private[spark] class ExecutorDelegationT

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72491990 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/HDFSCredentialProvider.scala --- @@ -0,0 +1,118 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72491505 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/HDFSCredentialProvider.scala --- @@ -0,0 +1,118 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72490919 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala --- @@ -41,16 +43,18 @@ private[spark] class ExecutorDelegationTo

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72490136 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/ConfigurableCredentialManager.scala --- @@ -0,0 +1,96 @@ +/* + * Licensed to the

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72489576 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/ConfigurableCredentialManager.scala --- @@ -0,0 +1,96 @@ +/* + * Licensed to the

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72489363 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/ConfigurableCredentialManager.scala --- @@ -0,0 +1,96 @@ +/* + * Licensed to the

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72487536 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/AMCredentialRenewer.scala --- @@ -27,39 +27,42 @@ import org.apache.hadoop.security.UserG

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-27 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72483453 --- Diff: docs/running-on-yarn.md --- @@ -525,16 +534,22 @@ token for the cluster's HDFS filesystem, and potentially for HBase and Hive. An HBase t

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-26 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72336372 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/AMCredentialRenewer.scala --- @@ -171,16 +172,30 @@ private[yarn] class AMDelegationTo

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable credential...

2016-07-26 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r72335383 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -312,15 +312,15 @@ class SparkHadoopUtil extends Logging { }