[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-08 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r70074645 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/token/ServiceTokenProvider.scala --- @@ -0,0 +1,75 @@ +/* + * Licensed to the Apache So

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r70020146 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -390,8 +390,9 @@ private[spark] class Client( // Upload Spark and th

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r69992687 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/token/ServiceTokenProvider.scala --- @@ -0,0 +1,75 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r69991485 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/token/ServiceTokenProvider.scala --- @@ -0,0 +1,75 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r69990872 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/token/ServiceTokenProvider.scala --- @@ -0,0 +1,75 @@ +/* + * Licensed to the Apache Softw

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r69990265 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/token/ConfigurableTokenManager.scala --- @@ -0,0 +1,214 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r69989897 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/token/ConfigurableTokenManager.scala --- @@ -0,0 +1,214 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r69989547 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/token/ConfigurableTokenManager.scala --- @@ -0,0 +1,214 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r69989212 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/token/ConfigurableTokenManager.scala --- @@ -0,0 +1,214 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r69988867 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala --- @@ -96,237 +87,19 @@ class YarnSparkHadoopUtil extends SparkHadoopUti

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r69988196 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -390,8 +390,9 @@ private[spark] class Client( // Upload Spark and the a

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r69918095 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -390,8 +390,9 @@ private[spark] class Client( // Upload Spark and th

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r69917965 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/token/HDFSTokenProvider.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache Soft

[GitHub] spark pull request #14065: [SPARK-14743][YARN][WIP] Add a configurable token...

2016-07-07 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r69916415 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/token/AMDelegationTokenRenewer.scala --- @@ -171,10 +174,9 @@ private[yarn] class AMDelegationT