[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-09-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18978 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134032590 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala --- @@ -23,6 +23,8 @@ import

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134024641 --- Diff: core/src/main/scala/org/apache/spark/SecurityManager.scala --- @@ -533,12 +534,24 @@ private[spark] class SecurityManager( /**

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134025624 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -247,7 +261,9 @@ private[spark] class

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134025786 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -41,9 +47,16 @@ import

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134024733 --- Diff: core/src/main/scala/org/apache/spark/SecurityManager.scala --- @@ -533,12 +534,24 @@ private[spark] class SecurityManager( /**

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134024423 --- Diff: common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java --- @@ -108,6 +108,9 @@ public int

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134018580 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/SparkSaslServer.java --- @@ -182,10 +210,21 @@ public void handle(Callback[]

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134020417 --- Diff: common/network-common/src/main/java/org/apache/spark/network/util/HadoopSecurityUtils.java --- @@ -0,0 +1,73 @@ +/* + * Licensed to

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134038075 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -749,8 +803,18 @@ private[spark] class

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134032483 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1149,6 +1156,43 @@ private[spark] class Client(

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134008722 --- Diff: common/network-common/src/main/java/org/apache/spark/network/crypto/AuthEngine.java --- @@ -69,14 +77,26 @@ private CryptoCipher

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134018692 --- Diff: common/network-common/src/main/java/org/apache/spark/network/crypto/AuthEngine.java --- @@ -106,9 +127,22 @@ ClientChallenge challenge()

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134021622 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1149,6 +1156,43 @@ private[spark] class Client(

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/18978#discussion_r134037811 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -422,6 +440,35 @@ private[spark] class

[GitHub] spark pull request #18978: [SPARK-21737][YARN]Create communication channel b...

2017-08-17 Thread yoonlee95
GitHub user yoonlee95 opened a pull request: https://github.com/apache/spark/pull/18978 [SPARK-21737][YARN]Create communication channel between arbitrary clients and the Spark AM in YARN mode ## What changes were proposed in this pull request? In this JIRA, I develop code to