[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155244922 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155244901 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9530#discussion_r44352760 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala --- @@ -302,6 +325,105 @@ private[netty] class NettyRpcEnv( } }

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155236827 LGTM. I noticed that `Utils.fetchFile` cannot handle special chars (e.g., `%`, ` `) in file name. But since the http server has the same issue, it should not block this

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9530#discussion_r44351354 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala --- @@ -501,13 +625,15 @@ private[netty] class NettyRpcHandler( dispatcher

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9530#discussion_r44350911 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala --- @@ -501,13 +625,15 @@ private[netty] class NettyRpcHandler( dispatcher.

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9530#discussion_r44350637 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala --- @@ -501,13 +625,15 @@ private[netty] class NettyRpcHandler( dispatcher

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9530#discussion_r44349532 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala --- @@ -501,13 +625,15 @@ private[netty] class NettyRpcHandler( dispatcher.

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9530#discussion_r44349342 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala --- @@ -501,13 +625,15 @@ private[netty] class NettyRpcHandler( dispatcher

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155223319 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155219986 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155219970 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155219305 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155203661 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155202070 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155201831 **[Test build #45402 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45402/consoleFull)** for PR 9530 at commit [`87b7a91`](https://git

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155197372 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155197443 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155167098 **[Test build #45402 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45402/consoleFull)** for PR 9530 at commit [`87b7a91`](https://gith

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155166790 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155166742 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155166367 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155160617 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155160422 **[Test build #45383 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45383/consoleFull)** for PR 9530 at commit [`87b7a91`](https://git

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155134307 **[Test build #45383 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45383/consoleFull)** for PR 9530 at commit [`87b7a91`](https://gith

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155133513 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155133542 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154771670 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154771659 **[Test build #45293 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45293/consoleFull)** for PR 9530 at commit [`3f8209f`](https://git

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154768711 **[Test build #45293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45293/consoleFull)** for PR 9530 at commit [`3f8209f`](https://gith

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154768475 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154768480 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-07 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154768450 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154764742 **[Test build #45292 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45292/consoleFull)** for PR 9530 at commit [`3f8209f`](https://git

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154764761 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154753512 **[Test build #45292 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45292/consoleFull)** for PR 9530 at commit [`3f8209f`](https://gith

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154753111 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154753105 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-07 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154752998 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154577701 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-06 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154575961 /cc @rxin @zsxwing --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154574561 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-154574543 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-06 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/9530 [SPARK-11140] [core] Transfer files using network lib when using NettyRpcEnv. This change abstracts the code that serves jars / files to executors so that each RpcEnv can have its own implementat

<    1   2