[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12024 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/12024#issuecomment-202710390 Merging into master, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12024#issuecomment-202709467 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12024#issuecomment-202709463 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12024#issuecomment-202708781 **[Test build #54405 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54405/consoleFull)** for PR 12024 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12024#issuecomment-202674777 **[Test build #54405 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54405/consoleFull)** for PR 12024 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/12024#issuecomment-202673721 @davies, this is the new PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread sun-rui
GitHub user sun-rui opened a pull request: https://github.com/apache/spark/pull/12024 [SPARK-12792][SPARKR] Refactor RRDD to support R UDF. ## What changes were proposed in this pull request? Refactor RRDD by separating the common logic interacting with the R worker to a

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-202653531 ok, will send another PR soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-202495049 @sun-rui This PR have some conflict that fail the build, so reverted it, could you send another PR to fix that? --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-202494287 **[Test build #2701 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2701/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10947 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-202492419 **[Test build #2701 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2701/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-202492245 LGTM, merging this into master, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-16 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-197174079 hey @davies when you have a chance can you review this? thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-08 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/10947#discussion_r55477889 --- Diff: core/src/main/scala/org/apache/spark/api/r/RRunner.scala --- @@ -0,0 +1,367 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-08 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/10947#discussion_r55477830 --- Diff: core/src/main/scala/org/apache/spark/api/r/RRunner.scala --- @@ -0,0 +1,367 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-08 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/10947#discussion_r55477700 --- Diff: core/src/main/scala/org/apache/spark/api/r/RRunner.scala --- @@ -0,0 +1,367 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-08 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/10947#discussion_r55477584 --- Diff: core/src/main/scala/org/apache/spark/api/r/RRunner.scala --- @@ -0,0 +1,367 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-08 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/10947#discussion_r55476565 --- Diff: core/src/main/scala/org/apache/spark/api/r/RRunner.scala --- @@ -0,0 +1,367 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-08 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-194133921 cc @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-08 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/10947#discussion_r55476044 --- Diff: core/src/main/scala/org/apache/spark/api/r/RRunner.scala --- @@ -0,0 +1,367 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-08 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-194125116 For bulk movement of code, can you comment in the pr yourself which part was actually changed, and which part was simply moving code from one place to another? --- If

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-02 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-191595979 @davies, @rxin, could you help to review it and merge it? it will benefit development of following PRs. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-21 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-186970941 @NarineK, yes it is assumed that R has been installed in each worker node. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-19 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-186476315 Thanks for working on this, @sun-rui . I have a question regarding the R workers. Do we assume that there is a R instance installed on each cluster node ? Is that

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-182890890 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-182890889 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-182890645 **[Test build #51094 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51094/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-11 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-182836752 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-182846322 **[Test build #51094 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51094/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-181250046 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-181249953 **[Test build #50912 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50912/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-181250049 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-07 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-181211546 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-181222129 **[Test build #50912 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50912/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-180753047 **[Test build #50870 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50870/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-06 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-180717242 This PR happens to solve the concurrent computation issue of RRDD reported in SPARK-13178. Added a test case for it. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-180729342 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-180729224 **[Test build #50866 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50866/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-180729340 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-06 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-180748331 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-180772628 **[Test build #50870 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50870/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-180772947 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-180772941 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-02-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-180718353 **[Test build #50866 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50866/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-01-27 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-175946838 cc @davies. Thanks @sunrui for the PR. I'll review this later today --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-176018561 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-176018556 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-01-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-176017111 **[Test build #50250 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50250/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-01-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-175979066 **[Test build #50250 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50250/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-01-27 Thread sun-rui
GitHub user sun-rui opened a pull request: https://github.com/apache/spark/pull/10947 [SPARK-12792][SPARKR] Refactor RRDD to support R UDF. Refactor RRDD by separating the common logic interacting with the R worker to a new class RRunner, which can be used to evaluate R UDFs.

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-175601243 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-01-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-175601239 **[Test build #50192 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50192/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-175601244 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-01-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-175601047 **[Test build #50192 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50192/consoleFull)** for PR 10947 at commit