[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-13 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-120893058 @shivaram , tests done. Also tested with YARN cluster, yarn-client, standalone, createDataFrame() in YARN client mode. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-120874020 [Test build #37127 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37127/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-120874138 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-13 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-120964954 Thanks @sun-rui - LGTM. Merging this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-13 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-121062575 @sun-rui Could you close this PR ? Looks like Github PRs are not being closed due to an infrastructure issue https://issues.apache.org/jira/browse/INFRA-9988 --- If

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-121071932 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-13 Thread sun-rui
Github user sun-rui closed the pull request at: https://github.com/apache/spark/pull/6743 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-13 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-121103339 @shivaram, close the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-120835658 [Test build #37127 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37127/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-120835478 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-120835489 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-10 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-120510410 @sun-rui could you rebase this? There are conflicts now. @shivaram does the R side look good to you? If so feel free to merge it. --- If your project is set up for

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-10 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-120538848 Yeah R code looks fine to me. However as this changes some fundamental things with how we locate the package, @sun-rui it will be great if you could confirm the two or

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119526680 [Test build #36780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36780/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119547913 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119559185 The unit test failure: [info] - Single command with -e *** FAILED *** (2 minutes, 18 seconds) [info] java.util.concurrent.TimeoutException: Futures timed out

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119547878 [Test build #36780 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36780/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119519835 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119519707 [Test build #36765 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36765/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119525448 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119525432 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119623855 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119624723 [Test build #36801 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36801/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119623882 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119623370 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119669949 [Test build #36801 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36801/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119670853 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119670380 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119671638 [Test build #36804 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36804/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119670009 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119670883 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119709529 [Test build #36804 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36804/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119709670 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119460146 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119460116 [Test build #36758 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36758/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119468307 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119468337 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119468802 [Test build #36765 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36765/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r34061074 --- Diff: project/MimaExcludes.scala --- @@ -81,6 +81,10 @@ object MimaExcludes { org.apache.spark.mllib.linalg.Matrix.numNonzeros),

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119264311 @sun-rui OK not a problem. I think this is ready to go once it passes tests. LGTM! --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119160869 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119160861 [Test build #36675 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36675/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119169878 rebased --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119169983 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119159618 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119159738 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119161819 @andrewor14, I did a modification on your proposed code because when sparkRPackagePath() is called on executors, Most of the Spark conf properties can't be accessed

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119160453 [Test build #36675 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36675/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119198747 [Test build #36678 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36678/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119200840 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119198167 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119200820 [Test build #36678 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36678/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119432781 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119433552 [Test build #36758 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36758/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119423486 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119423495 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119427632 [Test build #36755 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36755/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119427659 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119432827 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-119424280 [Test build #36755 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36755/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-118824907 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-118828773 [Test build #36575 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36575/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-118825987 [Test build #36575 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36575/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-118824890 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-118828790 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-118848571 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-118848598 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-118849203 [Test build #36577 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36577/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-118852214 [Test build #36577 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36577/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-118852242 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-06 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-118956440 @sun-rui you could just copy and paste the error message in the test output to `MimaExcludes`. For instance, you should add the following line there: ```

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-06 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-118910150 BTW if we are changing the RRDD constructor we should add a MimaExcludes for it to make the tests pass. @andrewor14 or @davies can probably give more information about

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r33700035 --- Diff: core/src/main/scala/org/apache/spark/api/r/RUtils.scala --- @@ -0,0 +1,55 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r33702574 --- Diff: core/src/main/scala/org/apache/spark/api/r/RUtils.scala --- @@ -0,0 +1,44 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r33702691 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -339,6 +341,23 @@ object SparkSubmit { } } +

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r33702831 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -339,6 +341,23 @@ object SparkSubmit { } } +

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r33699978 --- Diff: core/src/main/scala/org/apache/spark/api/r/RUtils.scala --- @@ -0,0 +1,55 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r33702512 --- Diff: core/src/main/scala/org/apache/spark/api/r/RUtils.scala --- @@ -0,0 +1,55 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117761971 @sun-rui this looks pretty close. I left a suggestion to rewrite a method for readability, but functionally it looks good. Have you had a chance to test this on a

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r33654496 --- Diff: core/src/main/scala/org/apache/spark/api/r/RUtils.scala --- @@ -0,0 +1,55 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117882360 Not yet -- As a part of #7139 @brkyvz is adding support for installing Spark packages with R code from source. We can then extend that to install CRAN R packages as

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117859704 @andrewor14, I have tested this patch with a real YARN cluster. For an R program, it can source other R files and call functions within them, or it can

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r33738526 --- Diff: core/src/main/scala/org/apache/spark/api/r/RUtils.scala --- @@ -0,0 +1,55 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r33737682 --- Diff: core/src/main/scala/org/apache/spark/api/r/RUtils.scala --- @@ -0,0 +1,55 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-07-01 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r33739229 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -339,6 +341,23 @@ object SparkSubmit { } } +

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117062488 [Test build #36120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36120/consoleFull) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117063382 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117063367 [Test build #36120 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36120/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117061151 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117061208 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117084185 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117084297 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117090299 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117097977 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117097943 [Test build #36122 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36122/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117101678 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117101652 [Test build #36123 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36123/console) for PR 6743 at commit

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117240152 @sun-rui The reason this patch keeps failing the MiMa tests is that we are modifying the constructor of RRDD which is a Developer API if I am not wrong. Anyways that

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/6743#discussion_r33555215 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -339,6 +340,24 @@ object SparkSubmit { } } +

[GitHub] spark pull request: [SPARK-6797][SPARKR] Add support for YARN clus...

2015-06-30 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6743#issuecomment-117094686 [Test build #36123 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36123/consoleFull) for PR 6743 at commit

  1   2   >