[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-12-02 Thread roji
Github user roji commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-65195595 Sorry for dropping out, was involved in other things. @mateiz, I'll take a look at your suggestions in the coming week. --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-12-01 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-65169491 Any update here? I think this would be a great feature to have, but perhaps we should close this issue until it is ready to review (to make the size of the PR queue a l

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-09-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-54694487 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-27 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-53638130 Actually I notice that there's code for this in our `sbt/sbt` script, though it may be specific for finding directories. Take a look at that. --- If your project is set u

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-27 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-53634025 It would be nice if you found some best practice way of doing this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-27 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-53633816 Actually I spoke too soon, this fix doesn't seem to work with symlinks to relative paths. You can do ``` cd spark ln -s bin/spark-shell spark-shell ```

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-27 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-53633364 Hey @roji, actually I looked at this and I notice that `-h` on the `[` command is deprecated and replaced by `-L`. Mind changing that in the code? Otherwise it looks good.

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-53630144 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/19315/consoleFull) for PR 1875 at commit [`ccbc6e5`](https://github.com/a

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-53618994 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/19315/consoleFull) for PR 1875 at commit [`ccbc6e5`](https://github.com/ap

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-27 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-53618008 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-27 Thread roji
Github user roji commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-53570312 Rebased on master and squashed to a single commit, hope all is well now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-25 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-53299005 Yes, your patch no longer merges on master. Please rebase it onto the master branch. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-25 Thread roji
Github user roji commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-53233815 Um, am not sure, did something actually go wrong here? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If you

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-5203 QA results for PR 1875:- This patch FAILED unit tests.For more information see test ouptut:https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18953/consol

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-52777692 QA tests have started for PR 1875. This patch DID NOT merge cleanly! View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18953/consoleFull

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-20 Thread roji
Github user roji commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-52777250 @mateiz, added a commit for the sbin scripts. In general the scripts could use a bit of cleanup - the bin and sbin scripts work a bit differently, the sbin-specific

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-13 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-52083943 Yup, please fix those too. I think this is useful to have. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-11 Thread roji
Github user roji commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-51799530 Have just noticed the additional scripts under sbin, which also require treatment. Just before I go ahead and work on that, can you confirm this is a desirable PR? --- If

[GitHub] spark pull request: [SPARK-2960] Support executing Spark from syml...

2014-08-10 Thread roji
Github user roji commented on the pull request: https://github.com/apache/spark/pull/1875#issuecomment-51736839 @mateiz, thanks for the attention. Have opened an issue for this. May I suggest you guys update the contribution guide to specify that an issue be opened alongside p