Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12766116
--- Diff: bin/pyspark ---
@@ -25,6 +25,12 @@ export SPARK_HOME=$FWDIR
SCALA_VERSION=2.10
+if [[ $@ = *--help ]] || [[ $@ = *--h ]]; then
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43398854
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15065/
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43398853
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43282663
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43286838
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15036/
---
If your project
GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/799
[SPARK-1808] Route bin/pyspark through Spark submit
**Problem.** For `bin/pyspark`, there is currently no other way to specify
Spark configuration properties other than through `SPARK_JAVA_OPTS`
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/787#issuecomment-43256128
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43283363
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/787#issuecomment-43255242
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43285775
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user mateiz commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12723592
--- Diff: python/pyspark/java_gateway.py ---
@@ -34,9 +34,13 @@ def launch_gateway():
# Launch the Py4j gateway using Spark's run command so that
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43283366
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15034/
---
If your project is set up for it, you can
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/787#issuecomment-43255228
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12725383
--- Diff: python/pyspark/java_gateway.py ---
@@ -34,9 +34,13 @@ def launch_gateway():
# Launch the Py4j gateway using Spark's run command so
Github user mateiz commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12723563
--- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala ---
@@ -1166,4 +1166,16 @@ private[spark] object Utils extends Logging {
true
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12725362
--- Diff: bin/pyspark ---
@@ -25,6 +25,12 @@ export SPARK_HOME=$FWDIR
SCALA_VERSION=2.10
+if [[ $@ == *--help* ]]; then
+ echo
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43284075
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user mateiz commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12723628
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -293,8 +299,8 @@ object SparkSubmit {
}
private def
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43369307
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43365616
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43369309
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15049/
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43371649
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43286482
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15038/
---
If your project is set up for it, you can
Github user mateiz commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12760554
--- Diff: bin/pyspark ---
@@ -52,13 +58,35 @@ export
PYTHONPATH=$SPARK_HOME/python/lib/py4j-0.8.1-src.zip:$PYTHONPATH
export
Github user mateiz commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12759324
--- Diff: python/pyspark/java_gateway.py ---
@@ -76,3 +76,30 @@ def run(self):
java_import(gateway.jvm, scala.Tuple2)
return gateway
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43371650
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15050/
---
If your project
Github user mateiz commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12760581
--- Diff: bin/pyspark ---
@@ -25,6 +25,12 @@ export SPARK_HOME=$FWDIR
SCALA_VERSION=2.10
+if [[ $@ == *--help* ]]; then
--- End diff --
Github user ahirreddy commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43292344
Another thing is that when you kill the Python/IPython shell the JVM still
seems to be active. I tested this by running the shell, killing it and running
it again. It
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/787#issuecomment-43256129
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15029/
---
If your project is set up for it, you can
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12761591
--- Diff: bin/pyspark ---
@@ -52,13 +58,35 @@ export
PYTHONPATH=$SPARK_HOME/python/lib/py4j-0.8.1-src.zip:$PYTHONPATH
export
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43384288
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43286837
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43284082
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43365634
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user mateiz commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12760763
--- Diff: python/pyspark/java_gateway.py ---
@@ -76,3 +76,30 @@ def run(self):
java_import(gateway.jvm, scala.Tuple2)
return gateway
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12761541
--- Diff: bin/pyspark ---
@@ -52,13 +58,35 @@ export
PYTHONPATH=$SPARK_HOME/python/lib/py4j-0.8.1-src.zip:$PYTHONPATH
export
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43387439
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43387110
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43387112
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15053/
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43384298
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43367785
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43387432
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43389658
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user mateiz commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12759418
--- Diff: bin/pyspark ---
@@ -52,13 +58,35 @@ export
PYTHONPATH=$SPARK_HOME/python/lib/py4j-0.8.1-src.zip:$PYTHONPATH
export
Github user mateiz commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12723642
--- Diff: bin/pyspark ---
@@ -25,6 +25,12 @@ export SPARK_HOME=$FWDIR
SCALA_VERSION=2.10
+if [[ $@ == *--help* ]]; then
+ echo Usage:
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43286480
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43367475
Great catch. Looks like `--die-on-broken-pipe` was in fact not propagated
(see commit message for more details).
---
If your project is set up for it, you can reply
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43389659
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15054/
---
If your project
Github user mateiz commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12760706
--- Diff: bin/pyspark ---
@@ -52,13 +58,35 @@ export
PYTHONPATH=$SPARK_HOME/python/lib/py4j-0.8.1-src.zip:$PYTHONPATH
export
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12760990
--- Diff: python/pyspark/java_gateway.py ---
@@ -76,3 +76,30 @@ def run(self):
java_import(gateway.jvm, scala.Tuple2)
return gateway
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12727045
--- Diff: bin/pyspark ---
@@ -51,14 +57,20 @@ export
PYTHONPATH=$SPARK_HOME/python/lib/py4j-0.8.1-src.zip:$PYTHONPATH
# Load the PySpark shell.py script
Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43394087
Changes look good to me.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43393276
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43394309
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43395356
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43394310
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15058/
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43393272
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43396186
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15061/
---
If your project
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43395322
This is ready for merge from my side, provided that the tests pass (they
should).
---
If your project is set up for it, you can reply to this email and have your
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12765879
--- Diff: bin/spark-shell ---
@@ -28,7 +28,7 @@ esac
# Enter posix mode for bash
set -o posix
-if [[ $@ == *--help* ]]; then
+if [[ $@
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43396184
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43395353
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12765889
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -303,14 +309,36 @@ object SparkSubmit {
}
/**
+ *
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/799#discussion_r12765913
--- Diff: bin/pyspark ---
@@ -25,6 +25,12 @@ export SPARK_HOME=$FWDIR
SCALA_VERSION=2.10
+if [[ $@ = *--help ]] || [[ $@ = *--h ]]; then
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43396764
LGTM - a few minor comments. Mind taking a quick look
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/799
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43398156
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43398162
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/799#issuecomment-43398339
LGTM - thanks Andrew!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
69 matches
Mail list logo