GitHub user zjffdu reopened a pull request:
https://github.com/apache/spark/pull/13146
[SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonExec of driver and
executor through confâ¦
## What changes were proposed in this pull request?
Before this PR, user have to export environment variable to specify the
python of driver & executor which is not so convenient for users. This PR is
trying to allow user to specify python through configuration
"--pyspark-driver-python" & "--pyspark-executor-python"
## How was this patch tested?
Manually test in local & yarn mode for pyspark-shell and pyspark batch
mode.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zjffdu/spark SPARK-13081
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/13146.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #13146
----
commit 2c5db40958cf24de93951b00c0f69df756ace04e
Author: Jeff Zhang <zjf...@apache.org>
Date: 2016-05-17T08:07:06Z
[SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonExec of driver and
executor through configuration
commit 36a52d9959a026856ff1841dc060673d83cd9de8
Author: Jeff Zhang <zjf...@apache.org>
Date: 2016-05-17T12:14:42Z
address test failure
commit 735ab4d584efa3d023ee4619145d7a76504ba8f5
Author: Jeff Zhang <zjf...@apache.org>
Date: 2016-05-18T01:09:07Z
remove blank line
commit 9bcb35a0846af7d81290f0ef77d63a873049631b
Author: Jeff Zhang <zjf...@apache.org>
Date: 2016-06-22T06:14:16Z
fix typo
commit 0a6a96c11ac1a0ba0d5b5b6689f9b3094920dede
Author: Jeff Zhang <zjf...@apache.org>
Date: 2016-07-06T20:49:29Z
remove --pyspark-driver-python and --pyspark-executor-python
commit 8119f6ded867a8b2e0b212f3247f52278b9e8c28
Author: Jeff Zhang <zjf...@apache.org>
Date: 2016-08-09T01:59:15Z
address comments
commit 551a0cce72db26838fe74c15bb4340ec8723b19e
Author: Jeff Zhang <zjf...@apache.org>
Date: 2016-08-09T23:43:03Z
address comments
commit 1a39dc59b2a99e2befc0cf8dedc46476933b81e2
Author: Jeff Zhang <zjf...@apache.org>
Date: 2016-08-10T23:25:48Z
fix code style
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
