Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/30#discussion_r10410916 --- Diff: sbin/spark-config.sh --- @@ -34,3 +34,6 @@ this="$config_bin/$script" export SPARK_PREFIX=`dirname "$this"`/.. export SPARK_HOME=${SPARK_PREFIX} export SPARK_CONF_DIR="$SPARK_HOME/conf" +# Add the PySpark classes to the PYTHONPATH: +export PYTHONPATH=$SPARK_HOME/python:$PYTHONPATH --- End diff -- Good point; I think we should move these lines to `spark-class` to make sure that workers use the right PYTHONPATH even if they're started manually through `spark-class`.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---