Github user justinuang commented on the pull request: https://github.com/apache/spark/pull/8615#issuecomment-138326562 I think we are missing some of the references to 0.8.2.1 git grep py4j- LICENSE:For Py4J (python/lib/py4j-0.8.2.1-src.zip) bin/pyspark:export PYTHONPATH="$SPARK_HOME/python/lib/py4j-0.9-src.zip:$PYTHONPATH" bin/pyspark2.cmd:set PYTHONPATH=%SPARK_HOME%\python\lib\py4j-0.9-src.zip;%PYTHONPATH% core/src/main/scala/org/apache/spark/api/python/PythonUtils.scala: pythonPath += Seq(sparkHome, "python", "lib", "py4j-0.9-src.zip").mkString(File.separator) core/src/main/scala/org/apache/spark/deploy/PythonRunner.scala: thread.setName("py4j-gateway-init") python/docs/Makefile:export PYTHONPATH=$(realpath ..):$(realpath ../lib/py4j-0.9-src.zip) sbin/spark-config.sh:export PYTHONPATH="$SPARK_HOME/python/lib/py4j-0.8.2.1-src.zip:$PYTHONPATH" yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala: val py4jFile = new File(pyLibPath, "py4j-0.9-src.zip") yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala: "py4j-0.9-src.zip not found; cannot run pyspark application in YARN mode.") yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala: s"$sparkHome/python/lib/py4j-0.9-src.zip",
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org