Matthew Hayes created DATAFU-153:
------------------------------------
Summary: datafu-spark tests fail with Python 3
Key: DATAFU-153
URL: https://issues.apache.org/jira/browse/DATAFU-153
Project: DataFu
Issue Type: Bug
Reporter: Matthew Hayes
When local Python version is 3.x, there is an error thrown from
SparkPythonRunner due to execfile not being in Python 3. The tests work for
Python 2.7.
{code:java}
java.lang.RuntimeException: python bridge error:
Python 3.6.0 (default, Jun 6 2018, 13:47:36)
[GCC 4.2.1 Compatible Apple LLVM 9.1.0 (clang-902.0.39.2)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> >>> ... ... ... ... ... ... Traceback (most recent call last):
File "<stdin>", line 2, in <module>
NameError: name 'execfile' is not defined
at
org.apache.spark.datafu.deploy.SparkPythonRunner.execFile(SparkPythonRunner.scala:134)
at
org.apache.spark.datafu.deploy.SparkPythonRunner.runPyFile(SparkPythonRunner.scala:49)
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
