[ https://issues.apache.org/jira/browse/SPARK-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14562161#comment-14562161 ]
Shivaram Venkataraman commented on SPARK-7909: ---------------------------------------------- Could you check the worker logs to figure out why the executors were dying ? Also regarding the points described in the JIRA 1. Regd. pre-built Spark binary, I think Spark 1.4 will be Python3 friendly, but [~davies] might be able to confirm 2. I am not sure how print statements in shell script can interfere with Python3 (cc [~nchammas] who knows more than me about Python 3) > spark-ec2 and associated tools not py3 ready > -------------------------------------------- > > Key: SPARK-7909 > URL: https://issues.apache.org/jira/browse/SPARK-7909 > Project: Spark > Issue Type: Improvement > Components: EC2 > Environment: ec2 python3 > Reporter: Matthew Goodman > > At present there is not a possible permutation of tools that supports Python3 > on both the launching computer and running cluster. There are a couple > problems involved: > - There is no prebuilt spark binary with python3 support. > - spark-ec2/spark/init.sh contains inline py3 unfriendly print statements > - Config files for cluster processes don't seem to make it to all nodes in a > working format. > I have fixes for some of this, but the config and running context debugging > remains elusive to me. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org