[ https://issues.apache.org/jira/browse/SPARK-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14563488#comment-14563488 ]
Matthew Goodman commented on SPARK-7909: ---------------------------------------- Thanks for the leads. I had some major problems with the JIRA yesterday, was I alone in that? [~shivaram] Where are the worker logs stored? [~davies] I didn't see any of the RC binaries for spark in the EC2 in the s3 bucket: https://github.com/mesos/spark-ec2/blob/branch-1.4/spark/init.sh http://s3.amazonaws.com/spark-related-packages/ Is there somewhere else they are stored? I recall seeing the RC branches in github, but that appears to have just dissapeared, and the branch-1.4 no longer has a RC. Is the release happening today or some such? The first thing I did was [add the 1.3.1| https://github.com/3Scan/spark-ec2/commit/08d210dc8d44c07383e46fcd303c8f0c20828bcf] build that I found there, and try that. That didn't feature any of the py3 support, and crashes fast and early. Next I had it build from a checkout of the current master, which is where the above errors come from. To get a source build to work, I had to make [this change | https://github.com/3Scan/spark-ec2/commit/3416dd07c492b0cddcc98c4fa83f9e4284ed8fc9], and at least one other . . . to be determined following sorting out the above trace. > spark-ec2 and associated tools not py3 ready > -------------------------------------------- > > Key: SPARK-7909 > URL: https://issues.apache.org/jira/browse/SPARK-7909 > Project: Spark > Issue Type: Improvement > Components: EC2 > Environment: ec2 python3 > Reporter: Matthew Goodman > > At present there is not a possible permutation of tools that supports Python3 > on both the launching computer and running cluster. There are a couple > problems involved: > - There is no prebuilt spark binary with python3 support. > - spark-ec2/spark/init.sh contains inline py3 unfriendly print statements > - Config files for cluster processes don't seem to make it to all nodes in a > working format. > I have fixes for some of this, but the config and running context debugging > remains elusive to me. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org