Re: Does spark-ec2 support Windows?

AFAIK we've never claimed that spark-ec2 is supported on Windows -- for example in the code, we assume the existence of `ssh` as a binary on PATH etc. That said I've never tried to run it from Windows, so I am not sure if it can somehow be used. Thanks Shivaram On Sat, Jan 24, 2015 at 2:27 PM, Ni

Does spark-ec2 support Windows?

Is spark-ec2 supposed to run normally from Windows (e.g. to launch a cluster)? I ask because I don’t see mention of Windows anywhere in relation to spark-ec2, and there is an open PR that checks file permis

Project ideas for spark

Hello guys, I'm a graduate student and have to make a semester long project based on Data Intensive Computing. I'm interested in using Spark in my project so I would really appreciate if any body could suggest any project ideas related to using spark. Thank you in advance. -- View this message

Any interest in 'weighting' VectorTransformer which does component-wise scaling?

Hello, I found it useful to implement the Hadamard Product as a VectorTransformer. It can be applied to scale (by a constant) a certain dimension (column) of the data set. Since I've already implemented it and am using i

Re: spark 1.1.0 (w/ hadoop 2.4) vs aws java sdk 1.7.2

Hey Sean, I did find that after my post and tried it spark.files.userClassPathFirst = true But it is deemed in the docs as instrumental and did not work. Monitored that additional config via the logs and it did not complain ... no change though. So... Due to my timeline for a Demo