Thanks
Proust
From: Sean Owen so...@cloudera.com
To: Proust GZ Feng/China/IBM@IBMCN
Cc: user user@spark.apache.org
Date: 07/28/2015 02:20 PM
Subject:Re: NO Cygwin Support in bin/spark-class in Spark 1.4.0
It wasn't removed, but rewritten. Cygwin is just a distribution
(Main.java:74)
Thanks
Proust
From:Sean Owen so...@cloudera.com
To:Proust GZ Feng/China/IBM@IBMCN
Cc:user user@spark.apache.org
Date:07/28/2015 06:54 PM
Subject:Re: NO Cygwin Support in bin/spark-class in Spark 1.4.0
Subject:Re: NO Cygwin Support in bin/spark-class in Spark 1.4.0
Does adding back the cygwin detection and this clause make it work?
if $cygwin; then
CLASSPATH=`cygpath -wp $CLASSPATH`
fi
If so I imagine that's fine to bring back, if that's still needed.
On Tue, Jul 28, 2015 at 9:49 AM
)
at org.apache.spark.launcher.Main.main(Main.java:74)
Thanks
Proust
From:Sean Owen so...@cloudera.com
To:Proust GZ Feng/China/IBM@IBMCN
Cc:user user@spark.apache.org
Date:07/28/2015 06:54 PM
Subject:Re: NO Cygwin Support in bin/spark-class in Spark 1.4.0
Does adding back
:Sean Owen so...@cloudera.com
To:Proust GZ Feng/China/IBM@IBMCN
Cc:user user@spark.apache.org
Date:07/28/2015 02:20 PM
Subject:Re: NO Cygwin Support in bin/spark-class in Spark 1.4.0
It wasn't removed, but rewritten
there's a spark-submit.cmd file for windows. Does that work?
On 27 Jul 2015, at 21:19, Proust GZ Feng
pf...@cn.ibm.commailto:pf...@cn.ibm.com wrote:
Hi, Spark Users
Looks like Spark 1.4.0 cannot work with Cygwin due to the removing of Cygwin
support in bin/spark-class
The changeset is
It wasn't removed, but rewritten. Cygwin is just a distribution of
POSIX-related utilities so you should be able to use the normal .sh
scripts. In any event, you didn't say what the problem is?
On Tue, Jul 28, 2015 at 5:19 AM, Proust GZ Feng pf...@cn.ibm.com wrote:
Hi, Spark Users
Looks like
I agree with Sean - using virtual box on windows and using linux vm is a lot
easier than trying to circumvent the cygwin oddities. a lot of functionality
might not work in cygwin and you will end up trying to do back patches. Unless
there is a compelling reason - cygwin support seems not
That's for the Windows interpreter rather than bash-running Cygwin. I
don't know it's worth doing a lot of legwork for Cygwin, but, if it's
really just a few lines of classpath translation in one script, seems
reasonable.
On Tue, Jul 28, 2015 at 9:13 PM, Steve Loughran ste...@hortonworks.com
Hi, Spark Users
Looks like Spark 1.4.0 cannot work with Cygwin due to the removing of
Cygwin support in bin/spark-class
The changeset is
https://github.com/apache/spark/commit/517975d89d40a77c7186f488547eed11f79c1e97#diff-fdf4d3e600042c63ffa17b692c4372a3
The changeset said Add a library for
10 matches
Mail list logo
