OK I tried your build -
First you need to put spt in C:\sbt
Then you get
Microsoft Windows [Version 6.2.9200]
(c) 2012 Microsoft Corporation. All rights reserved.
e:\>which java
/cygdrive/c/Program Files/Java/jdk1.6.0_25/bin/java
e:\>java -version
java version "1.6.0_25"
Java(TM) SE Runtime Environment (build 1.6.0_25-b06)
e:\spark>sbt_opt.bat
e:\spark>set SCRIPT_DIR=C:\sbt\
e:\spark>java -Xms512m -Xmx2g -Xss1M -XX:+CMSClassUnloadingEnabled
-XX:MaxPermSize=128m -jar "C:\sbt\sbt-launch.jar"
[ERROR] Terminal initialization failed; falling back to unsupported
java.lang.IncompatibleClassChangeError: Found class jline.Terminal, but
interface was expected
at jline.TerminalFactory.create(TerminalFactory.java:101)
at jline.TerminalFactory.get(TerminalFactory.java:159)
at sbt.ConsoleLogger$.ansiSupported(ConsoleLogger.scala:86)
at sbt.ConsoleLogger$.<init>(ConsoleLogger.scala:80)
at sbt.ConsoleLogger$.<clinit>(ConsoleLogger.scala)
at sbt.GlobalLogging$.initial(GlobalLogging.scala:40)
at sbt.StandardMain$.initialGlobalLogging(Main.scala:64)
at sbt.StandardMain$.initialState(Main.scala:73)
at sbt.xMain.run(Main.scala:29)
at xsbt.boot.Launch$.run(Launch.scala:55)
at xsbt.boot.Launch$$anonfun$explicit$1.apply(Launch.scala:45)
at xsbt.boot.Launch$.launch(Launch.scala:69)
at xsbt.boot.Launch$.apply(Launch.scala:16)
at xsbt.boot.Boot$.runImpl(Boot.scala:31)
at xsbt.boot.Boot$.main(Boot.scala:20)
at xsbt.boot.Boot.main(Boot.scala)
java.lang.IncompatibleClassChangeError: JLine incompatibility detected.
Check that the sbt launcher is version 0.13.x or later.
at sbt.ConsoleLogger$.ansiSupported(ConsoleLogger.scala:97)
at sbt.ConsoleLogger$.<init>(ConsoleLogger.scala:80)
at sbt.ConsoleLogger$.<clinit>(ConsoleLogger.scala)
at sbt.GlobalLogging$.initial(GlobalLogging.scala:40)
at sbt.StandardMain$.initialGlobalLogging(Main.scala:64)
at sbt.StandardMain$.initialState(Main.scala:73)
at sbt.xMain.run(Main.scala:29)
at xsbt.boot.Launch$.run(Launch.scala:55)
at xsbt.boot.Launch$$anonfun$explicit$1.apply(Launch.scala:45)
at xsbt.boot.Launch$.launch(Launch.scala:69)
at xsbt.boot.Launch$.apply(Launch.scala:16)
at xsbt.boot.Boot$.runImpl(Boot.scala:31)
at xsbt.boot.Boot$.main(Boot.scala:20)
at xsbt.boot.Boot.main(Boot.scala)
Error during sbt execution: java.lang.IncompatibleClassChangeError: JLine
incompatibility detected. Check that the sbt launcher is version 0.13.x or
later.
I believe my version of sbt is -.0.13
Finally even if I could build Spark I still don't see how to launch a server
On Sat, Aug 16, 2014 at 7:33 PM, Manu Suryavansh <suryavanshi.m...@gmail.com
> wrote:
> Hi,
>
> I have built spark-1.0.0 on Windows using Java 7/8 and I have been able to
> run several examples - here are my notes -
> http://ml-nlp-ir.blogspot.com/2014/04/building-spark-on-windows-and-cloudera.html
> on how to build from source and run examples in spark shell.
>
>
> Regards,
> Manu
>
>
> On Sat, Aug 16, 2014 at 12:14 PM, Steve Lewis <lordjoe2...@gmail.com>
> wrote:
>
>> I want to look at porting a Hadoop problem to Spark - eventually I want
>> to run on a Hadoop 2.0 cluster but while I am learning and porting I want
>> to run small problems in my windows box.
>> I installed scala and sbt.
>> I download Spark and in the spark directory can say
>> mvn -Phadoop-0.23 -Dhadoop.version=0.23.7 -DskipTests clean package
>> which succeeds
>> I tried
>> sbt/sbt assembly
>> which fails with errors
>>
>> In the documentation
>> <https://spark.apache.org/docs/latest/spark-standalone.html>it says
>>
>> *Note:* The launch scripts do not currently support Windows. To run a
>> Spark cluster on Windows, start the master and workers by hand.
>> with no indication of how to do this.
>>
>> I can build and run samples (say JavaWordCount) to the point where they
>> fail because a master cannot be found (none is running)
>>
>> I want to know how to get a spark master and a slave or two running on my
>> windows box so I can look at the samples and start playing with Spark
>>
>> Does anyone have a windows instance running??
>> Please DON'T SAY I SHOULD RUN LINUX! if it is supposed to work on
>> windows someone should have tested it and be willing to state how.
>>
>>
>>
>>
>
>
> --
> Manu Suryavansh
>
--
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com
