I am also trying to run on Windows and will post once I am able to launch. My guess is that "by hand" it probably means manually forming the java command I.e. class path and java options and then appending right class name for worker or master.
Spark script follow hierarchy : start-master or workers which calls start-deamon which calls start-class. Each one building/appending command line or environment variables. I saw equivalent windows scripts to in latest build while I was running it on Linux. Regards, Tushar On Aug 17, 2014 8:03 AM, "Manu Suryavansh" <[email protected]> wrote: > Hi, > > I have built spark-1.0.0 on Windows using Java 7/8 and I have been able to > run several examples - here are my notes - > http://ml-nlp-ir.blogspot.com/2014/04/building-spark-on-windows-and-cloudera.html > on how to build from source and run examples in spark shell. > > > Regards, > Manu > > > On Sat, Aug 16, 2014 at 12:14 PM, Steve Lewis <[email protected]> > wrote: > >> I want to look at porting a Hadoop problem to Spark - eventually I want >> to run on a Hadoop 2.0 cluster but while I am learning and porting I want >> to run small problems in my windows box. >> I installed scala and sbt. >> I download Spark and in the spark directory can say >> mvn -Phadoop-0.23 -Dhadoop.version=0.23.7 -DskipTests clean package >> which succeeds >> I tried >> sbt/sbt assembly >> which fails with errors >> >> In the documentation >> <https://spark.apache.org/docs/latest/spark-standalone.html>it says >> >> *Note:* The launch scripts do not currently support Windows. To run a >> Spark cluster on Windows, start the master and workers by hand. >> with no indication of how to do this. >> >> I can build and run samples (say JavaWordCount) to the point where they >> fail because a master cannot be found (none is running) >> >> I want to know how to get a spark master and a slave or two running on my >> windows box so I can look at the samples and start playing with Spark >> >> Does anyone have a windows instance running?? >> Please DON'T SAY I SHOULD RUN LINUX! if it is supposed to work on >> windows someone should have tested it and be willing to state how. >> >> >> >> > > > -- > Manu Suryavansh >
