Re: Running LocalClusterSparkContext

2015-04-03 Thread Marcelo Vanzin
When was the last time you pulled? That should have been fixed as part of SPARK-6473. Notice latest master suffers from SPARK-6673 on Windows. On Fri, Apr 3, 2015 at 12:21 PM, Ulanov, Alexander alexander.ula...@hp.com wrote: Hi, I am trying to execute unit tests with LocalClusterSparkContext

RE: Running LocalClusterSparkContext

2015-04-03 Thread Ulanov, Alexander
Thank you so much! It allows me to proceed and Spark started to execute my code. I use sc.textFile and Spark crashes on it: 15/04/03 15:15:21.572 sparkDriver-akka.actor.default-dispatcher-4 INFO SparkDeploySchedulerBackend: Registered executor:

Windows CI infra

2015-04-03 Thread Nicholas Chammas
I've seen other projects use Appveyor http://www.appveyor.com/ for CI on Windows. Has anyone used them before? I've seen on more than one occasion something break on Windows without us knowing, so it might be worth looking into using something like this if it's relatively straightforward. Nick

Wrong initial bias in GraphX SVDPlusPlus?

2015-04-03 Thread Michael Malak
I believe that in the initialization portion of GraphX SVDPlusPluS, the initialization of biases is incorrect. Specifically, in line https://github.com/apache/spark/blob/master/graphx/src/main/scala/org/apache/spark/graphx/lib/SVDPlusPlus.scala#L96 instead of (vd._1, vd._2, msg.get._2 /