Hi all
I want to learn spark source code recently. Git clone spark code from
git , and exec sbt gen-idea command . import the project into intellij ,
have such error below:
Anyone could help me? Spark version is 1.4, operation system is windows
7
I am not sure what happen. According to your snapshot, it just shows warning
message instead of error. But I suggest you can try to use maven with: mvn
idea:idea.
On Monday, May 25, 2015 2:48 PM, huangzheng 1106944...@qq.com wrote:
!--#yiv0816328792 _filtered #yiv0816328792
Hi Ricardo,
instead of filtering header just remove the header of your file.
In your code you create a filter for the header but you don't use it to
compute parsedData.
val parsedData = filter_data.map(s = Vectors.dense(s.split(',').
map(_.toDouble))).cache()
2015-05-19 21:23 GMT+02:00 Stephen
Hi,
Can anybody see what's wrong in this piece of code:
./bin/spark-shell --num-executors 2 --executor-memory 512m --master yarn-client
import org.apache.spark.mllib.clustering.KMeans
import org.apache.spark.mllib.linalg.Vectors
val data = sc.textFile(/user/p_loadbd/fraude5.csv).map(x =
Hi Ricardo,
providing the error output would help . But in any case you need to do a
collect() on the rdd returned from computeCost.
2015-05-19 11:59 GMT-07:00 Ricardo Goncalves da Silva
ricardog.si...@telefonica.com:
Hi,
Can anybody see what’s wrong in this piece of code:
