graph reduceByKey

2014-08-05 Thread Omer Holzinger
Hey all! I'm a total beginner with spark / hadoop / graph computation so please excuse my beginner question. I've created a graph, using graphx. Now, for every vertex, I want to get all its second degree neighbors. so if my graph is: v1 -- v2 v1 -- v4 v1 -- v6 I want to get something like: v2

Problem running Spark shell (1.0.0) on EMR

2014-08-05 Thread Omer Holzinger
I'm having similar problem to: http://mail-archives.apache.org/mod_mbox/spark-user/201407.mbox/browser I'm trying to follow the tutorial at: When I run: val file = sc.textFile(s3://bigdatademo/sample/wiki/) I get: WARN storage.BlockManager: Putting block broadcast_1 failed