Hi all,
As a previous thread, I am asking how to implement a divide-and-conquer
algorithm (skyline) in Spark.
Here is my current solution:
val data = sc.textFile(…).map(line = line.split(“,”).map(_.toDouble))
val result = data.mapPartitions(points =
= line.split(,).map(_.toDouble))
val partialResults = data.mapPartitions(points =
skyline(points.toArray).iterator).collect() val results =
skyline(partialResults)
On Wed, Apr 16, 2014 at 1:03 AM, Yanzhe Chen yanzhe...@gmail.com
(mailto:yanzhe...@gmail.com) wrote:
Hi
Hi, all
I'm trying to build Spark in IntelliJ IDEA 13.
I clone the latest repo and run sbt/sbt gen-idea in the root folder.
Then import it into IntelliJ IDEA. Scala plugin for IntelliJ IDEA has been
installed.
Everything seems ok until I ran Build Make Project:
Information: Using javac
