Re: Using Spark for Divide-and-Conquer Algorithms

2014-04-11 Thread Dean Wampler
There is a handy parallelize method for running independent computations.
The examples page (http://spark.apache.org/examples.html) on the website
uses it to estimate Pi. You can join the results at the end of the parallel
calculations.


On Fri, Apr 11, 2014 at 7:52 AM, Yanzhe Chen  wrote:

>  Hi all,
>
> Is Spark suitable for applications like Convex Hull algorithm, which has
> some classic divide-and-conquer approaches like QuickHull?
>
> More generally, Is there a way to express divide-and-conquer algorithms in
> Spark?
>
> Thanks!
>
> --
> Yanzhe Chen
> Institute of Parallel and Distributed Systems
> Shanghai Jiao Tong University
> Email: yanzhe...@gmail.com
> Sent with Sparrow 
>
>


-- 
Dean Wampler, Ph.D.
Typesafe
@deanwampler
http://typesafe.com
http://polyglotprogramming.com


Using Spark for Divide-and-Conquer Algorithms

2014-04-11 Thread Yanzhe Chen
Hi all, 

Is Spark suitable for applications like Convex Hull algorithm, which has some 
classic divide-and-conquer approaches like QuickHull?

More generally, Is there a way to express divide-and-conquer algorithms in 
Spark?

Thanks! 

-- 
Yanzhe Chen
Institute of Parallel and Distributed Systems
Shanghai Jiao Tong University
Email: yanzhe...@gmail.com
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)