RE: K-nearest neighbors search in Spark

2014-05-28 Thread Carter
Hi Andrew, Thank you for your info. I will have a look at these links. Thanks, Carter Date: Tue, 27 May 2014 09:06:02 -0700 From: ml-node+s1001560n6436...@n3.nabble.com To: gyz...@hotmail.com Subject: Re: K-nearest neighbors search in Spark Hi Carter, In Spark 1.0 there will be an

RE: K-nearest neighbors search in Spark

2014-05-28 Thread Carter
Hi Krishna, Thank you very much for your code. I will use it as a good start point. Thanks, Carter Date: Tue, 27 May 2014 16:42:39 -0700 From: ml-node+s1001560n6455...@n3.nabble.com To: gyz...@hotmail.com Subject: Re: K-nearest neighbors search in Spark Carter, Just as a quick

Re: K-nearest neighbors search in Spark

2014-05-27 Thread Krishna Sankar
) } dist.foreach(println(_)) // sort this for topK // } } data01.csv 1,68,93 2,12,90 3,45,76 4,86,54 HTH. Cheers On Tue, May 27, 2014 at 4:10 AM, Carter wrote: > Any suggestion is very much appreciated. > > > > -- > View this message in context:

Re: K-nearest neighbors search in Spark

2014-05-27 Thread Andrew Ash
t: > http://apache-spark-user-list.1001560.n3.nabble.com/K-nearest-neighbors-search-in-Spark-tp6393p6421.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >

Re: K-nearest neighbors search in Spark

2014-05-27 Thread Carter
Any suggestion is very much appreciated. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/K-nearest-neighbors-search-in-Spark-tp6393p6421.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

K-nearest neighbors search in Spark

2014-05-26 Thread Carter
Hi all,I want to implement a basic K-nearest neighbors search in Spark, but I am totally new to Scala so don't know where to start with.My data consists of millions of points. For each point, I need to compute its Euclidean distance to the other points, and return the top-K points that are cl