Re: distributed computation of median

2017-04-18 Thread pavan adukuri
Do you know of any python implementation for the same? thanks pavan On 4/17/17, 9:54 AM, svjk24 wrote: Hello, Is there any interest in an efficient distributed computation of the median algorithm? A google search pulls some stackoverflow discussion but it would be good to have one provided

Re: distributed computation of median

2017-04-17 Thread Koert Kuipers
g/t-digest > > > > > -- > View this message in context: http://apache-spark- > developers-list.1001551.n3.nabble.com/distributed-computation-of-median- > tp21356p21357.html > Sent from

Re: distributed computation of median

2017-04-17 Thread Reynold Xin
The DataFrame API includes an approximate quartile implementation. If you ask for quantile 0.5, you will get approximate median. On Sun, Apr 16, 2017 at 9:24 PM svjk24 <svj...@gmail.com> wrote: > Hello, > Is there any interest in an efficient distributed computation of the > m

Re: distributed computation of median

2017-04-17 Thread Jason White
. https://github.com/tdunning/t-digest -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/distributed-computation-of-median-tp21356p21357.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com

distributed computation of median

2017-04-16 Thread svjk24
Hello, Is there any interest in an efficient distributed computation of the median algorithm? A google search pulls some stackoverflow discussion but it would be good to have one provided. I have an implementation (that could be improved) from the paper " Fast Computation of the M