Hello,
Is there in built function for getting median and standard deviation in
spark sql? Currently I am converting the schemaRdd to DoubleRdd and calling
doubleRDD.stats(). But still it does not have median.
What is the most efficient way to get the median?
Thanks Regards
Tridib
--
View
. */
def stdev(): Double = stats().stdev
Cheers
On Wed, Mar 4, 2015 at 10:51 AM, tridib tridib.sama...@live.com wrote:
Hello,
Is there in built function for getting median and standard deviation in
spark sql? Currently I am converting the schemaRdd to DoubleRdd and calling
doubleRDD.stats