;> ...
>>
>> But I want to turn it into a general function which can handle variable
>> number of columns. How could I do that? Thanks in advance!
>>
>>
>> Regards,
>>
>> Shawn
>>
>> --
>> View this message in context: filter rows by all columns
>> <http://apache-spark-user-list.1001560.n3.nabble.com/filter-rows-by-all-columns-tp28309.html>
>> Sent from the Apache Spark User List mailing list archive
>> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
>>
>
>
))
>
> .filter(x=>math.abs(x.get(1).toString().toDouble-means(1))<=3*stddevs(
> 1))
>
> ...
>
> But I want to turn it into a general function which can handle variable
> number of columns. How could I do that? Thanks in advance!
>
>
> Regards,
>
> Sh
want to turn it into a general function which can handle variable
number of columns. How could I do that? Thanks in advance!
Regards,
Shawn
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/filter-rows-by-all-columns-tp28309.html
Sent from the Apache Spark User List