Re: filter rows by all columns

2017-01-17 Thread Xiaomeng Wan
;> ... >> >> But I want to turn it into a general function which can handle variable >> number of columns. How could I do that? Thanks in advance! >> >> >> Regards, >> >> Shawn >> >> -- >> View this message in context: filter rows by all columns >> <http://apache-spark-user-list.1001560.n3.nabble.com/filter-rows-by-all-columns-tp28309.html> >> Sent from the Apache Spark User List mailing list archive >> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com. >> > >

Re: filter rows by all columns

2017-01-16 Thread Hyukjin Kwon
)) > > .filter(x=>math.abs(x.get(1).toString().toDouble-means(1))<=3*stddevs( > 1)) > > ... > > But I want to turn it into a general function which can handle variable > number of columns. How could I do that? Thanks in advance! > > > Regards, > > Sh

filter rows by all columns

2017-01-16 Thread Shawn Wan
want to turn it into a general function which can handle variable number of columns. How could I do that? Thanks in advance! Regards, Shawn -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/filter-rows-by-all-columns-tp28309.html Sent from the Apache Spark User List