Great! Thank you!
________________________________ From: Reynold Xin [mailto:[email protected]] Sent: Thursday, April 02, 2015 8:11 AM To: Haopu Wang Cc: user; [email protected] Subject: Re: Can I call aggregate UDF in DataFrame? You totally can. https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/ apache/spark/sql/DataFrame.scala#L792 There is also an attempt at adding stddev here already: https://github.com/apache/spark/pull/5228 On Thu, Mar 26, 2015 at 12:37 AM, Haopu Wang <[email protected]> wrote: Specifically there are only 5 aggregate functions in class org.apache.spark.sql.GroupedData: sum/max/min/mean/count. Can I plugin a function to calculate stddev? Thank you! --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
