[jira] [Updated] (SPARK-2693) Support for UDAF Hive Aggregates like PERCENTILE
[ https://issues.apache.org/jira/browse/SPARK-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2693: Priority: Critical (was: Major) > Support for UDAF Hive Aggregates like PERCENTILE > > > Key: SPARK-2693 > URL: https://issues.apache.org/jira/browse/SPARK-2693 > Project: Spark > Issue Type: Bug > Components: SQL >Reporter: Michael Armbrust >Assignee: Ravindra Pesala >Priority: Critical > > {code} > SELECT MIN(field1), MAX(field2), AVG(field3), PERCENTILE(field4), > year,month,day FROM raw_data_table GROUP BY year, month, day > MIN, MAX and AVG functions work fine for me, but with PERCENTILE, I get an > error as shown below. > Exception in thread "main" java.lang.RuntimeException: No handler for udf > class org.apache.hadoop.hive.ql.udf.UDAFPercentile > at scala.sys.package$.error(package.scala:27) > at > org.apache.spark.sql.hive.HiveFunctionRegistry$.lookupFunction(hiveUdfs.scala:69) > at > org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveFunctions$$anonfun$apply$4$$anonfun$applyOrElse$3.applyOrElse(Analyzer.scala:115) > at > org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveFunctions$$anonfun$apply$4$$anonfun$applyOrElse$3.applyOrElse(Analyzer.scala:113) > at > org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:165) > {code} > This aggregate extends UDAF, which we don't yet have a wrapper for. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-2693) Support for UDAF Hive Aggregates like PERCENTILE
[ https://issues.apache.org/jira/browse/SPARK-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2693: Assignee: Ravindra Pesala > Support for UDAF Hive Aggregates like PERCENTILE > > > Key: SPARK-2693 > URL: https://issues.apache.org/jira/browse/SPARK-2693 > Project: Spark > Issue Type: Bug > Components: SQL >Reporter: Michael Armbrust >Assignee: Ravindra Pesala > > {code} > SELECT MIN(field1), MAX(field2), AVG(field3), PERCENTILE(field4), > year,month,day FROM raw_data_table GROUP BY year, month, day > MIN, MAX and AVG functions work fine for me, but with PERCENTILE, I get an > error as shown below. > Exception in thread "main" java.lang.RuntimeException: No handler for udf > class org.apache.hadoop.hive.ql.udf.UDAFPercentile > at scala.sys.package$.error(package.scala:27) > at > org.apache.spark.sql.hive.HiveFunctionRegistry$.lookupFunction(hiveUdfs.scala:69) > at > org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveFunctions$$anonfun$apply$4$$anonfun$applyOrElse$3.applyOrElse(Analyzer.scala:115) > at > org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveFunctions$$anonfun$apply$4$$anonfun$applyOrElse$3.applyOrElse(Analyzer.scala:113) > at > org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:165) > {code} > This aggregate extends UDAF, which we don't yet have a wrapper for. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org