Re: callUdf("percentile_approx",col("mycol"),lit(0.25)) does not compile spark 1.5.1 source but it does work in spark 1.5.1 bin

Hi Ted I checked hive-exec-1.2.1.spark.jar contains the following required classes but still it doesn't compile I don't understand why is this Jar getting overwritten in scope org/apache/hadoop/hive/ql/udf/generic/GenericUDAFPercentileApprox$GenericUDAFMultiplePercentileApproxEvaluator.class

Re: callUdf("percentile_approx",col("mycol"),lit(0.25)) does not compile spark 1.5.1 source but it does work in spark 1.5.1 bin

Umesh: $ jar tvf /home/hbase/.m2/repository/org/spark-project/hive/hive-exec/1.2.1.spark/hive-exec-1.2.1.spark.jar | grep GenericUDAFPercentile 2143 Fri Jul 31 23:51:48 PDT 2015 org/apache/hadoop/hive/ql/udf/generic/GenericUDAFPercentileApprox$1.class 4602 Fri Jul 31 23:51:48 PDT 2015

Re: callUdf("percentile_approx",col("mycol"),lit(0.25)) does not compile spark 1.5.1 source but it does work in spark 1.5.1 bin

The udf is defined in GenericUDAFPercentileApprox of hive. When spark-shell runs, it has access to the above class which is packaged in assembly/target/scala-2.10/spark-assembly-1.6.0-SNAPSHOT-hadoop2.7.0.jar : 2143 Fri Oct 16 15:02:26 PDT 2015

Re: callUdf("percentile_approx",col("mycol"),lit(0.25)) does not compile spark 1.5.1 source but it does work in spark 1.5.1 bin

Thanks much Ted so when do we get to use this sparkUdf in Java code using maven code dependencies?? You said JIRA 10671 is not pushed as part of 1.5.1 so it should be released in 1.6.0 as mentioned in the JIRA right? On Sun, Oct 18, 2015 at 9:20 PM, Ted Yu wrote: > The udf