No, analytic and window functions do not work yet. On Tue, Oct 21, 2014 at 3:00 AM, Pierre B < pierre.borckm...@realimpactanalytics.com> wrote:
> Hi! > > The RANK function is available in hive since version 0.11. > When trying to use it in SparkSQL, I'm getting the following exception > (full > stacktrace below): > java.lang.ClassCastException: > org.apache.hadoop.hive.ql.udf.generic.GenericUDAFRank$RankBuffer cannot be > cast to > > org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator$AbstractAggregationBuffer > > Is this function supposed to be available? > > Thanks > > P. > > --- > > > java.lang.ClassCastException: > org.apache.hadoop.hive.ql.udf.generic.GenericUDAFRank$RankBuffer cannot be > cast to > > org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator$AbstractAggregationBuffer > at > org.apache.spark.sql.hive.HiveUdafFunction.<init>(hiveUdfs.scala:334) > at > org.apache.spark.sql.hive.HiveGenericUdaf.newInstance(hiveUdfs.scala:233) > at > org.apache.spark.sql.hive.HiveGenericUdaf.newInstance(hiveUdfs.scala:207) > at > org.apache.spark.sql.execution.Aggregate.org > $apache$spark$sql$execution$Aggregate$$newAggregateBuffer(Aggregate.scala:97) > at > > org.apache.spark.sql.execution.Aggregate$$anonfun$execute$1$$anonfun$6.apply(Aggregate.scala:129) > at > > org.apache.spark.sql.execution.Aggregate$$anonfun$execute$1$$anonfun$6.apply(Aggregate.scala:128) > at org.apache.spark.rdd.RDD$$anonfun$13.apply(RDD.scala:596) > at org.apache.spark.rdd.RDD$$anonfun$13.apply(RDD.scala:596) > at > org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35) > at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:262) > at org.apache.spark.rdd.RDD.iterator(RDD.scala:229) > at org.apache.spark.rdd.MappedRDD.compute(MappedRDD.scala:31) > at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:262) > at org.apache.spark.rdd.RDD.iterator(RDD.scala:229) > at > org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:62) > at org.apache.spark.scheduler.Task.run(Task.scala:54) > at > org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:177) > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/SQL-Is-RANK-function-supposed-to-work-in-SparkSQL-1-1-0-tp16909.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
