Re: Hive permanent functions are not available in Spark SQL

2015-09-30 Thread Pala M Muthaia
+user list On Tue, Sep 29, 2015 at 3:43 PM, Pala M Muthaia <mchett...@rocketfuelinc.com > wrote: > Hi, > > I am trying to use internal UDFs that we have added as permanent functions > to Hive, from within Spark SQL query (using HiveContext), but i encounter > NoSuc

Hive permanent functions are not available in Spark SQL

2015-09-29 Thread Pala M Muthaia
Hi, I am trying to use internal UDFs that we have added as permanent functions to Hive, from within Spark SQL query (using HiveContext), but i encounter NoSuchObjectException, i.e. the function could not be found. However, if i execute 'show functions' command in spark SQL, the permanent

Re: Sources/pom for org.spark-project.hive

2015-08-11 Thread Pala M Muthaia
:25, Pala M Muthaia mchett...@rocketfuelinc.com wrote: Hi, I am trying to make Spark SQL 1.4 work with our internal fork of Hive. We have some customizations in Hive (custom authorization, various hooks etc) that are all part of hive-exec. Given Spark's hive dependency is through org.spark

Absence of version 1.3 of spark-assembly jar

2015-05-28 Thread Pala M Muthaia
I am looking to take dependency on spark-assembly jar, version 1.3.0, for our spark code unit tests, but it's not available on maven central (only older versions are available). Looks like it's not getting released anymore, is that right? Our internal build system prevents us from including