Re: Is it possible to use SparkSQL JDBC ThriftServer without Hive

2016-01-13 Thread Antonio Piccolboni
Thriftserver creates a HiveContext hence the hive libs, but you don't need to have Hive running at all. Depending on what you mean by "without Hive" that could be a positive or negative answer to your question. You need the dependencies, but you don't need a running instance. On Wed, Jan 13, 2016

How to access resources added with SQL: ADD FILE

2015-12-17 Thread Antonio Piccolboni
Hi, I need to access a file from a UDF. In standalone, if I add the file /tmp/somedata, it ends up in /private/tmp/somedata, as I found out keeping an eye on the logs. That is actually the same file because of a link between the directories, nothing related to spark. My expectation reading some

Re: Can't create UDF through thriftserver, no error reported

2015-12-16 Thread Antonio Piccolboni
Mmmmh, I may have been stuck with some stale lib. A complete reset of the client (when by complete I mean beyond what reason would require) solved the problem. I think we can consider this solved unless new evidence appears. Thanks! On Wed, Dec 16, 2015 at 9:16 AM Antonio Piccolboni <a

Re: Can't create UDF through thriftserver, no error reported

2015-12-16 Thread Antonio Piccolboni
/jira/browse/SPARK-11191 > > > > On Wed, Dec 16, 2015 at 3:14 AM, Antonio Piccolboni < > anto...@piccolboni.info> wrote: > >> Hi, >> I am trying to create a UDF using the thiftserver. I followed this >> example <https://gist.github.com/airawat/74

Can't create UDF through thriftserver, no error reported

2015-12-15 Thread Antonio Piccolboni
Hi, I am trying to create a UDF using the thiftserver. I followed this example , which is originally for hive. My understanding is that the thriftserver creates a hivecontext and Hive UDFs should be supported. I then sent this query to the thriftserver (I