Re: [SparkSQL] Function parity with Shark?

2014-10-06 Thread Yana Kadiyska
I have created https://issues.apache.org/jira/browse/SPARK-3814 https://issues.apache.org/jira/browse/SPARK-3815 Will probably try my hand at 3814, seems like a good place to get started... On Fri, Oct 3, 2014 at 3:06 PM, Michael Armbrust wrote: > Thanks for digging in! These both look like t

Re: [SparkSQL] Function parity with Shark?

2014-10-03 Thread Michael Armbrust
Thanks for digging in! These both look like they should have JIRAs. On Fri, Oct 3, 2014 at 8:14 AM, Yana Kadiyska wrote: > Thanks -- it does appear that I misdiagnosed a bit: case works generally > but it doesn't seem to like the bit operation, which does not seem to work > (type of bit_field i

Re: [SparkSQL] Function parity with Shark?

2014-10-03 Thread Yana Kadiyska
Thanks -- it does appear that I misdiagnosed a bit: case works generally but it doesn't seem to like the bit operation, which does not seem to work (type of bit_field in Hive is bigint): Error: java.lang.RuntimeException: Unsupported language features in query: select (case when bit_field & 1=1 th

Re: [SparkSQL] Function parity with Shark?

2014-10-02 Thread Michael Armbrust
What are the errors you are seeing. All of those functions should work. On Thu, Oct 2, 2014 at 6:56 AM, Yana Kadiyska wrote: > Hi, in an effort to migrate off of Shark I recently tried the Thrift JDBC > server that comes with Spark 1.1.0. > > However I observed that conditional functions do not

[SparkSQL] Function parity with Shark?

2014-10-02 Thread Yana Kadiyska
Hi, in an effort to migrate off of Shark I recently tried the Thrift JDBC server that comes with Spark 1.1.0. However I observed that conditional functions do not work (I tried 'case' and 'coalesce') some string functions like 'concat' also did not work. Is there a list of what's missing or a ro