spark SQL thrift server - support for more features via jdbc (table catalog)

2015-10-21 Thread rkrist
Hello, there seems to be missing support for some operations in spark SQL thrift server. To be more specific - when connected to our spark SQL instance (1.5.1, standallone deployment) from standard jdbc sql client (squirrel SQL and few others) via the thrift server, sql query processing seem to

ClassCastException processing date fields using spark SQL since 1.3.0

2015-04-16 Thread rkrist
Hello guys, after upgrading spark to 1.3.0 (and performing necessary code changes) an issue appeared making me unable to handle Date fields (java.sql.Date) with Spark SQL module. An exception appears in the console when I try to execute and SQL query on a DataFrame (see below). When I tried to

Re: ClassCastException processing date fields using spark SQL since 1.3.0

2015-04-16 Thread rkrist
...one additional note: implementation of org.apache.spark.sql.columnar.IntColumnStats is IMHO wrong. Small hint - what will be the resulting upper and lower values for column containing no data (empty RDD or null values in Int column across the whole RDD)? Shouldn't they be null? -- View