RE: Hive on Spark VS Spark SQL

2015-05-20 Thread Dragga, Christopher
While I've not experimented with the most recent versions of SparkSQL, earlier releases could not cope with intermediate result sets that exceeded the available memory; Hive handles this sort of situation much more gracefully. If you have a smallish cluster and large data, this could pose a pro

RE: basic, dumb getting started question (single-node)

2014-11-13 Thread Dragga, Christopher
Alternatively, for hive-site.xml, you can create an empty XML file with just the header and a set of configuration tags () and only fill in those properties that you want to change; Hive will then use the defaults for everything else. Either approach works. -Chris Dragga From: Ritesh Kumar Si

Null pointer error with UNION ALL on partitioned tables

2014-08-15 Thread Dragga, Christopher
Hi- I'm using Hive 0.13.1 on Tez and running into an odd null pointer error. If I run a query of the form SELECT foo, bar FROM a UNION ALL SELECT foo, bar FROM b; where either a or b is an empty table partitioned on a single key (neither foo nor bar), Hive exits with the message "FAILED: Null