PySpark - Hive Context Does Not Return Results but SQL Context Does for Similar Query.

2015-10-14 Thread charles.drotar
I have duplicated my submission to stack overflow below since it is exactly the same question I would like to post here as well. Please don't judge me too harshly for my laziness *The questions I

Re: PySpark - Hive Context Does Not Return Results but SQL Context Does for Similar Query.

2015-10-14 Thread Michael Armbrust
No link to the original stack overflow so I can up my reputation? :) This is likely not a difference between HiveContext/SQLContext, but instead a difference between a table where the metadata is coming from the HiveMetastore vs the SparkSQL Data Source API. I would guess that if you create the