Hi All,I have used a hiveContext.sql() to join a temporary table created from Dataframe and parquet tables created in Hive.
The join query runs fine for few hours and then suddenly fails to do the Join. Once the issue happens the dataframe returned from hiveContext.sql() is empty. If I restart the job, things starts working again.
If anyone has faced this type of issue, please suggest I am using spark 1.5.1, single node in local mode and hive Hive 1.1.0 Thanks, Jins George
