RE: LATERAL VIEW explode issue

2015-05-20 Thread yana
Just a guess but are you using HiveContext in one case vs SqlContext inanother? You dont show a stacktrace but this looks like parser error...Which would make me guess different  context or different spark versio on the cluster you are submitting to... Sent on the new Sprint Network from my

Re: LATERAL VIEW explode issue

2015-05-20 Thread kiran mavatoor
Hi Yana, I was using sqlContext in the program by creating new SqlContext(sc). This was created the problem when i submit the job using spark-submit. Where as, when I run the same program in spark-shell, the default context is hive context (it seems ) and every thing seems to be fine. This