Re: Getting a TreeNode Exception while saving into Hadoop

2016-08-17 Thread max square
n see that exception is caused by following, csn you check where in > your code you are using this path > > Caused by: org.apache.hadoop.mapred.InvalidInputException: Input path > does not exist: hdfs://testcluster:8020/experiments/vol/spark_chomp_ > data/bak/restaurants-bak/latest > > On Wed, 17 Au

Re: Getting a TreeNode Exception while saving into Hadoop

2016-08-17 Thread max square
/bump It'd be great if someone can point me to the correct direction. On Mon, Aug 8, 2016 at 5:07 PM, max square <max2subscr...@gmail.com> wrote: > Here's the complete stacktrace - https://gist.github.com/rohann/ > 649b0fcc9d5062ef792eddebf5a315c1 > > For reference, here's the

Getting a TreeNode Exception while saving into Hadoop

2016-08-08 Thread max square
Hey guys, I'm trying to save Dataframe in CSV format after performing unionAll operations on it. But I get this exception - Exception in thread "main" org.apache.spark.sql.catalyst.errors.package$TreeNodeException: execute, tree: TungstenExchange hashpartitioning(mId#430,200) I'm saving it by