Re: output folder structure not getting commited and remains as _temporary

2015-07-01 Thread Akhil Das
Looks like a jar conflict to me. ava.lang.NoSuchMethodException: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsData.getBytesWritten() You are having multiple versions of the same jars in the classpath. Thanks Best Regards On Wed, Jul 1, 2015 at 6:58 AM, nkd kalidas.nimmaga...@gmail.com

output folder structure not getting commited and remains as _temporary

2015-06-30 Thread nkd
I am running a spark application in standalone cluster on windows 7 environment. Following are the details. spark version = 1.4.0 Windows/Standalone mode built the Hadoop 2.6.0 on windows and set the env params like so HADOOP_HOME = E:\hadooptar260\hadoop-2.6.0 HADOOP_CONF_DIR