Re: Spark Java.lang.NullPointerException

2015-12-11 Thread Steve Loughran
> On 11 Dec 2015, at 05:14, michael_han wrote: > > Hi Sarala, > I found the reason, it's because when spark run it still needs Hadoop > support, I think it's a bug in Spark and still not fixed now ;) > It's related to how the hadoop filesystem apis are used to access

Re: Spark Java.lang.NullPointerException

2015-12-10 Thread michael_han
Hi Sarala, I found the reason, it's because when spark run it still needs Hadoop support, I think it's a bug in Spark and still not fixed now ;) After I download winutils.exe and following the steps from bellow workaround, it works fine:

Re: Spark Java.lang.NullPointerException

2015-12-08 Thread michael_han
t-1.0.jar;c: \spark-1.5.2-bin-hadoop2.6\lib\spark-assembly-1.5.2-hadoop2.6.0.jar does not exi st, skipping. *<2>* spark-submit --master local --name "SparkTest App" --class com.qad.SparkTest1 target/Spark-Test-1.0.jar --jars c:/spark-1.5.2-bin-hadoop2.6/lib/spark-assembly-1.5.2