Re: Spark 2.0.1 & 2.1.1 fails on Hadoop-3.0.0-alhpa2

2017-05-10 Thread Jasson Chenwei
Got it, Thanks, Ravi! Wei On Wed, May 10, 2017 at 12:56 PM, Ravi Prakash wrote: > Hi Jasson! > > You will have to build Spark again with Hadoop-3.0.0-alpha2. This was done > as part of https://issues.apache.org/jira/browse/HADOOP-12563 . > > HTH > Ravi > > On Tue, May

Re: Spark 2.0.1 & 2.1.1 fails on Hadoop-3.0.0-alhpa2

2017-05-10 Thread Ravi Prakash
Hi Jasson! You will have to build Spark again with Hadoop-3.0.0-alpha2. This was done as part of https://issues.apache.org/jira/browse/HADOOP-12563 . HTH Ravi On Tue, May 9, 2017 at 4:33 PM, Jasson Chenwei wrote: > hi, all > > I just upgraded my Hadoop from 2.7.3 to

Spark 2.0.1 & 2.1.1 fails on Hadoop-3.0.0-alhpa2

2017-05-10 Thread Jasson Chenwei
hi, all I just upgraded my Hadoop from 2.7.3 to 3.0.0-alpha2. My spark version is 2.0.1. It works well on Hadoop -2.7.3. However, I had this error output of driver log on 3.0.0: *SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in