Re: failed to build spark with maven for both 1.0.1 and latest master branch

2014-07-31 Thread Tathagata Das
Does a mvn clean or sbt/sbt clean help? TD On Wed, Jul 30, 2014 at 9:25 PM, yao yaosheng...@gmail.com wrote: Hi Folks, Today I am trying to build spark using maven; however, the following command failed consistently for both 1.0.1 and the latest master. (BTW, it seems sbt works fine:

Re: failed to build spark with maven for both 1.0.1 and latest master branch

2014-07-31 Thread yao
Hi TD, I've asked my colleagues to do the same thing but compile still fails. However, maven build succeeded once I built it on my personal macbook (with the latest MacOS Yosemite). So I guess there might be something wrong in my build environment. Wonder if anyone tried to compile spark using

Re: failed to build spark with maven for both 1.0.1 and latest master branch

2014-07-31 Thread Ted Yu
The following command succeeded (on Linux) on Spark master checked out this morning: mvn -Pyarn -Phive -Phadoop-2.4 -DskipTests install FYI On Thu, Jul 31, 2014 at 1:36 PM, yao yaosheng...@gmail.com wrote: Hi TD, I've asked my colleagues to do the same thing but compile still fails.

Re: failed to build spark with maven for both 1.0.1 and latest master branch

2014-07-31 Thread yao
Great, thanks Ted. I just did a maven build on CentOS 6, everything looks good. So this is more like a Mac specific issue. On Thu, Jul 31, 2014 at 1:43 PM, Ted Yu yuzhih...@gmail.com wrote: The following command succeeded (on Linux) on Spark master checked out this morning: mvn -Pyarn

failed to build spark with maven for both 1.0.1 and latest master branch

2014-07-30 Thread yao
Hi Folks, Today I am trying to build spark using maven; however, the following command failed consistently for both 1.0.1 and the latest master. (BTW, it seems sbt works fine: *sbt/sbt -Dhadoop.version=2.4.0 -Pyarn clean assembly)* Environment: Mac OS Mavericks Maven: 3.2.2 (installed by