Re: Has anyone else observed this build break?

2014-11-15 Thread Sean Owen
FWIW I do not see this on master with mvn -DskipTests clean package. I'm on OS X 10.10 and I build with Java 8 by default. On Fri, Nov 14, 2014 at 8:17 PM, Patrick Wendell pwend...@gmail.com wrote: A recent patch broke clean builds for me, I am trying to see how widespread this issue is and

Re: Has anyone else observed this build break?

2014-11-15 Thread Ted Yu
Sorry for the late reply. I tested my patch on Mac with the following JDK: java version 1.7.0_60 Java(TM) SE Runtime Environment (build 1.7.0_60-b19) Java HotSpot(TM) 64-Bit Server VM (build 24.60-b09, mixed mode) Let me see if the problem can be solved upstream in HBase hbase-annotations

Re: Has anyone else observed this build break?

2014-11-15 Thread Ted Yu
I couldn't reproduce the problem using: java version 1.6.0_65 Java(TM) SE Runtime Environment (build 1.6.0_65-b14-462-11M4609) Java HotSpot(TM) 64-Bit Server VM (build 20.65-b04-462, mixed mode) Since hbase-annotations is a transitive dependency, I created the following pull request to exclude

Re: Has anyone else observed this build break?

2014-11-15 Thread Patrick Wendell
Sounds like this is pretty specific to my environment so not a big deal then. However, if we can safely exclude those packages it's worth doing. On Sat, Nov 15, 2014 at 7:27 AM, Ted Yu yuzhih...@gmail.com wrote: I couldn't reproduce the problem using: java version 1.6.0_65 Java(TM) SE Runtime

mvn or sbt for studying and developing Spark?

2014-11-15 Thread Yiming (John) Zhang
Hi, I am new in developing Spark and my current focus is about co-scheduling of spark tasks. However, I am confused with the building tools: sometimes the documentation uses mvn but sometimes uses sbt. So, my question is that which one is the preferred tool of Spark community? And what's

Re: mvn or sbt for studying and developing Spark?

2014-11-15 Thread Dinesh J. Weerakkody
Hi Yiming, I believe that both SBT and MVN is supported in SPARK, but SBT is preferred (I'm not 100% sure about this :) ). When I'm using MVN I got some build failures. After that used SBT and works fine. You can go through these discussions regarding SBT vs MVN and learn pros and cons of both

Re: mvn or sbt for studying and developing Spark?

2014-11-15 Thread Sean Owen
No, the Maven build is the main one. I would use it unless you have a need to use the SBT build in particular. On Nov 16, 2014 2:58 AM, Dinesh J. Weerakkody dineshjweerakk...@gmail.com wrote: Hi Yiming, I believe that both SBT and MVN is supported in SPARK, but SBT is preferred (I'm not 100%