I couldn't reproduce the problem using: java version "1.6.0_65" Java(TM) SE Runtime Environment (build 1.6.0_65-b14-462-11M4609) Java HotSpot(TM) 64-Bit Server VM (build 20.65-b04-462, mixed mode)
Since hbase-annotations is a transitive dependency, I created the following pull request to exclude it from various hbase modules: https://github.com/apache/spark/pull/3286 Cheers https://github.com/apache/spark/pull/3286 On Sat, Nov 15, 2014 at 6:56 AM, Ted Yu <yuzhih...@gmail.com> wrote: > Sorry for the late reply. > > I tested my patch on Mac with the following JDK: > > java version "1.7.0_60" > Java(TM) SE Runtime Environment (build 1.7.0_60-b19) > Java HotSpot(TM) 64-Bit Server VM (build 24.60-b09, mixed mode) > > Let me see if the problem can be solved upstream in HBase hbase-annotations > module. > > Cheers > > On Fri, Nov 14, 2014 at 12:32 PM, Patrick Wendell <pwend...@gmail.com> > wrote: > >> I think in this case we can probably just drop that dependency, so >> there is a simpler fix. But mostly I'm curious whether anyone else has >> observed this. >> >> On Fri, Nov 14, 2014 at 12:24 PM, Hari Shreedharan >> <hshreedha...@cloudera.com> wrote: >> > Seems like a comment on that page mentions a fix, which would add yet >> > another profile though -- specifically telling mvn that if it is an >> apple >> > jdk, use the classes.jar as the tools.jar as well, since Apple-packaged >> JDK >> > 6 bundled them together. >> > >> > Link: >> > http://permalink.gmane.org/gmane.comp.java.maven-plugins.mojo.user/4320 >> > >> > I didn't test it, but maybe this can fix it? >> > >> > Thanks, >> > Hari >> > >> > >> > On Fri, Nov 14, 2014 at 12:21 PM, Patrick Wendell <pwend...@gmail.com> >> > wrote: >> >> >> >> A work around for this fix is identified here: >> >> >> >> >> http://dbknickerbocker.blogspot.com/2013/04/simple-fix-to-missing-toolsjar-in-jdk.html >> >> >> >> However, if this affects more users I'd prefer to just fix it properly >> >> in our build. >> >> >> >> On Fri, Nov 14, 2014 at 12:17 PM, Patrick Wendell <pwend...@gmail.com> >> >> wrote: >> >> > A recent patch broke clean builds for me, I am trying to see how >> >> > widespread this issue is and whether we need to revert the patch. >> >> > >> >> > The error I've seen is this when building the examples project: >> >> > >> >> > spark-examples_2.10: Could not resolve dependencies for project >> >> > org.apache.spark:spark-examples_2.10:jar:1.2.0-SNAPSHOT: Could not >> >> > find artifact jdk.tools:jdk.tools:jar:1.7 at specified path >> >> > >> >> > >> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/../lib/tools.jar >> >> > >> >> > The reason for this error is that hbase-annotations is using a >> >> > "system" scoped dependency in their hbase-annotations pom, and this >> >> > doesn't work with certain JDK layouts such as that provided on Mac >> OS: >> >> > >> >> > >> >> > >> http://central.maven.org/maven2/org/apache/hbase/hbase-annotations/0.98.7-hadoop2/hbase-annotations-0.98.7-hadoop2.pom >> >> > >> >> > Has anyone else seen this or is it just me? >> >> > >> >> > - Patrick >> >> >> >> --------------------------------------------------------------------- >> >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >> >> For additional commands, e-mail: dev-h...@spark.apache.org >> >> >> > >> > >
