Man that command is slow. Anyway, it seems guava 16 is being brought transitively by curator 2.6.0 which should have been overridden by the explicit dependency on curator 2.4.0, but apparently, as Steve mentioned, sbt/ivy decided to break things, so I'll be adding some exclusions.
On Thu, Nov 5, 2015 at 11:55 AM, Marcelo Vanzin <van...@cloudera.com> wrote: > Answering my own question: "dependency-graph" > > On Thu, Nov 5, 2015 at 11:44 AM, Marcelo Vanzin <van...@cloudera.com> wrote: >> Does anyone know how to get something similar to "mvn dependency:tree" from >> sbt? >> >> mvn dependency:tree with hadoop 2.6.0 does not show any instances of guava >> 16... >> >> On Thu, Nov 5, 2015 at 11:37 AM, Ted Yu <yuzhih...@gmail.com> wrote: >>> build/sbt -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver >>> -Dhadoop.version=2.6.0 -DskipTests assembly >>> >>> The above command fails on Mac. >>> >>> build/sbt -Pyarn -Phadoop-2.2 -Phive -Phive-thriftserver -Pkinesis-asl >>> -DskipTests assembly >>> >>> The above command, used by Jenkins, passes. >>> That's why the build error wasn't caught. >>> >>> FYI >>> >>> On Thu, Nov 5, 2015 at 11:07 AM, Dilip Biswal <dbis...@us.ibm.com> wrote: >>>> >>>> Hello Ted, >>>> >>>> Thanks for your response. >>>> >>>> Here is the command i used : >>>> >>>> build/sbt clean >>>> build/sbt -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver >>>> -Dhadoop.version=2.6.0 -DskipTests assembly >>>> >>>> I am building on CentOS and on master branch. >>>> >>>> One other thing, i was able to build fine with the above command up until >>>> recently. I think i have stared >>>> to have problem after SPARK-11073 where the HashCodes import was added. >>>> >>>> Regards, >>>> Dilip Biswal >>>> Tel: 408-463-4980 >>>> dbis...@us.ibm.com >>>> >>>> >>>> >>>> From: Ted Yu <yuzhih...@gmail.com> >>>> To: Dilip Biswal/Oakland/IBM@IBMUS >>>> Cc: Jean-Baptiste Onofré <j...@nanthrax.net>, "dev@spark.apache.org" >>>> <dev@spark.apache.org> >>>> Date: 11/05/2015 10:46 AM >>>> Subject: Re: Master build fails ? >>>> ________________________________ >>>> >>>> >>>> >>>> Dilip: >>>> Can you give the command you used ? >>>> >>>> Which release were you building ? >>>> What OS did you build on ? >>>> >>>> Cheers >>>> >>>> On Thu, Nov 5, 2015 at 10:21 AM, Dilip Biswal <dbis...@us.ibm.com> wrote: >>>> Hello, >>>> >>>> I am getting the same build error about not being able tofind >>>> com.google.common.hash.HashCodes. >>>> >>>> >>>> Is there a solution to this ? >>>> >>>> Regards, >>>> Dilip Biswal >>>> Tel: 408-463-4980 >>>> dbis...@us.ibm.com >>>> >>>> >>>> >>>> From: Jean-Baptiste Onofré <j...@nanthrax.net> >>>> To: Ted Yu <yuzhih...@gmail.com> >>>> Cc: "dev@spark.apache.org" <dev@spark.apache.org> >>>> Date: 11/03/2015 07:20 AM >>>> Subject: Re: Master build fails ? >>>> ________________________________ >>>> >>>> >>>> >>>> Hi Ted, >>>> >>>> thanks for the update. The build with sbt is in progress on my box. >>>> >>>> Regards >>>> JB >>>> >>>> On 11/03/2015 03:31 PM, Ted Yu wrote: >>>> > Interesting, Sbt builds were not all failing: >>>> > >>>> > https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-SBT/ >>>> > >>>> > FYI >>>> > >>>> > On Tue, Nov 3, 2015 at 5:58 AM, Jean-Baptiste Onofré <j...@nanthrax.net >>>> > <mailto:j...@nanthrax.net>> wrote: >>>> >>>> > >>>> > Hi Jacek, >>>> > >>>> > it works fine with mvn: the problem is with sbt. >>>> > >>>> > I suspect a different reactor order in sbt compare to mvn. >>>> > >>>> > Regards >>>> > JB >>>> > >>>> > On 11/03/2015 02:44 PM, Jacek Laskowski wrote: >>>> > >>>> > Hi, >>>> > >>>> > Just built the sources using the following command and it worked >>>> > fine. >>>> > >>>> > ➜ spark git:(master) ✗ ./build/mvn -Pyarn -Phadoop-2.6 >>>> > -Dhadoop.version=2.7.1 -Dscala-2.11 -Phive -Phive-thriftserver >>>> > -DskipTests clean install >>>> > ... >>>> > [INFO] >>>> > >>>> > ------------------------------------------------------------------------ >>>> > [INFO] BUILD SUCCESS >>>> > [INFO] >>>> > >>>> > ------------------------------------------------------------------------ >>>> > [INFO] Total time: 14:15 min >>>> > [INFO] Finished at: 2015-11-03T14:40:40+01:00 >>>> > [INFO] Final Memory: 438M/1972M >>>> > [INFO] >>>> > >>>> > ------------------------------------------------------------------------ >>>> > >>>> > ➜ spark git:(master) ✗ java -version >>>> > java version "1.8.0_66" >>>> > Java(TM) SE Runtime Environment (build 1.8.0_66-b17) >>>> > Java HotSpot(TM) 64-Bit Server VM (build 25.66-b17, mixed mode) >>>> > >>>> > I'm on Mac OS. >>>> > >>>> > Pozdrawiam, >>>> > Jacek >>>> > >>>> > -- >>>> > Jacek Laskowski | >>>> http://blog.japila.pl| >>>> > http://blog.jaceklaskowski.pl >>>> >>>> > Follow me at https://twitter.com/jaceklaskowski >>>> > Upvote at http://stackoverflow.com/users/1305344/jacek-laskowski >>>> >>>> > >>>> > >>>> > On Tue, Nov 3, 2015 at 1:37 PM, Jean-Baptiste Onofré >>>> > <j...@nanthrax.net<mailto:j...@nanthrax.net>> wrote: >>>> > >>>> > Thanks for the update, I used mvn to build but without hive >>>> > profile. >>>> > >>>> > Let me try with mvn with the same options as you and sbt >>>> > also. >>>> > >>>> > I keep you posted. >>>> > >>>> > Regards >>>> > JB >>>> > >>>> > On 11/03/2015 12:55 PM, Jeff Zhang wrote: >>>> > >>>> > >>>> > I found it is due to SPARK-11073. >>>> > >>>> > Here's the command I used to build >>>> > >>>> > build/sbt clean compile -Pyarn -Phadoop-2.6 -Phive >>>> > -Phive-thriftserver >>>> > -Psparkr >>>> > >>>> > On Tue, Nov 3, 2015 at 7:52 PM, Jean-Baptiste Onofré >>>> > <j...@nanthrax.net<mailto:j...@nanthrax.net> >>>> > <mailto:j...@nanthrax.net<mailto:j...@nanthrax.net>>> >>>> > wrote: >>>> >>>> > >>>> > Hi Jeff, >>>> > >>>> > it works for me (with skipping the tests). >>>> > >>>> > Let me try again, just to be sure. >>>> > >>>> > Regards >>>> > JB >>>> > >>>> > >>>> > On 11/03/2015 11:50 AM, Jeff Zhang wrote: >>>> > >>>> > Looks like it's due to guava version >>>> > conflicts, I see both guava >>>> > 14.0.1 >>>> > and 16.0.1 under lib_managed/bundles. Anyone >>>> > meet this issue too ? >>>> > >>>> > [error] >>>> > >>>> > >>>> > /Users/jzhang/github/spark_apache/core/src/main/scala/org/apache/spark/SecurityManager.scala:26: >>>> > object HashCodes is not a member of package >>>> > com.google.common.hash >>>> > [error] import >>>> > com.google.common.hash.HashCodes >>>> > [error] ^ >>>> > [info] Resolving >>>> > org.apache.commons#commons-math;2.2 ... >>>> > [error] >>>> > >>>> > >>>> > /Users/jzhang/github/spark_apache/core/src/main/scala/org/apache/spark/SecurityManager.scala:384: >>>> > not found: value HashCodes >>>> > [error] val cookie = >>>> > HashCodes.fromBytes(secret).toString() >>>> > [error] ^ >>>> > >>>> > >>>> > >>>> > >>>> > -- >>>> > Best Regards >>>> > >>>> > Jeff Zhang >>>> > >>>> > >>>> > -- >>>> > Jean-Baptiste Onofré >>>> > jbono...@apache.org< >>>> mailto:jbono...@apache.org> >>>> > <mailto:jbono...@apache.org<mailto:jbono...@apache.org>> >>>> > http://blog.nanthrax.net >>>> > Talend - http://www.talend.com >>>> > >>>> > >>>> > >>>> > --------------------------------------------------------------------- >>>> > To unsubscribe, e-mail: >>>> > dev-unsubscr...@spark.apache.org >>>> > <mailto:dev-unsubscr...@spark.apache.org> >>>> > <mailto:dev-unsubscr...@spark.apache.org >>>> > <mailto:dev-unsubscr...@spark.apache.org>> >>>> > For additional commands, e-mail: >>>> > >>>> > dev-h...@spark.apache.org<mailto:dev-h...@spark.apache.org> >>>> > <mailto:dev-h...@spark.apache.org >>>> >>>> > <mailto:dev-h...@spark.apache.org>> >>>> > >>>> > >>>> > >>>> > >>>> > -- >>>> > Best Regards >>>> > >>>> > Jeff Zhang >>>> > >>>> > >>>> > >>>> > -- >>>> > Jean-Baptiste Onofré >>>> > jbono...@apache.org<mailto:jbono...@apache.org> >>>> > http://blog.nanthrax.net >>>> > Talend - http://www.talend.com >>>> > >>>> > >>>> > --------------------------------------------------------------------- >>>> > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>>> > <mailto:dev-unsubscr...@spark.apache.org> >>>> > For additional commands, e-mail: dev-h...@spark.apache.org >>>> > <mailto:dev-h...@spark.apache.org> >>>> > >>>> > >>>> > >>>> > --------------------------------------------------------------------- >>>> > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>>> > <mailto:dev-unsubscr...@spark.apache.org> >>>> > For additional commands, e-mail: dev-h...@spark.apache.org >>>> > <mailto:dev-h...@spark.apache.org> >>>> > >>>> > >>>> > -- >>>> > Jean-Baptiste Onofré >>>> > jbono...@apache.org<mailto:jbono...@apache.org> >>>> > http://blog.nanthrax.net >>>> > Talend - http://www.talend.com >>>> > >>>> > >>>> > --------------------------------------------------------------------- >>>> > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>>> > <mailto:dev-unsubscr...@spark.apache.org> >>>> > For additional commands, e-mail: dev-h...@spark.apache.org >>>> > <mailto:dev-h...@spark.apache.org> >>>> > >>>> > >>>> >>>> -- >>>> Jean-Baptiste Onofré >>>> jbono...@apache.org >>>> http://blog.nanthrax.net >>>> Talend - http://www.talend.com >>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>>> For additional commands, e-mail: dev-h...@spark.apache.org >>>> >>>> >>>> >>>> >>>> >>> >> >> >> >> -- >> Marcelo > > > > -- > Marcelo -- Marcelo --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
