Answering my own question: "dependency-graph" On Thu, Nov 5, 2015 at 11:44 AM, Marcelo Vanzin <van...@cloudera.com> wrote: > Does anyone know how to get something similar to "mvn dependency:tree" from > sbt? > > mvn dependency:tree with hadoop 2.6.0 does not show any instances of guava > 16... > > On Thu, Nov 5, 2015 at 11:37 AM, Ted Yu <yuzhih...@gmail.com> wrote: >> build/sbt -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver >> -Dhadoop.version=2.6.0 -DskipTests assembly >> >> The above command fails on Mac. >> >> build/sbt -Pyarn -Phadoop-2.2 -Phive -Phive-thriftserver -Pkinesis-asl >> -DskipTests assembly >> >> The above command, used by Jenkins, passes. >> That's why the build error wasn't caught. >> >> FYI >> >> On Thu, Nov 5, 2015 at 11:07 AM, Dilip Biswal <dbis...@us.ibm.com> wrote: >>> >>> Hello Ted, >>> >>> Thanks for your response. >>> >>> Here is the command i used : >>> >>> build/sbt clean >>> build/sbt -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver >>> -Dhadoop.version=2.6.0 -DskipTests assembly >>> >>> I am building on CentOS and on master branch. >>> >>> One other thing, i was able to build fine with the above command up until >>> recently. I think i have stared >>> to have problem after SPARK-11073 where the HashCodes import was added. >>> >>> Regards, >>> Dilip Biswal >>> Tel: 408-463-4980 >>> dbis...@us.ibm.com >>> >>> >>> >>> From: Ted Yu <yuzhih...@gmail.com> >>> To: Dilip Biswal/Oakland/IBM@IBMUS >>> Cc: Jean-Baptiste Onofré <j...@nanthrax.net>, "dev@spark.apache.org" >>> <dev@spark.apache.org> >>> Date: 11/05/2015 10:46 AM >>> Subject: Re: Master build fails ? >>> ________________________________ >>> >>> >>> >>> Dilip: >>> Can you give the command you used ? >>> >>> Which release were you building ? >>> What OS did you build on ? >>> >>> Cheers >>> >>> On Thu, Nov 5, 2015 at 10:21 AM, Dilip Biswal <dbis...@us.ibm.com> wrote: >>> Hello, >>> >>> I am getting the same build error about not being able tofind >>> com.google.common.hash.HashCodes. >>> >>> >>> Is there a solution to this ? >>> >>> Regards, >>> Dilip Biswal >>> Tel: 408-463-4980 >>> dbis...@us.ibm.com >>> >>> >>> >>> From: Jean-Baptiste Onofré <j...@nanthrax.net> >>> To: Ted Yu <yuzhih...@gmail.com> >>> Cc: "dev@spark.apache.org" <dev@spark.apache.org> >>> Date: 11/03/2015 07:20 AM >>> Subject: Re: Master build fails ? >>> ________________________________ >>> >>> >>> >>> Hi Ted, >>> >>> thanks for the update. The build with sbt is in progress on my box. >>> >>> Regards >>> JB >>> >>> On 11/03/2015 03:31 PM, Ted Yu wrote: >>> > Interesting, Sbt builds were not all failing: >>> > >>> > https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-SBT/ >>> > >>> > FYI >>> > >>> > On Tue, Nov 3, 2015 at 5:58 AM, Jean-Baptiste Onofré <j...@nanthrax.net >>> > <mailto:j...@nanthrax.net>> wrote: >>> >>> > >>> > Hi Jacek, >>> > >>> > it works fine with mvn: the problem is with sbt. >>> > >>> > I suspect a different reactor order in sbt compare to mvn. >>> > >>> > Regards >>> > JB >>> > >>> > On 11/03/2015 02:44 PM, Jacek Laskowski wrote: >>> > >>> > Hi, >>> > >>> > Just built the sources using the following command and it worked >>> > fine. >>> > >>> > ➜ spark git:(master) ✗ ./build/mvn -Pyarn -Phadoop-2.6 >>> > -Dhadoop.version=2.7.1 -Dscala-2.11 -Phive -Phive-thriftserver >>> > -DskipTests clean install >>> > ... >>> > [INFO] >>> > >>> > ------------------------------------------------------------------------ >>> > [INFO] BUILD SUCCESS >>> > [INFO] >>> > >>> > ------------------------------------------------------------------------ >>> > [INFO] Total time: 14:15 min >>> > [INFO] Finished at: 2015-11-03T14:40:40+01:00 >>> > [INFO] Final Memory: 438M/1972M >>> > [INFO] >>> > >>> > ------------------------------------------------------------------------ >>> > >>> > ➜ spark git:(master) ✗ java -version >>> > java version "1.8.0_66" >>> > Java(TM) SE Runtime Environment (build 1.8.0_66-b17) >>> > Java HotSpot(TM) 64-Bit Server VM (build 25.66-b17, mixed mode) >>> > >>> > I'm on Mac OS. >>> > >>> > Pozdrawiam, >>> > Jacek >>> > >>> > -- >>> > Jacek Laskowski | >>> http://blog.japila.pl| >>> > http://blog.jaceklaskowski.pl >>> >>> > Follow me at https://twitter.com/jaceklaskowski >>> > Upvote at http://stackoverflow.com/users/1305344/jacek-laskowski >>> >>> > >>> > >>> > On Tue, Nov 3, 2015 at 1:37 PM, Jean-Baptiste Onofré >>> > <j...@nanthrax.net<mailto:j...@nanthrax.net>> wrote: >>> > >>> > Thanks for the update, I used mvn to build but without hive >>> > profile. >>> > >>> > Let me try with mvn with the same options as you and sbt >>> > also. >>> > >>> > I keep you posted. >>> > >>> > Regards >>> > JB >>> > >>> > On 11/03/2015 12:55 PM, Jeff Zhang wrote: >>> > >>> > >>> > I found it is due to SPARK-11073. >>> > >>> > Here's the command I used to build >>> > >>> > build/sbt clean compile -Pyarn -Phadoop-2.6 -Phive >>> > -Phive-thriftserver >>> > -Psparkr >>> > >>> > On Tue, Nov 3, 2015 at 7:52 PM, Jean-Baptiste Onofré >>> > <j...@nanthrax.net<mailto:j...@nanthrax.net> >>> > <mailto:j...@nanthrax.net<mailto:j...@nanthrax.net>>> >>> > wrote: >>> >>> > >>> > Hi Jeff, >>> > >>> > it works for me (with skipping the tests). >>> > >>> > Let me try again, just to be sure. >>> > >>> > Regards >>> > JB >>> > >>> > >>> > On 11/03/2015 11:50 AM, Jeff Zhang wrote: >>> > >>> > Looks like it's due to guava version >>> > conflicts, I see both guava >>> > 14.0.1 >>> > and 16.0.1 under lib_managed/bundles. Anyone >>> > meet this issue too ? >>> > >>> > [error] >>> > >>> > >>> > /Users/jzhang/github/spark_apache/core/src/main/scala/org/apache/spark/SecurityManager.scala:26: >>> > object HashCodes is not a member of package >>> > com.google.common.hash >>> > [error] import >>> > com.google.common.hash.HashCodes >>> > [error] ^ >>> > [info] Resolving >>> > org.apache.commons#commons-math;2.2 ... >>> > [error] >>> > >>> > >>> > /Users/jzhang/github/spark_apache/core/src/main/scala/org/apache/spark/SecurityManager.scala:384: >>> > not found: value HashCodes >>> > [error] val cookie = >>> > HashCodes.fromBytes(secret).toString() >>> > [error] ^ >>> > >>> > >>> > >>> > >>> > -- >>> > Best Regards >>> > >>> > Jeff Zhang >>> > >>> > >>> > -- >>> > Jean-Baptiste Onofré >>> > jbono...@apache.org< >>> mailto:jbono...@apache.org> >>> > <mailto:jbono...@apache.org<mailto:jbono...@apache.org>> >>> > http://blog.nanthrax.net >>> > Talend - http://www.talend.com >>> > >>> > >>> > >>> > --------------------------------------------------------------------- >>> > To unsubscribe, e-mail: >>> > dev-unsubscr...@spark.apache.org >>> > <mailto:dev-unsubscr...@spark.apache.org> >>> > <mailto:dev-unsubscr...@spark.apache.org >>> > <mailto:dev-unsubscr...@spark.apache.org>> >>> > For additional commands, e-mail: >>> > >>> > dev-h...@spark.apache.org<mailto:dev-h...@spark.apache.org> >>> > <mailto:dev-h...@spark.apache.org >>> >>> > <mailto:dev-h...@spark.apache.org>> >>> > >>> > >>> > >>> > >>> > -- >>> > Best Regards >>> > >>> > Jeff Zhang >>> > >>> > >>> > >>> > -- >>> > Jean-Baptiste Onofré >>> > jbono...@apache.org<mailto:jbono...@apache.org> >>> > http://blog.nanthrax.net >>> > Talend - http://www.talend.com >>> > >>> > >>> > --------------------------------------------------------------------- >>> > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>> > <mailto:dev-unsubscr...@spark.apache.org> >>> > For additional commands, e-mail: dev-h...@spark.apache.org >>> > <mailto:dev-h...@spark.apache.org> >>> > >>> > >>> > >>> > --------------------------------------------------------------------- >>> > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>> > <mailto:dev-unsubscr...@spark.apache.org> >>> > For additional commands, e-mail: dev-h...@spark.apache.org >>> > <mailto:dev-h...@spark.apache.org> >>> > >>> > >>> > -- >>> > Jean-Baptiste Onofré >>> > jbono...@apache.org<mailto:jbono...@apache.org> >>> > http://blog.nanthrax.net >>> > Talend - http://www.talend.com >>> > >>> > >>> > --------------------------------------------------------------------- >>> > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>> > <mailto:dev-unsubscr...@spark.apache.org> >>> > For additional commands, e-mail: dev-h...@spark.apache.org >>> > <mailto:dev-h...@spark.apache.org> >>> > >>> > >>> >>> -- >>> Jean-Baptiste Onofré >>> jbono...@apache.org >>> http://blog.nanthrax.net >>> Talend - http://www.talend.com >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>> For additional commands, e-mail: dev-h...@spark.apache.org >>> >>> >>> >>> >>> >> > > > > -- > Marcelo
-- Marcelo --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
