FYI I pushed a fix for this to github; so if you pull everything should work now.
On Thu, Nov 5, 2015 at 12:07 PM, Marcelo Vanzin <van...@cloudera.com> wrote: > Man that command is slow. Anyway, it seems guava 16 is being brought > transitively by curator 2.6.0 which should have been overridden by the > explicit dependency on curator 2.4.0, but apparently, as Steve > mentioned, sbt/ivy decided to break things, so I'll be adding some > exclusions. > > On Thu, Nov 5, 2015 at 11:55 AM, Marcelo Vanzin <van...@cloudera.com> wrote: >> Answering my own question: "dependency-graph" >> >> On Thu, Nov 5, 2015 at 11:44 AM, Marcelo Vanzin <van...@cloudera.com> wrote: >>> Does anyone know how to get something similar to "mvn dependency:tree" from >>> sbt? >>> >>> mvn dependency:tree with hadoop 2.6.0 does not show any instances of guava >>> 16... >>> >>> On Thu, Nov 5, 2015 at 11:37 AM, Ted Yu <yuzhih...@gmail.com> wrote: >>>> build/sbt -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver >>>> -Dhadoop.version=2.6.0 -DskipTests assembly >>>> >>>> The above command fails on Mac. >>>> >>>> build/sbt -Pyarn -Phadoop-2.2 -Phive -Phive-thriftserver -Pkinesis-asl >>>> -DskipTests assembly >>>> >>>> The above command, used by Jenkins, passes. >>>> That's why the build error wasn't caught. >>>> >>>> FYI >>>> >>>> On Thu, Nov 5, 2015 at 11:07 AM, Dilip Biswal <dbis...@us.ibm.com> wrote: >>>>> >>>>> Hello Ted, >>>>> >>>>> Thanks for your response. >>>>> >>>>> Here is the command i used : >>>>> >>>>> build/sbt clean >>>>> build/sbt -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver >>>>> -Dhadoop.version=2.6.0 -DskipTests assembly >>>>> >>>>> I am building on CentOS and on master branch. >>>>> >>>>> One other thing, i was able to build fine with the above command up until >>>>> recently. I think i have stared >>>>> to have problem after SPARK-11073 where the HashCodes import was added. >>>>> >>>>> Regards, >>>>> Dilip Biswal >>>>> Tel: 408-463-4980 >>>>> dbis...@us.ibm.com >>>>> >>>>> >>>>> >>>>> From: Ted Yu <yuzhih...@gmail.com> >>>>> To: Dilip Biswal/Oakland/IBM@IBMUS >>>>> Cc: Jean-Baptiste Onofré <j...@nanthrax.net>, >>>>> "dev@spark.apache.org" >>>>> <dev@spark.apache.org> >>>>> Date: 11/05/2015 10:46 AM >>>>> Subject: Re: Master build fails ? >>>>> ________________________________ >>>>> >>>>> >>>>> >>>>> Dilip: >>>>> Can you give the command you used ? >>>>> >>>>> Which release were you building ? >>>>> What OS did you build on ? >>>>> >>>>> Cheers >>>>> >>>>> On Thu, Nov 5, 2015 at 10:21 AM, Dilip Biswal <dbis...@us.ibm.com> wrote: >>>>> Hello, >>>>> >>>>> I am getting the same build error about not being able tofind >>>>> com.google.common.hash.HashCodes. >>>>> >>>>> >>>>> Is there a solution to this ? >>>>> >>>>> Regards, >>>>> Dilip Biswal >>>>> Tel: 408-463-4980 >>>>> dbis...@us.ibm.com >>>>> >>>>> >>>>> >>>>> From: Jean-Baptiste Onofré <j...@nanthrax.net> >>>>> To: Ted Yu <yuzhih...@gmail.com> >>>>> Cc: "dev@spark.apache.org" <dev@spark.apache.org> >>>>> Date: 11/03/2015 07:20 AM >>>>> Subject: Re: Master build fails ? >>>>> ________________________________ >>>>> >>>>> >>>>> >>>>> Hi Ted, >>>>> >>>>> thanks for the update. The build with sbt is in progress on my box. >>>>> >>>>> Regards >>>>> JB >>>>> >>>>> On 11/03/2015 03:31 PM, Ted Yu wrote: >>>>> > Interesting, Sbt builds were not all failing: >>>>> > >>>>> > https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-SBT/ >>>>> > >>>>> > FYI >>>>> > >>>>> > On Tue, Nov 3, 2015 at 5:58 AM, Jean-Baptiste Onofré <j...@nanthrax.net >>>>> > <mailto:j...@nanthrax.net>> wrote: >>>>> >>>>> > >>>>> > Hi Jacek, >>>>> > >>>>> > it works fine with mvn: the problem is with sbt. >>>>> > >>>>> > I suspect a different reactor order in sbt compare to mvn. >>>>> > >>>>> > Regards >>>>> > JB >>>>> > >>>>> > On 11/03/2015 02:44 PM, Jacek Laskowski wrote: >>>>> > >>>>> > Hi, >>>>> > >>>>> > Just built the sources using the following command and it worked >>>>> > fine. >>>>> > >>>>> > ➜ spark git:(master) ✗ ./build/mvn -Pyarn -Phadoop-2.6 >>>>> > -Dhadoop.version=2.7.1 -Dscala-2.11 -Phive -Phive-thriftserver >>>>> > -DskipTests clean install >>>>> > ... >>>>> > [INFO] >>>>> > >>>>> > ------------------------------------------------------------------------ >>>>> > [INFO] BUILD SUCCESS >>>>> > [INFO] >>>>> > >>>>> > ------------------------------------------------------------------------ >>>>> > [INFO] Total time: 14:15 min >>>>> > [INFO] Finished at: 2015-11-03T14:40:40+01:00 >>>>> > [INFO] Final Memory: 438M/1972M >>>>> > [INFO] >>>>> > >>>>> > ------------------------------------------------------------------------ >>>>> > >>>>> > ➜ spark git:(master) ✗ java -version >>>>> > java version "1.8.0_66" >>>>> > Java(TM) SE Runtime Environment (build 1.8.0_66-b17) >>>>> > Java HotSpot(TM) 64-Bit Server VM (build 25.66-b17, mixed mode) >>>>> > >>>>> > I'm on Mac OS. >>>>> > >>>>> > Pozdrawiam, >>>>> > Jacek >>>>> > >>>>> > -- >>>>> > Jacek Laskowski | >>>>> http://blog.japila.pl| >>>>> > http://blog.jaceklaskowski.pl >>>>> >>>>> > Follow me at https://twitter.com/jaceklaskowski >>>>> > Upvote at http://stackoverflow.com/users/1305344/jacek-laskowski >>>>> >>>>> > >>>>> > >>>>> > On Tue, Nov 3, 2015 at 1:37 PM, Jean-Baptiste Onofré >>>>> > <j...@nanthrax.net<mailto:j...@nanthrax.net>> wrote: >>>>> > >>>>> > Thanks for the update, I used mvn to build but without hive >>>>> > profile. >>>>> > >>>>> > Let me try with mvn with the same options as you and sbt >>>>> > also. >>>>> > >>>>> > I keep you posted. >>>>> > >>>>> > Regards >>>>> > JB >>>>> > >>>>> > On 11/03/2015 12:55 PM, Jeff Zhang wrote: >>>>> > >>>>> > >>>>> > I found it is due to SPARK-11073. >>>>> > >>>>> > Here's the command I used to build >>>>> > >>>>> > build/sbt clean compile -Pyarn -Phadoop-2.6 -Phive >>>>> > -Phive-thriftserver >>>>> > -Psparkr >>>>> > >>>>> > On Tue, Nov 3, 2015 at 7:52 PM, Jean-Baptiste Onofré >>>>> > <j...@nanthrax.net<mailto:j...@nanthrax.net> >>>>> > <mailto:j...@nanthrax.net<mailto:j...@nanthrax.net>>> >>>>> > wrote: >>>>> >>>>> > >>>>> > Hi Jeff, >>>>> > >>>>> > it works for me (with skipping the tests). >>>>> > >>>>> > Let me try again, just to be sure. >>>>> > >>>>> > Regards >>>>> > JB >>>>> > >>>>> > >>>>> > On 11/03/2015 11:50 AM, Jeff Zhang wrote: >>>>> > >>>>> > Looks like it's due to guava version >>>>> > conflicts, I see both guava >>>>> > 14.0.1 >>>>> > and 16.0.1 under lib_managed/bundles. Anyone >>>>> > meet this issue too ? >>>>> > >>>>> > [error] >>>>> > >>>>> > >>>>> > /Users/jzhang/github/spark_apache/core/src/main/scala/org/apache/spark/SecurityManager.scala:26: >>>>> > object HashCodes is not a member of package >>>>> > com.google.common.hash >>>>> > [error] import >>>>> > com.google.common.hash.HashCodes >>>>> > [error] ^ >>>>> > [info] Resolving >>>>> > org.apache.commons#commons-math;2.2 ... >>>>> > [error] >>>>> > >>>>> > >>>>> > /Users/jzhang/github/spark_apache/core/src/main/scala/org/apache/spark/SecurityManager.scala:384: >>>>> > not found: value HashCodes >>>>> > [error] val cookie = >>>>> > HashCodes.fromBytes(secret).toString() >>>>> > [error] ^ >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > -- >>>>> > Best Regards >>>>> > >>>>> > Jeff Zhang >>>>> > >>>>> > >>>>> > -- >>>>> > Jean-Baptiste Onofré >>>>> > jbono...@apache.org< >>>>> mailto:jbono...@apache.org> >>>>> > <mailto:jbono...@apache.org<mailto:jbono...@apache.org>> >>>>> > http://blog.nanthrax.net >>>>> > Talend - http://www.talend.com >>>>> > >>>>> > >>>>> > >>>>> > --------------------------------------------------------------------- >>>>> > To unsubscribe, e-mail: >>>>> > dev-unsubscr...@spark.apache.org >>>>> > <mailto:dev-unsubscr...@spark.apache.org> >>>>> > <mailto:dev-unsubscr...@spark.apache.org >>>>> > <mailto:dev-unsubscr...@spark.apache.org>> >>>>> > For additional commands, e-mail: >>>>> > >>>>> > dev-h...@spark.apache.org<mailto:dev-h...@spark.apache.org> >>>>> > <mailto:dev-h...@spark.apache.org >>>>> >>>>> > <mailto:dev-h...@spark.apache.org>> >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > -- >>>>> > Best Regards >>>>> > >>>>> > Jeff Zhang >>>>> > >>>>> > >>>>> > >>>>> > -- >>>>> > Jean-Baptiste Onofré >>>>> > jbono...@apache.org<mailto:jbono...@apache.org> >>>>> > http://blog.nanthrax.net >>>>> > Talend - http://www.talend.com >>>>> > >>>>> > >>>>> > --------------------------------------------------------------------- >>>>> > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>>>> > <mailto:dev-unsubscr...@spark.apache.org> >>>>> > For additional commands, e-mail: dev-h...@spark.apache.org >>>>> > <mailto:dev-h...@spark.apache.org> >>>>> > >>>>> > >>>>> > >>>>> > --------------------------------------------------------------------- >>>>> > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>>>> > <mailto:dev-unsubscr...@spark.apache.org> >>>>> > For additional commands, e-mail: dev-h...@spark.apache.org >>>>> > <mailto:dev-h...@spark.apache.org> >>>>> > >>>>> > >>>>> > -- >>>>> > Jean-Baptiste Onofré >>>>> > jbono...@apache.org<mailto:jbono...@apache.org> >>>>> > http://blog.nanthrax.net >>>>> > Talend - http://www.talend.com >>>>> > >>>>> > >>>>> > --------------------------------------------------------------------- >>>>> > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>>>> > <mailto:dev-unsubscr...@spark.apache.org> >>>>> > For additional commands, e-mail: dev-h...@spark.apache.org >>>>> > <mailto:dev-h...@spark.apache.org> >>>>> > >>>>> > >>>>> >>>>> -- >>>>> Jean-Baptiste Onofré >>>>> jbono...@apache.org >>>>> http://blog.nanthrax.net >>>>> Talend - http://www.talend.com >>>>> >>>>> --------------------------------------------------------------------- >>>>> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>>>> For additional commands, e-mail: dev-h...@spark.apache.org >>>>> >>>>> >>>>> >>>>> >>>>> >>>> >>> >>> >>> >>> -- >>> Marcelo >> >> >> >> -- >> Marcelo > > > > -- > Marcelo -- Marcelo --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
