Any particular reason you're not just downloading a build from http://spark.apache.org/downloads.html Even if you aren't using Hadoop, any of those builds will work.
If you want to build from source, the Maven build is more reliable. dean Dean Wampler, Ph.D. Author: Programming Scala, 2nd Edition <http://shop.oreilly.com/product/0636920033073.do> (O'Reilly) Typesafe <http://typesafe.com> @deanwampler <http://twitter.com/deanwampler> http://polyglotprogramming.com On Sat, Mar 21, 2015 at 5:52 PM, HARIPRIYA AYYALASOMAYAJULA < aharipriy...@gmail.com> wrote: > Hello, > > I am trying to install Spark 1.3.0 on my mac. Earlier, I was working with > Spark 1.1.0. Now, I come across this error : > > sbt.ResolveException: unresolved dependency: > org.apache.spark#spark-network-common_2.10;1.3.0: configuration not public > in org.apache.spark#spark-network-common_2.10;1.3.0: 'test'. It was > required from org.apache.spark#spark-network-shuffle_2.10;1.3.0 test > at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:278) > at sbt.IvyActions$$anonfun$updateEither$1.apply(IvyActions.scala:175) > at sbt.IvyActions$$anonfun$updateEither$1.apply(IvyActions.scala:157) > at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:151) > at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:151) > at sbt.IvySbt$$anonfun$withIvy$1.apply(Ivy.scala:128) > at sbt.IvySbt.sbt$IvySbt$$action$1(Ivy.scala:56) > at sbt.IvySbt$$anon$4.call(Ivy.scala:64) > at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:93) > at > xsbt.boot.Locks$GlobalLock.xsbt$boot$Locks$GlobalLock$$withChannelRetries$1(Locks.scala:78) > at xsbt.boot.Locks$GlobalLock$$anonfun$withFileLock$1.apply(Locks.scala:97) > at xsbt.boot.Using$.withResource(Using.scala:10) > at xsbt.boot.Using$.apply(Using.scala:9) > at xsbt.boot.Locks$GlobalLock.ignoringDeadlockAvoided(Locks.scala:58) > at xsbt.boot.Locks$GlobalLock.withLock(Locks.scala:48) > at xsbt.boot.Locks$.apply0(Locks.scala:31) > at xsbt.boot.Locks$.apply(Locks.scala:28) > at sbt.IvySbt.withDefaultLogger(Ivy.scala:64) > at sbt.IvySbt.withIvy(Ivy.scala:123) > at sbt.IvySbt.withIvy(Ivy.scala:120) > at sbt.IvySbt$Module.withModule(Ivy.scala:151) > at sbt.IvyActions$.updateEither(IvyActions.scala:157) > at > sbt.Classpaths$$anonfun$sbt$Classpaths$$work$1$1.apply(Defaults.scala:1318) > at > sbt.Classpaths$$anonfun$sbt$Classpaths$$work$1$1.apply(Defaults.scala:1315) > at > sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$85.apply(Defaults.scala:1345) > at > sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$85.apply(Defaults.scala:1343) > at sbt.Tracked$$anonfun$lastOutput$1.apply(Tracked.scala:35) > at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:1348) > at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:1342) > at sbt.Tracked$$anonfun$inputChanged$1.apply(Tracked.scala:45) > at sbt.Classpaths$.cachedUpdate(Defaults.scala:1360) > at sbt.Classpaths$$anonfun$updateTask$1.apply(Defaults.scala:1300) > at sbt.Classpaths$$anonfun$updateTask$1.apply(Defaults.scala:1275) > at scala.Function1$$anonfun$compose$1.apply(Function1.scala:47) > at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:40) > at sbt.std.Transform$$anon$4.work(System.scala:63) > at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:226) > at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:226) > at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:17) > at sbt.Execute.work(Execute.scala:235) > at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:226) > at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:226) > at > sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:159) > at sbt.CompletionService$$anon$2.call(CompletionService.scala:28) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) > at java.lang.Thread.run(Thread.java:695) > [error] (network-shuffle/*:update) sbt.ResolveException: unresolved > dependency: org.apache.spark#spark-network-common_2.10;1.3.0: configuration > not public in org.apache.spark#spark-network-common_2.10;1.3.0: 'test'. It > was required from org.apache.spark#spark-network-shuffle_2.10;1.3.0 test > [error] Total time: 5 s, completed Mar 21, 2015 7:48:45 PM > > I tried uninstalling and re - installing, when I browsed over the > internet, I came across suggestions to include -Phadoop, now even if I use > > build/sbt -Pyarn -Phadoop-2.3 assembly > > It gives me an error. > > I greatly appreciate any help. Thank you for your time. > > > -- > Regards, > Haripriya Ayyalasomayajula > Graduate Student > Department of Computer Science > University of Houston > Contact : 650-796-7112 >
