Re: Build Spark with maven

Try to see if that dependency comes via a transitive dependency using a mvn dependency tree. Rajika On Sat, Dec 7, 2013 at 1:31 AM, Azuryy Yu wrote: > Hey dears, > > Can you give me a maven repo, so I can compile Spark with Maven. > > I'm using http://repo1.maven.org/maven2/ currently > > but

Re: Build Spark with maven

@Mark, It works now after I changed the seetings.xml, but It would be better if improve a little Spark document in the section of "Building Spark with Maven " On Mon, Dec 9, 2013 at 10:45 AM, Azuryy Yu wrote: > @Mark > > I

Re: Build Spark with maven

Yeah, don't do that. The akka packages you need are not in Maven Central, so you won't be able to find them by looking only in a mirror. If you temporarily rename your settings.xml file, build Spark 0.8.1, then put your settings back, you should be okay as long as you don't remove the akka packag

Re: Build Spark with maven

@Mark I configured under apache-maven/conf/settings.xml: maven-nexus external:* Official Maven Repo http://repo1.maven.org/maven2/ On Mon, Dec 9, 2013 at 10:41 AM, Azuryy Yu wrote: > @Mater, what's your maven mirror used in your setting.xml, can y

Re: Build Spark with maven

@Mater, what's your maven mirror used in your setting.xml, can you share with me? Thanks. On Mon, Dec 9, 2013 at 10:14 AM, Azuryy Yu wrote: > Hi Mark, > > I build the current releast candidate, > It complained during build: > Downloading: > http://repo1.maven.org/maven2/com/typesafe/akka/akka-

Re: Build Spark with maven

Maven should retrieve the akka libraries from http://repo.akka.io/releases/ -- see the section of spark/pom.xml. Do you have nexus settings in, e.g., a ~/.m2/settings.xml file that are interfering with fetching form that repository? On Sun, Dec 8, 2013 at 6:14 PM, Azuryy Yu wrote: > Hi Mark,

Re: Build Spark with maven

Hi Mark, I build the current releast candidate, It complained during build: Downloading: http://repo1.maven.org/maven2/com/typesafe/akka/akka-actor/2.0.5/akka-actor-2.0.5.pom [WARNING] The POM for com.typesafe.akka:akka-actor:jar:2.0.5 is missing, no dependency information available Downloading: h

Re: Build Spark with maven

Thanks Mark, I will. On Mon, Dec 9, 2013 at 9:53 AM, Mark Hamstra wrote: > You probably want to try the current release candidate: > https://github.com/apache/incubator-spark/archive/v0.8.1-incubating.tar.gz > > > On Sun, Dec 8, 2013 at 5:51 PM, Azuryy Yu wrote: > >> Thanks Matei, I'll try. >>

Re: Build Spark with maven

You probably want to try the current release candidate: https://github.com/apache/incubator-spark/archive/v0.8.1-incubating.tar.gz On Sun, Dec 8, 2013 at 5:51 PM, Azuryy Yu wrote: > Thanks Matei, I'll try. > > @Mark, I download source package from > http://spark-project.org/download/spark-0.8.0

Re: Build Spark with maven

Thanks Matei, I'll try. @Mark, I download source package from http://spark-project.org/download/spark-0.8.0-incubating.tgz, Sorry, I build 0.8.0. not 0.8.1. On Mon, Dec 9, 2013 at 9:31 AM, Mark Hamstra wrote: > There is no released source package of Spark 0.8.1. It's just gone into > release c

Re: Build Spark with maven

There is no released source package of Spark 0.8.1. It's just gone into release candidate in the past day. Is that what you are trying to build? It should be exactly the same as what I just checked out from the v0.8.1-incubating tag. On Sun, Dec 8, 2013 at 5:28 PM, Azuryy Yu wrote: > I am no

Re: Build Spark with maven

I am not check out from repository, I download source package and build. On 2013-12-09 9:22 AM, "Mark Hamstra" wrote: > I don't believe that is true of the Spark 0.8.1 code. I just got done > building Spark from the v0.8.1-incubating tag after first removing anything > to do with akka from my ~

Re: Build Spark with maven

Yeah, maybe you have weird versions of something published locally. Try deleting your ~/.m2 and ~/.ivy2 directories and redoing the build. Unfortunately this will take a while to re-download stuff, but it should work out. Matei On Dec 8, 2013, at 5:21 PM, Mark Hamstra wrote: > I don't believ

Re: Build Spark with maven

I don't believe that is true of the Spark 0.8.1 code. I just got done building Spark from the v0.8.1-incubating tag after first removing anything to do with akka from my ~/.m2/repository. After a successful build without incident, my local repo now only contains akka 2.0.5 packages within the com

Re: Build Spark with maven

I build 0.8.1, maven try to download akka-actor-2.0.1, which is used by scala-core-io. On 2013-12-09 8:40 AM, "Matei Zaharia" wrote: > Which version of Spark are you building? AFAIK it should be using Akka > 2.0.5, not 2.0.1. > > Matei > > On Dec 8, 2013, at 3:35 PM, Azuryy Yu wrote: > > any th

Re: Build Spark with maven

Which version of Spark are you building? AFAIK it should be using Akka 2.0.5, not 2.0.1. Matei On Dec 8, 2013, at 3:35 PM, Azuryy Yu wrote: > any thoughs here? I still cannot compile spark using maven, thanks for any > inputs. > On 2013-12-07 2:31 PM, "Azuryy Yu" wrote: > Hey dears, > > Can

Re: Build Spark with maven

any thoughs here? I still cannot compile spark using maven, thanks for any inputs. On 2013-12-07 2:31 PM, "Azuryy Yu" wrote: > Hey dears, > > Can you give me a maven repo, so I can compile Spark with Maven. > > I'm using http://repo1.maven.org/maven2/ currently > > but It complains cannot find a

Build Spark with maven

Hey dears, Can you give me a maven repo, so I can compile Spark with Maven. I'm using http://repo1.maven.org/maven2/ currently but It complains cannot find akka-actor-2.0.1, I searched on the repo1.maven, and I am also cannot find akka-actor-2.0.1, which is too old. another strange output I ca