Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2

2014-08-03 Thread Patrick Wendell
> wrote: > >>> > >>> Currently scala 2.10.2 can't be pulled in from maven central it seems, > >>> however if you have it in your ivy cache it should work. > >>> > >>> > >>> On Fri, Aug 1, 2014 at 3:15 PM, Holden Karau &

Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2

2014-08-02 Thread DB Tsai
>> wrote: >>>> >>>> Me 3 >>>> >>>> >>>> On Fri, Aug 1, 2014 at 11:15 AM, nit wrote: >>>>> >>>>> I also ran into same issue. What is the solution? >>>>> >>>>> >&g

Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2

2014-08-01 Thread Patrick Wendell
>>>> I also ran into same issue. What is the solution? >>>> >>>> >>>> >>>> -- >>>> View this message in context: >>>> http://apache-spark-user-list.1001560.n3.nabble.com/Compiling-Spark-master-284771ef-with-sbt-sbt-assembly-fails-on-EC2-tp11155p11189.html >>>> Sent from the Apache Spark User List mailing list archive at Nabble.com. >>>> >>> >>> >>> >>> -- >>> Cell : 425-233-8271 >>> >> >> >> >> -- >> Cell : 425-233-8271 >> > >

Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2

2014-08-01 Thread Shivaram Venkataraman
gt;> I also ran into same issue. What is the solution? >>>> >>>> >>>> >>>> -- >>>> View this message in context: >>>> http://apache-spark-user-list.1001560.n3.nabble.com/Compiling-Spark-master-284771ef-with-sbt-sbt-assembly-fails-on-EC2-tp11155p11189.html >>>> Sent from the Apache Spark User List mailing list archive at Nabble.com. >>>> >>> >>> >>> >>> -- >>> Cell : 425-233-8271 >>> >> >> >> >> -- >> Cell : 425-233-8271 >> > >

Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2

2014-08-01 Thread Shivaram Venkataraman
Holden Karau wrote: > >> Me 3 >> >> >> On Fri, Aug 1, 2014 at 11:15 AM, nit wrote: >> >>> I also ran into same issue. What is the solution? >>> >>> >>> >>> -- >>> View this message in context: >>> ht

Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2

2014-08-01 Thread Patrick Wendell
solution? >>> >>> >>> >>> -- >>> View this message in context: >>> http://apache-spark-user-list.1001560.n3.nabble.com/Compiling-Spark-master-284771ef-with-sbt-sbt-assembly-fails-on-EC2-tp11155p11189.html >>> Sent from the Apache Spark User List mailing list archive at Nabble.com. >>> >> >> >> >> -- >> Cell : 425-233-8271 >> > > > > -- > Cell : 425-233-8271 >

Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2

2014-08-01 Thread Holden Karau
ssue. What is the solution? >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Compiling-Spark-master-284771ef-with-sbt-sbt-assembly-fails-on-EC2-tp11155p11189.html >> Sent from the Apache Spark User List mai

Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2

2014-08-01 Thread Holden Karau
Me 3 On Fri, Aug 1, 2014 at 11:15 AM, nit wrote: > I also ran into same issue. What is the solution? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Compiling-Spark-master-284771ef-with-sbt-sbt-assembly-fails-on-EC2-tp11

Re: Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2

2014-08-01 Thread nit
I also ran into same issue. What is the solution? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Compiling-Spark-master-284771ef-with-sbt-sbt-assembly-fails-on-EC2-tp11155p11189.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2

2014-08-01 Thread Ankur Dave
Attempting to build Spark from source on EC2 using sbt gives the error "sbt.ResolveException: unresolved dependency: org.scala-lang#scala-library;2.10.2: not found". This only seems to happen on EC2, not on my local machine. To reproduce, launch a cluster using spark-ec2, clone the Spark reposi

Re: sbt/sbt assembly fails with ssl certificate error

2014-03-24 Thread Debasish Das
After a long time (may be a month) I could do a fresh build for 2.0.0-mr1-cdh4.5.0...I was using the cached files in .ivy2/cache My case is especially painful since I have to build behind a firewall... @Sean thanks for the fix...I think we should put a test for https/firewall compilation as well.

Re: sbt/sbt assembly fails with ssl certificate error

2014-03-23 Thread Bharath Bhushan
I don’t see the errors anymore. Thanks Aaron. On 24-Mar-2014, at 12:52 am, Aaron Davidson wrote: > These errors should be fixed on master with Sean's PR: > https://github.com/apache/spark/pull/209 > > The orbit errors are quite possibly due to using https instead of http, > whether or not the

Re: sbt/sbt assembly fails with ssl certificate error

2014-03-23 Thread Aaron Davidson
These errors should be fixed on master with Sean's PR: https://github.com/apache/spark/pull/209 The orbit errors are quite possibly due to using https instead of http, whether or not the SSL cert was bad. Let us know if they go away with reverting to http. On Sun, Mar 23, 2014 at 11:48 AM, Debas

Re: sbt/sbt assembly fails with ssl certificate error

2014-03-23 Thread Debasish Das
I am getting these weird errors which I have not seen before: [error] Server access Error: handshake alert: unrecognized_name url= https://repo.maven.apache.org/maven2/org/eclipse/jetty/orbit/javax.servlet/2.5.0.v201103041518/javax.servlet-2.5.0.v201103041518.orbit [info] Resolving org.eclipse.je

Re: sbt/sbt assembly fails with ssl certificate error

2014-03-23 Thread Sean Owen
I'm also seeing this. It also was working for me previously AFAIK. Tthe proximate cause is my well-intentioned change that uses HTTPS to access all artifact repos. The default for Maven Central before would have been HTTP. While it's a good idea to use HTTPS, it may run into complications. I see:

sbt/sbt assembly fails with ssl certificate error

2014-03-23 Thread Bharath Bhushan
I am facing a weird failure where "sbt/sbt assembly” shows a lot of SSL certificate errors for repo.maven.apache.org. Is anyone else facing the same problems? Any idea why this is happening? Yesterday I was able to successfully run it. Loading https://repo.maven.apache.org shows an invalid cert

Re: sbt assembly fails

2014-03-17 Thread Mayur Rustagi
you need to assemble the code to get spark working (unless you are using hadoop 1.0.4). to run the code you can follow any of the standalone guides here: https://spark.apache.org/docs/0.9.0/quick-start.html#a-standalone-app-in-scalayou would still need sbt though. Mayur Rustagi Ph: +1 (760) 203

Re: sbt assembly fails

2014-03-17 Thread Chengi Liu
Yeah.. The http_proxy is set up.. and so is https_proxy.. Basically, my maven projects, git pulls etc everything is working fine.. except this. Here is another question which might help me to bypass this issue If I create a jar using eclipse... how do i run that jar in code. Like in hadoop, I

Re: sbt assembly fails

2014-03-17 Thread Mayur Rustagi
is it translating to sbt? are you also setting command line proxy HTTP_PROXY easiest is to build a small code & just test it out by building in command line.. Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi On Tue, Mar 18, 2

Re: sbt assembly fails

2014-03-17 Thread Chengi Liu
Hi Sean, Yeah.. I am seeing erros across all repos and yepp.. this error is mainly because of connectivity issue... How do I set up proxy.. I did set up proxy as suggested by Mayur: export JAVA_OPTS="$JAVA_OPTS -Dhttp.proxyHost=yourserver -Dhttp.proxyPort=8080 -Dhttp.proxyUser=username -Dhttp.pr

Re: sbt assembly fails

2014-03-17 Thread Sean Owen
It's in the main Maven repo: http://central.maven.org/maven2/io/netty/netty-all/ I assume you're seeing errors accessing all repos? the last few you quote are not where they are intended to be, you're just seeing it fail through all of them. I think it remains a connectivity problem from your env

Re: sbt assembly fails

2014-03-17 Thread Chengi Liu
I have set it up.. still it fails.. Question: https://oss.sonatype.org/content/repositories/snapshots/io/netty/netty-all/ 4.0.13 is not there? Instead 4.0.18 is there?? Is this a bug

Re: sbt assembly fails

2014-03-17 Thread Mayur Rustagi
http://mail-archives.apache.org/mod_mbox/spark-user/201403.mbox/%3ccaaqhkj48japuzqc476es67c+rrfime87uprambdoofhcl0k...@mail.gmail.com%3E You also have to specify git proxy as code may be copied off git also. Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi

sbt assembly fails

2014-03-17 Thread Chengi Liu
Hi, I am trying to compile the spark project using sbt/sbt assembly.. And i see this error: [info] Resolving io.netty#netty-all;4.0.13.Final ... [error] Server access Error: Connection timed out url= https://oss.sonatype.org/content/repositories/snapshots/io/netty/netty-all/4.0.13.Final/netty-all