Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-25 Thread Doug Balog
It works for me in cluster mode. I’m running on Hortonworks 2.2.4.12 in secure mode with Hive 0.14 I built with ./make-distribution —tgz -Phive -Phive-thriftserver -Phbase-provided -Pyarn -Phadoop-2.6 Doug > On Aug 25, 2015, at 4:56 PM, Tom Graves wrote: > > Anyone using HiveContext with

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-25 Thread Tom Graves
Anyone using HiveContext with secure Hive with Spark 1.5 and have it working? We have a non standard version of hive but was pulling our hive jars and its failing to authenticate.  It could be something in our hive version but wondering if spark isn't forwarding credentials properly. Tom

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-25 Thread Tom Graves
Is there a jira to update the sql hive docs?Spark SQL and DataFrames - Spark 1.5.0 Documentation |   | |   |   |   |   |   | | Spark SQL and DataFrames - Spark 1.5.0 DocumentationSpark SQL and DataFrame Guide Overview DataFrames Starting Point: SQLContext Creating DataFrames DataFrame Operation

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-24 Thread Sandy Ryza
I see that there's an 1.5.0-rc2 tag in github now. Is that the official RC2 tag to start trying out? -Sandy On Mon, Aug 24, 2015 at 7:23 AM, Sean Owen wrote: > PS Shixiong Zhu is correct that this one has to be fixed: > https://issues.apache.org/jira/browse/SPARK-10168 > > For example you can

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-24 Thread Sandy Ryza
Cool, thanks! On Mon, Aug 24, 2015 at 2:07 PM, Reynold Xin wrote: > Nope --- I cut that last Friday but had an error. I will remove it and cut > a new one. > > > On Mon, Aug 24, 2015 at 2:06 PM, Sandy Ryza > wrote: > >> I see that there's an 1.5.0-rc2 tag in github now. Is that the official >>

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-24 Thread Reynold Xin
Nope --- I cut that last Friday but had an error. I will remove it and cut a new one. On Mon, Aug 24, 2015 at 2:06 PM, Sandy Ryza wrote: > I see that there's an 1.5.0-rc2 tag in github now. Is that the official > RC2 tag to start trying out? > > -Sandy > > On Mon, Aug 24, 2015 at 7:23 AM, Sean

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-24 Thread Sean Owen
PS Shixiong Zhu is correct that this one has to be fixed: https://issues.apache.org/jira/browse/SPARK-10168 For example you can see assemblies like this are nearly empty: https://repository.apache.org/content/repositories/orgapachespark-1137/org/apache/spark/spark-streaming-flume-assembly_2.10/1.5

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-23 Thread Sean Owen
I think this is a symptom of not running "mvn ... package" and then "mvn ... test"? On Mon, Aug 24, 2015 at 1:27 AM, Luciano Resende wrote: > On Fri, Aug 21, 2015 at 9:28 AM, Sean Owen wrote: >> >> Signatures, license, etc. look good. I'm getting some fairly >> consistent failures using Java 7 +

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-23 Thread Luciano Resende
On Fri, Aug 21, 2015 at 9:28 AM, Sean Owen wrote: > Signatures, license, etc. look good. I'm getting some fairly > consistent failures using Java 7 + Ubuntu 15 + "-Pyarn -Phive > -Phive-thriftserver -Phadoop-2.6" -- does anyone else see these? they > are likely just test problems, but worth askin

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-21 Thread Reynold Xin
Problem noted. Apparently the release script doesn't automate the replacement of all version strings yet. I'm going to publish a new RC over the weekend with the release version properly assigned. Please continue the testing and report any problems you find. Thanks! On Fri, Aug 21, 2015 at 2:20

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-21 Thread Marcelo Vanzin
The pom files look correct, but this file is not: https://github.com/apache/spark/blob/4c56ad772637615cc1f4f88d619fac6c372c8552/core/src/main/scala/org/apache/spark/package.scala So, I guess, -1? On Fri, Aug 21, 2015 at 2:17 PM, mkhaitman wrote: > Just a heads up that this RC1 release is still

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-21 Thread Ted Yu
I pointed hbase-spark module (in HBase project) to 1.5.0-rc1 and was able to build the module (with proper maven repo). FYI On Fri, Aug 21, 2015 at 2:17 PM, mkhaitman wrote: > Just a heads up that this RC1 release is still appearing as > "1.5.0-SNAPSHOT" > (Not just me right..?) > > > > -- > Vi

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-21 Thread mkhaitman
Just a heads up that this RC1 release is still appearing as "1.5.0-SNAPSHOT" (Not just me right..?) -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-1-5-0-RC1-tp13780p13792.html Sent from the Apache Spark Developers List mailin

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-21 Thread Reynold Xin
A mistake in the original email. The vote closes at 20:00 UTC, Aug 24, rather than Aug 17. On Thursday, August 20, 2015, Shivaram Venkataraman < shiva...@eecs.berkeley.edu> wrote: > FYI > > The staging repository published as version 1.5.0 is at > https://repository.apache.org/content/repositorie

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-21 Thread Sean Owen
Signatures, license, etc. look good. I'm getting some fairly consistent failures using Java 7 + Ubuntu 15 + "-Pyarn -Phive -Phive-thriftserver -Phadoop-2.6" -- does anyone else see these? they are likely just test problems, but worth asking. Stack traces are at the end. There are currently 79 issu

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-20 Thread Shivaram Venkataraman
FYI The staging repository published as version 1.5.0 is at https://repository.apache.org/content/repositories/orgapachespark-1136 while the staging repository published as version 1.5.0-rc1 is at https://repository.apache.org/content/repositories/orgapachespark-1137 Thanks Shivaram On Thu, Aug

[VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-20 Thread Reynold Xin
Please vote on releasing the following candidate as Apache Spark version 1.5.0! The vote is open until Monday, Aug 17, 2015 at 20:00 UTC and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 1.5.0 [ ] -1 Do not release this package because ...