Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-25 Thread Tom Graves
Is there a jira to update the sql hive docs?Spark SQL and DataFrames - Spark 1.5.0 Documentation |   | |   |   |   |   |   | | Spark SQL and DataFrames - Spark 1.5.0 DocumentationSpark SQL and DataFrame Guide Overview DataFrames Starting Point: SQLContext Creating DataFrames DataFrame

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-25 Thread Tom Graves
Anyone using HiveContext with secure Hive with Spark 1.5 and have it working? We have a non standard version of hive but was pulling our hive jars and its failing to authenticate.  It could be something in our hive version but wondering if spark isn't forwarding credentials properly. Tom

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-25 Thread Doug Balog
It works for me in cluster mode. I’m running on Hortonworks 2.2.4.12 in secure mode with Hive 0.14 I built with ./make-distribution —tgz -Phive -Phive-thriftserver -Phbase-provided -Pyarn -Phadoop-2.6 Doug On Aug 25, 2015, at 4:56 PM, Tom Graves tgraves...@yahoo.com.INVALID wrote:

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-24 Thread Sean Owen
PS Shixiong Zhu is correct that this one has to be fixed: https://issues.apache.org/jira/browse/SPARK-10168 For example you can see assemblies like this are nearly empty:

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-24 Thread Sandy Ryza
I see that there's an 1.5.0-rc2 tag in github now. Is that the official RC2 tag to start trying out? -Sandy On Mon, Aug 24, 2015 at 7:23 AM, Sean Owen so...@cloudera.com wrote: PS Shixiong Zhu is correct that this one has to be fixed: https://issues.apache.org/jira/browse/SPARK-10168 For

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-24 Thread Reynold Xin
Nope --- I cut that last Friday but had an error. I will remove it and cut a new one. On Mon, Aug 24, 2015 at 2:06 PM, Sandy Ryza sandy.r...@cloudera.com wrote: I see that there's an 1.5.0-rc2 tag in github now. Is that the official RC2 tag to start trying out? -Sandy On Mon, Aug 24,

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-24 Thread Sandy Ryza
Cool, thanks! On Mon, Aug 24, 2015 at 2:07 PM, Reynold Xin r...@databricks.com wrote: Nope --- I cut that last Friday but had an error. I will remove it and cut a new one. On Mon, Aug 24, 2015 at 2:06 PM, Sandy Ryza sandy.r...@cloudera.com wrote: I see that there's an 1.5.0-rc2 tag in

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-23 Thread Luciano Resende
On Fri, Aug 21, 2015 at 9:28 AM, Sean Owen so...@cloudera.com wrote: Signatures, license, etc. look good. I'm getting some fairly consistent failures using Java 7 + Ubuntu 15 + -Pyarn -Phive -Phive-thriftserver -Phadoop-2.6 -- does anyone else see these? they are likely just test problems,

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-23 Thread Sean Owen
I think this is a symptom of not running mvn ... package and then mvn ... test? On Mon, Aug 24, 2015 at 1:27 AM, Luciano Resende luckbr1...@gmail.com wrote: On Fri, Aug 21, 2015 at 9:28 AM, Sean Owen so...@cloudera.com wrote: Signatures, license, etc. look good. I'm getting some fairly

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-21 Thread Sean Owen
Signatures, license, etc. look good. I'm getting some fairly consistent failures using Java 7 + Ubuntu 15 + -Pyarn -Phive -Phive-thriftserver -Phadoop-2.6 -- does anyone else see these? they are likely just test problems, but worth asking. Stack traces are at the end. There are currently 79

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-21 Thread mkhaitman
Just a heads up that this RC1 release is still appearing as 1.5.0-SNAPSHOT (Not just me right..?) -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-1-5-0-RC1-tp13780p13792.html Sent from the Apache Spark Developers List mailing

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-21 Thread Marcelo Vanzin
The pom files look correct, but this file is not: https://github.com/apache/spark/blob/4c56ad772637615cc1f4f88d619fac6c372c8552/core/src/main/scala/org/apache/spark/package.scala So, I guess, -1? On Fri, Aug 21, 2015 at 2:17 PM, mkhaitman mark.khait...@chango.com wrote: Just a heads up that

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-21 Thread Reynold Xin
Problem noted. Apparently the release script doesn't automate the replacement of all version strings yet. I'm going to publish a new RC over the weekend with the release version properly assigned. Please continue the testing and report any problems you find. Thanks! On Fri, Aug 21, 2015 at 2:20

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-21 Thread Ted Yu
I pointed hbase-spark module (in HBase project) to 1.5.0-rc1 and was able to build the module (with proper maven repo). FYI On Fri, Aug 21, 2015 at 2:17 PM, mkhaitman mark.khait...@chango.com wrote: Just a heads up that this RC1 release is still appearing as 1.5.0-SNAPSHOT (Not just me

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-20 Thread Shivaram Venkataraman
FYI The staging repository published as version 1.5.0 is at https://repository.apache.org/content/repositories/orgapachespark-1136 while the staging repository published as version 1.5.0-rc1 is at https://repository.apache.org/content/repositories/orgapachespark-1137 Thanks Shivaram On Thu, Aug

[VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-20 Thread Reynold Xin
Please vote on releasing the following candidate as Apache Spark version 1.5.0! The vote is open until Monday, Aug 17, 2015 at 20:00 UTC and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 1.5.0 [ ] -1 Do not release this package because ...