RE: [VOTE] Release Apache Spark 2.0.0 (RC4)

-1 Breaks the existing applications while using the Script Transformation in Spark SQL, as the default Record/Column delimiter class changed since we don’t get the default conf value from HiveConf any more, see SPARK-16515; This is a regression. From: Reynold Xin [mailto:r...@databricks.com]

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

-1 There is a typo here : There is specially handling for not-a-number (NaN)… Just kidding, of course (about the vote). :) I vote +1 (for realz). - Successfully

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

Updated documentation at http://people.apache.org/~pwendell/spark-releases/spark-2.0.0-rc4-docs-updated/ On Thu, Jul 14, 2016 at 11:59 AM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.0.0. The vote is open until Sunday,

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

So the mesos issue (SPARK-16522) Michael is investigating. Unless it is actually failing Mesos, I wouldn't call it a blocker. The file path thing Alex brought up (SPARK-15899) only impacts test cases on Windows. I think it's important to fix, but definitely not a blocker either. For the doc

RE: [VOTE] Release Apache Spark 2.0.0 (RC4)

-1, due to unresolved https://issues.apache.org/jira/browse/SPARK-15899 From: Reynold Xin [mailto:r...@databricks.com] Sent: Thursday, July 14, 2016 12:00 PM To: dev@spark.apache.org Subject: [VOTE] Release Apache Spark 2.0.0 (RC4) Please vote on releasing the following candidate as Apache Spark

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

I think the docs build was broken because of https://issues.apache.org/jira/browse/SPARK-16553 - A fix has been merged and we are testing it now Shivaram On Thu, Jul 14, 2016 at 1:56 PM, Matthias Niehoff wrote: > Some of the programming guides in the docs only

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

Some of the programming guides in the docs only give me blank page (Spark programming guide works. Streaming, DataFrame/SQL and Structured Streaming do not). 2016-07-14 22:21 GMT+02:00 Nicholas Chammas : > Oh nevermind, just noticed your note. Apologies. > > On Thu,

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

Oh nevermind, just noticed your note. Apologies. On Thu, Jul 14, 2016 at 4:20 PM Nicholas Chammas wrote: > Just curious: Did we have an RC3? I don't remember seeing one. > > > On Thu, Jul 14, 2016 at 3:00 PM Reynold Xin wrote: > >> Please vote

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

Just curious: Did we have an RC3? I don't remember seeing one. On Thu, Jul 14, 2016 at 3:00 PM Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.0.0. The vote is open until Sunday, July 17, 2016 at 12:00 PDT and passes > if a

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

-1 Pending resolution of https://issues.apache.org/jira/browse/SPARK-16522 (diagnosing now) On Thu, Jul 14, 2016 at 11:59 AM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.0.0. The vote is open until Sunday, July 17, 2016

[VOTE] Release Apache Spark 2.0.0 (RC4)

Please vote on releasing the following candidate as Apache Spark version 2.0.0. The vote is open until Sunday, July 17, 2016 at 12:00 PDT and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 2.0.0 [ ] -1 Do not release this package because ...

Re: [VOTE] Release Apache Spark 2.0.0 (RC2)

I see that all blockers targeted for 2.0.0 have either been resolved or downgraded. Do you have an ETA for the next RC? Thanks, Jonathan On Mon, Jul 11, 2016 at 4:33 AM Sean Owen wrote: > Yeah there were already other blockers when the RC was released. This > one was

DataFrameWriter.insertInto() to table with Avro schema by URL

There is a Hive table with Avro schema specified by URL pointing to file in HDFS. CREATE EXTERNAL TABLE IF NOT EXISTS my_table ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' STORED AS INPUTFORMAT