Re: drop java 7 support for spark 2.1.x or spark 2.2.x

2016-07-23 Thread Dongjoon Hyun
Hi, All. What about providing a official benchmark result between `Apache Spark on JDK7` and `Apache Spark on JDK8`? I think that is enough for this issue since we cannot drive users. We had better let users choose one of JDK7/JDK8 for their own benefits. Bests, Dongjoon. On Sat, Jul 23, 2016

Re: drop java 7 support for spark 2.1.x or spark 2.2.x

2016-07-23 Thread Mark Hamstra
Sure, signalling well ahead of time is good, as is getting better performance from Java 8; but do either of those interests really require dropping Java 7 support sooner rather than later? Now, to retroactively copy edit myself, when I previously wrote "after all or nearly all relevant clusters

Re: drop java 7 support for spark 2.1.x or spark 2.2.x

2016-07-23 Thread Koert Kuipers
i care about signalling it in advance mostly. and given the performance differences we do have some interest in pushing towards java 8 On Jul 23, 2016 6:10 PM, "Mark Hamstra" wrote: Why the push to remove Java 7 support as soon as possible (which is how I read your

drop java 7 support for spark 2.1.x or spark 2.2.x

2016-07-23 Thread Koert Kuipers
dropping java 7 support was considered for spark 2.0.x but we decided against it. ideally dropping support for a java version should be communicated far in advance to facilitate the transition. is this the right time to make that decision and start communicating it (mailing list, jira, etc.)?

Re: [VOTE] Release Apache Spark 2.0.0 (RC5)

2016-07-23 Thread Ewan Leith
Ok cool, i didn't vote as I've done no real testing myself and i think the window had already closed anyway. I'm happy to wait for 2.0.1 for our systems. Thanks, Ewan On 23 Jul 2016 07:07, Reynold Xin wrote: Ewan not sure if you wanted to explicitly -1 so I didn’t include

Re: [VOTE] Release Apache Spark 2.0.0 (RC5)

2016-07-23 Thread Reynold Xin
Ewan not sure if you wanted to explicitly -1 so I didn’t include you in that. I will document this as a known issue in the release notes. We have other bugs that we have fixed since RC5, and we can fix those together in 2.0.1. On July 22, 2016 at 10:24:32 PM, Ewan Leith

Re: [VOTE] Release Apache Spark 2.0.0 (RC5)

2016-07-23 Thread Reynold Xin
The vote has passed with the following +1 votes and no -1 votes. I will work on packaging the new release next week. +1 Reynold Xin* Sean Owen* Shivaram Venkataraman* Jonathan Kelly Joseph E. Gonzalez* Krishna Sankar Dongjoon Hyun Ricardo Almeida Joseph Bradley* Matei Zaharia* Luciano Resende