Re: [VOTE] Release Apache Spark 2.0.0 (RC5)

2016-07-23 Thread Ewan Leith
Ok cool, i didn't vote as I've done no real testing myself and i think the window had already closed anyway. I'm happy to wait for 2.0.1 for our systems. Thanks, Ewan On 23 Jul 2016 07:07, Reynold Xin wrote: Ewan not sure if you wanted to explicitly -1 so I didn’t include you in that. I will

drop java 7 support for spark 2.1.x or spark 2.2.x

2016-07-23 Thread Koert Kuipers
dropping java 7 support was considered for spark 2.0.x but we decided against it. ideally dropping support for a java version should be communicated far in advance to facilitate the transition. is this the right time to make that decision and start communicating it (mailing list, jira, etc.)? per

Re: drop java 7 support for spark 2.1.x or spark 2.2.x

2016-07-23 Thread Mark Hamstra
Why the push to remove Java 7 support as soon as possible (which is how I read your "cluster admins plan to migrate by date X, so Spark should end Java 7 support then, too")? First, I don't think we should be removing Java 7 support until some time after all or nearly all relevant clusters are act

Re: drop java 7 support for spark 2.1.x or spark 2.2.x

2016-07-23 Thread Koert Kuipers
i care about signalling it in advance mostly. and given the performance differences we do have some interest in pushing towards java 8 On Jul 23, 2016 6:10 PM, "Mark Hamstra" wrote: Why the push to remove Java 7 support as soon as possible (which is how I read your "cluster admins plan to migrat

Re: drop java 7 support for spark 2.1.x or spark 2.2.x

2016-07-23 Thread Mark Hamstra
Sure, signalling well ahead of time is good, as is getting better performance from Java 8; but do either of those interests really require dropping Java 7 support sooner rather than later? Now, to retroactively copy edit myself, when I previously wrote "after all or nearly all relevant clusters ar

Re: drop java 7 support for spark 2.1.x or spark 2.2.x

2016-07-23 Thread Koert Kuipers
They don't require dropping it sooner rather than later. But signalling in some way that java 8 is (strongly) recommend would be good. On Jul 23, 2016 6:59 PM, "Mark Hamstra" wrote: > Sure, signalling well ahead of time is good, as is getting better > performance from Java 8; but do either of th

Re: drop java 7 support for spark 2.1.x or spark 2.2.x

2016-07-23 Thread Dongjoon Hyun
Hi, All. What about providing a official benchmark result between `Apache Spark on JDK7` and `Apache Spark on JDK8`? I think that is enough for this issue since we cannot drive users. We had better let users choose one of JDK7/JDK8 for their own benefits. Bests, Dongjoon. On Sat, Jul 23, 2016