Re: Request for comments: Java 7 removal

2017-02-14 Thread Yuming Wang
There is a way only Spark use Java 8, Hadoop still use Java 7: spark-conf.jpg (58K) By the way, I have a way to install any spark version on CM5.4 - CM5.7 by custom CSD

Re: Request for comments: Java 7 removal

2017-02-14 Thread Koert Kuipers
what about the conversation about dropping scala 2.10? On Fri, Feb 10, 2017 at 11:47 AM, Sean Owen wrote: > As you have seen, there's a WIP PR to implement removal of Java 7 support: > https://github.com/apache/spark/pull/16871 > > I have heard several +1s at

Re: Request for comments: Java 7 removal

2017-02-14 Thread Sean Owen
Yes, that's a key concern about the Java dependency, that its update is a function of the OS packages and those who control them, which is often not the end user. I think that's why this has been delayed a while. My general position is that, of course, someone in that boat can use Spark 2.1.x.

Re: Request for comments: Java 7 removal

2017-02-13 Thread Charles Allen
I think the biggest concern is enterprise users/operators who do not have the authority or access to upgrade hadoop/yarn clusters to java8. As a reference point, apparently CDH 5.3

Re: Request for comments: Java 7 removal

2017-02-10 Thread Sean Owen
As usual I think maintenance release branches are created ad-hoc when there seems to be some demand. I personally would guess there will be at least one more 2.0.x and 2.1.x maintenance release. In that sense, yeah it's not really even the end of actively supporting a Java 7-compatible release.

Re: Request for comments: Java 7 removal

2017-02-10 Thread Denis Bolshakov
Hello Sean, Thanks for asking. >From my point of view it Ok to remove Java 7 support from Spark since 2.2 release. But as a lot of users still use java 7 could you please share your vision about bug fix releases for 2.0 and 2.1? About python 2.6 https://www.python.org/download/releases/2.6/

Request for comments: Java 7 removal

2017-02-10 Thread Sean Owen
As you have seen, there's a WIP PR to implement removal of Java 7 support: https://github.com/apache/spark/pull/16871 I have heard several +1s at https://issues.apache.org/jira/browse/SPARK-19493 but am asking for concerns too, now that there's a concrete change to review. If this goes in for