Re: Hadoop - Major releases

2015-03-17 Thread Colin P. McCabe
Thanks, Andrew and Joep. +1 for maintaining wire and API compatibility, but moving to JDK8 in 3.0 best, Colin On Mon, Mar 16, 2015 at 3:22 PM, Andrew Wang wrote: > I took the liberty of adding line breaks to Joep's mail. > > Thanks for the great feedback Joep. The goal with 3.x is to maintain A

Re: Hadoop - Major releases

2015-03-16 Thread Andrew Wang
I took the liberty of adding line breaks to Joep's mail. Thanks for the great feedback Joep. The goal with 3.x is to maintain API and wire compatibility with 2.x, which I think addresses most of your concerns. A 2.x client running on JDK7 would then still be able to talk to a 3.x server running on

Re: Hadoop - Major releases

2015-03-16 Thread J. Rottinghuis
Here are some of our thought on the discussions of the past few days with respect to backwards compatibility. In general at Twitter we're not necessarily against backwards incompatible changes per se. *It depends on the "Return on Pain". While it is hard to quantify the returns in the a

Re: Hadoop - Major releases

2015-03-09 Thread Andrew Wang
Hi Mayank, > 1. We would be moving to Hadoop -3 (Not this year though) however I don't > see we can do another JDK upgrade so soon. So the point I am trying to make > is we should be supporting jdk 7 as well for Hadoop-3. > > We'll still be releasing 2.x releases for a while, with similar feature

Re: Hadoop - Major releases

2015-03-09 Thread Mayank Bansal
Hi Andrew, I wish things are as simple as you are pointing out. At least they are not for us so far. Couple of things 1. We would be moving to Hadoop -3 (Not this year though) however I don't see we can do another JDK upgrade so soon. So the point I am trying to make is we should be supporting j

Re: Hadoop - Major releases

2015-03-09 Thread Jagane Sundar
Thichphuoctien On Mar 9, 2015 3:35 PM, "Andrew Wang" wrote: > Hi Mayank, > > Note that Hadoop 3 does not mean the end of updates for Hadoop 2.x, which > will keep supporting JDK7 for a while yet. Someone on the original thread > also proposed keeping Hadoop 3 JDK7-source compatible to make backpo

Re: Hadoop - Major releases

2015-03-09 Thread Andrew Wang
Hi Mayank, Note that Hadoop 3 does not mean the end of updates for Hadoop 2.x, which will keep supporting JDK7 for a while yet. Someone on the original thread also proposed keeping Hadoop 3 JDK7-source compatible to make backports to 2.x easier. I support this. Note also that the jump from Hadoop

Re: Hadoop - Major releases

2015-03-09 Thread Mayank Bansal
Hi Guys, >From my prospective @ ebay we are not going to upgrade to JDK 8 any time soon we just upgraded to 7 and not want to move further at least this year so I will request you guys not to drop the support for JDK 7 as that would be very crucial for us to move forward. We also just completed o

Hadoop - Major releases

2015-03-09 Thread Arun Murthy
Over the last few days, we have had lots of discussions that have intertwined several major themes: # When/why do we make major Hadoop releases? # When/how do we move to major JDK versions? # To a lesser extent, we have debated another theme: what do we do about trunk? For now, let's park