Java Versions and Hadoop

2011-10-07 Thread Milind.Bhandarkar
Hi Folks, While I have seen the wiki on which java versions to use currently to run Hadoop, I have not seen any discussion about the roadmap of java version compatibility with future hadoop versions. Recently, Oracle retired the "Operating System Distributor License for Java" (DLJ) [http://robila

Re: Java Versions and Hadoop

2011-10-08 Thread Todd Lipcon
I think requiring Java 7 is years off... I think most people have doubts as to Java 7's stability until it's been adopted by a majority of applications, and the new features aren't compelling enough to jump ship, IMO. -Todd On Fri, Oct 7, 2011 at 3:33 PM, wrote: > Hi Folks, > > While I have see

Re: Java Versions and Hadoop

2011-10-08 Thread Ted Dunning
I hate to sound like the folks who only recently stopped using 1.4, but I am afraid that Todd is right on here. The folks who are desperate for new features are being siphoned off by Scala and Clojure which is leaving a core of recalcitrant termagants like me. I think that it is going to take som

Re: Java Versions and Hadoop

2011-10-09 Thread Brian Bockelman
You know, I was looking around for Java EOL information a few weeks ago and found this: http://www.oracle.com/technetwork/java/eol-135779.html I might not be reading closely enough, but that says Java 6 is EOL in 9 months. In terms of major releases and getting things stableā€¦ that's just aroun

Re: Java Versions and Hadoop

2011-10-09 Thread Ted Dunning
On Sun, Oct 9, 2011 at 5:49 PM, Brian Bockelman wrote: > You know, I was looking around for Java EOL information a few weeks ago and > found this: > > http://www.oracle.com/technetwork/java/eol-135779.html > > I might not be reading closely enough, but that says Java 6 is EOL in 9 > months. In te

Re: Java Versions and Hadoop

2011-10-09 Thread Konstantin Boudnik
On Sun, Oct 09, 2011 at 07:49PM, Brian Bockelman wrote: > You know, I was looking around for Java EOL information a few weeks ago and > found this: > > http://www.oracle.com/technetwork/java/eol-135779.html > > I might not be reading closely enough, but that says Java 6 is EOL in 9 > months. In

Re: Java Versions and Hadoop

2011-10-09 Thread Scott Carey
On 10/8/11 11:19 AM, "Ted Dunning" wrote: >I hate to sound like the folks who only recently stopped using 1.4, but I >am >afraid that Todd is right on here. > >The folks who are desperate for new features are being siphoned off by >Scala >and Clojure which is leaving a core of recalcitrant term

Re: Java Versions and Hadoop

2011-10-09 Thread Scott Carey
On 10/7/11 3:33 PM, "milind.bhandar...@emc.com" wrote: >Hi Folks, > >While I have seen the wiki on which java versions to use currently to run >Hadoop, I have not seen any discussion about the roadmap of java version >compatibility with future hadoop versions. > >Recently, Oracle retired the "O

Re: Java Versions and Hadoop

2011-10-09 Thread Scott Carey
On 10/9/11 9:22 PM, "Scott Carey" wrote: > > >On 10/8/11 11:19 AM, "Ted Dunning" wrote: > >>I hate to sound like the folks who only recently stopped using 1.4, but I >>am >>afraid that Todd is right on here. >> >>The folks who are desperate for new features are being siphoned off by >>Scala >>

Re: Java Versions and Hadoop

2011-10-10 Thread Milind.Bhandarkar
>I believe you mean when will it be compatible with Java 7, not require it >(based on all you mention above, other than the word 'required'). Is that >the case? I meant, "when will I be able to use some of the JDK 7 APIs in Hadoop code ?", which means JDK7 is required for Hadoop. - milind ---

Re: Java Versions and Hadoop

2011-10-11 Thread Steve Loughran
On 10/10/11 19:57, Scott Carey wrote: What JRE (6 update ?) is planned to be used when testing 0.23 at scale? Should JRE 7u2 also be tested? Both a new update to JRE 6 and 7 is due out very soon. 0.23 will be code complete after that. If I had enough resources and time, I'd test both the late

Re: Java Versions and Hadoop

2011-10-11 Thread Steve Loughran
On 10/10/11 22:32, milind.bhandar...@emc.com wrote: I believe you mean when will it be compatible with Java 7, not require it (based on all you mention above, other than the word 'required'). Is that the case? I meant, "when will I be able to use some of the JDK 7 APIs in Hadoop code ?", whi

Re: Java Versions and Hadoop

2011-10-11 Thread Milind.Bhandarkar
Steve, >I would suggest moving up projects on the side first, layers on top, >like your MPI-on-YARN stuff, where there is little or no installed base >to worry about That is exactly the project for which I though some of the new I/O interfaces would reduce the amount of code, (plus auto-freed res

Re: Java Versions and Hadoop

2011-10-11 Thread Arun C Murthy
MR2 supports different JVMs for user-apps. Arun On Oct 11, 2011, at 10:31 AM, wrote: > Steve, > >> I would suggest moving up projects on the side first, layers on top, >> like your MPI-on-YARN stuff, where there is little or no installed base >> to worry about > > That is exactly the projec

Re: Java Versions and Hadoop

2011-10-11 Thread Milind.Bhandarkar
Oh, that is very interesting ! Would I have to write my own container-launcher for that ? Or does existing container launcher support it ? - Milind --- Milind Bhandarkar Greenplum Labs, EMC (Disclaimer: Opinions expressed in this email are those of the author, and do not necessarily represent the

Re: Java Versions and Hadoop

2011-10-11 Thread Arun C Murthy
On Oct 11, 2011, at 11:57 AM, wrote: > Oh, that is very interesting ! Would I have to write my own > container-launcher for that ? Or does existing container launcher support > it ? > In MR2 the command line for the container is the AM's own responsibility. So, you can easily set whatever JA

Re: Java Versions and Hadoop

2011-11-03 Thread Scott Carey
On 10/11/11 4:18 AM, "Steve Loughran" wrote: >On 10/10/11 19:57, Scott Carey wrote: > >> What JRE (6 update ?) is planned to be used when testing 0.23 at scale? >> Should JRE 7u2 also be tested? Both a new update to JRE 6 and 7 is due >> out very soon. 0.23 will be code complete after that.