We're using EMR 2.4 in production, and it will take a while to upgrade to 2.6 depending on how fast EMR can provide us 2.6 AMI. But if that's what we need to fully use Tez-8, we will upgrade our cluster.
On Wed, Dec 10, 2014 at 1:44 PM, Siddharth Seth <[email protected]> wrote: > +1 for changing the default to 2.6.0. > > Publishing multiple jars - do you mean per hadoop version supported ? > That'll likely be very difficult to use - what would the dependency be ? > Will there be binary compatibility issues if someone builds against tez > jars built against Hadoop-2.6, and then deployed against 2.2 ? > > On Mon, Dec 8, 2014 at 10:02 AM, Hitesh Shah <[email protected]> wrote: > >> Thanks for the info, Douglas. We will not be dropping support for 2.4 for >> sure at the moment. >> >> Anyone else have any comments in this regard? >> >> @Bikas/@Sid - what do we do about publishing jars for a release? We would >> need to publish 2 or 3 sets? >> >> thanks >> — Hitesh >> >> On Dec 4, 2014, at 12:51 PM, Moore, Douglas < >> [email protected]> wrote: >> >> > 2.4.x and beyond for the customers we have >> > >> > Sent from my iPhone >> > >> >> On Dec 4, 2014, at 12:36 PM, Hitesh Shah <[email protected]> wrote: >> >> >> >> Hello folks >> >> >> >> Could folks who are following these mailing lists do a raise of hands >> on which versions of Hadoop you are trying to run Tez on? >> >> >> >> 1) 2.2.x >> >> 2) 2.3.x >> >> 3) 2.4.x >> >> 4) 2.5.x >> >> 5) 2.6.x >> >> >> >> Given that we are building out the UI and for the large part, the >> History UI ( i.e. the one which will display DAG details after an app has >> disappeared ) will be dependent on YARN Timeline, the UI will not be >> supported for Hadoop versions 2.2.x and 2.3.x given that they do not >> support Timeline. >> >> Likewise, ACLs support in Timeline was introduced in Hadoop 2.6.x - >> this means ACLs will not be enforceable on Hadoop 2.4.x and 2.5.x >> >> >> >> Also, as part of TEZ-1696, I also propose changing the default version >> to 2.6.0 given that secure Timeline is only available as of 2.6.0. >> >> >> >> Thoughts/concerns? >> >> >> >> thanks >> >> — Hitesh >> >> >> >> >
