Re: hadoop-2.5 - June end?

2014-06-27 Thread Karthik Kambatla
I was trying to do a JIRA bulk update to target all non-blockers to 2.6, but doesn't look like the bulk-update tool doesn't have Target Version. Does anyone know if that is true or if it is me not having permissions? On Thu, Jun 26, 2014 at 12:08 AM, Karthik Kambatla ka...@cloudera.com wrote:

Re: hadoop-2.5 - June end?

2014-06-27 Thread Vinod Kumar Vavilapalli
Like I mentioned before, I'd like to get RM-webservices : YARN-1695 included. May be we can wait for the branch till that point of time. I am also pushing for Shared Cache: YARN-1492 reviews. Again, like I said before, we can take it as we go. +Vinod Hortonworks Inc. http://hortonworks.com/ On

Re: hadoop-2.5 - June end?

2014-06-27 Thread Karthik Kambatla
Including YARN-1695 makes sense, just made it a blocker to ensure we get it in. YARN-1492 - would be great if we get it in, but I am not sure how feasible it is. Given it is being developed on a branch, there is also the merge to trunk and branch-2 overhead. I would prefer branching soon so we

Re: hadoop-2.5 - June end?

2014-06-27 Thread Karthik Kambatla
Spoke to Vinod offline. The tentative plan is cut branch-2.5 middle of next week and work towards getting the remaining blockers in as soon as possible. On Fri, Jun 27, 2014 at 12:56 PM, Karthik Kambatla ka...@cloudera.com wrote: Including YARN-1695 makes sense, just made it a blocker to

Re: hadoop-2.5 - June end?

2014-06-27 Thread Sangjin Lee
Hi Karthik, Regarding YARN-1492 (shared cache), it should not hold up 2.5 if it is not there. If it's not there, it's not there. Also, FYI, since it turns out the changes are not too large and should not have a lot of conflicts, we're thinking of not using a separate branch. Regards, Sangjin

Re: hadoop-2.5 - June end?

2014-06-23 Thread Arun C Murthy
Folks, I'd appreciate some help here. Due to family reasons (all good ones), I'll be away for a couple of weeks. Can someone else pick up the RM duties for hadoop-2.5? Maybe Andrew since he's expressed interest in the past? I will pick up the thread again for hadoop-2.6, but I don't want to

Re: hadoop-2.5 - June end?

2014-06-23 Thread Karthik Kambatla
I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I might need some help from someone more familiar with HDFS. On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I'd appreciate some help here. Due to family reasons (all good ones), I'll be

Re: hadoop-2.5 - June end?

2014-06-23 Thread Sangjin Lee
It would be great if we can consider the shared cache (YARN-1492) as part of 2.5. It obviously will depend on the reviews from folks, but the feature itself should be reasonably solid. Thanks, Sangjin On Mon, Jun 23, 2014 at 2:24 PM, Arun C Murthy a...@hortonworks.com wrote: Thanks Karthik!

Re: hadoop-2.5 - June end?

2014-06-23 Thread Andrew Wang
Thanks for volunteering Karthik, I can help out with anything on the HDFS side if you need it. Best, Andrew On Mon, Jun 23, 2014 at 2:30 PM, Sangjin Lee sjl...@gmail.com wrote: It would be great if we can consider the shared cache (YARN-1492) as part of 2.5. It obviously will depend on the

Re: hadoop-2.5 - June end?

2014-06-23 Thread Karthik Kambatla
While YARN-1492 would greatly benefit performance, I think it might be a little too ambitious at this point to include it in 2.5 without delaying it. As I mentioned before and from my offline conversation with Arun, we might want to release 2.6 end of July and that might be a better vehicle for

Re: hadoop-2.5 - June end?

2014-06-23 Thread Jian He
Just found the roadmap includes a wrong jira link for RM Webservices YARN-1731, it should be YARN-1695 https://issues.apache.org/jira/browse/YARN-1695. Jian On Mon, Jun 23, 2014 at 2:51 PM, Karthik Kambatla ka...@cloudera.com wrote: While YARN-1492 would greatly benefit performance, I think

Re: hadoop-2.5 - June end?

2014-06-23 Thread Tsuyoshi OZAWA
IMHO, I'd like to +1 to include YARN-1492 and work-preserving restart in 2.6. I believe they are good improvement, but they are work-in-progress and it takes a bit time to be done. Thanks, - Tsuyoshi On Tue, Jun 24, 2014 at 7:13 AM, Jian He j...@hortonworks.com wrote: Just found the roadmap

Re: hadoop-2.5 - June end?

2014-06-23 Thread Akira AJISAKA
Extended attributes (HDFS-2006) is already merged to branch-2, so I'll update the Roadmap wiki to change it from 2.6 to 2.5. Please correct me if I am wrong. Thanks, Akira (2014/06/23 16:28), Tsuyoshi OZAWA wrote: IMHO, I'd like to +1 to include YARN-1492 and work-preserving restart in 2.6. I

Re: hadoop-2.5 - June end?

2014-06-23 Thread Vinod Kumar Vavilapalli
Tx Jian, updated the wiki. +Vinod On Jun 23, 2014, at 3:13 PM, Jian He j...@hortonworks.com wrote: Just found the roadmap includes a wrong jira link for RM Webservices YARN-1731, it should be YARN-1695 https://issues.apache.org/jira/browse/YARN-1695. Jian On Mon, Jun 23, 2014 at 2:51

Re: hadoop-2.5 - June end?

2014-06-23 Thread Vinod Kumar Vavilapalli
I started reviewing YARN-1492 and synced up offline with Sangjin and Chris who are leading this. I proposed that we should get the reviews and commits going as they go and then mark the feature alpha, beta or stable depending on how far we are ahead with the feature and how it aligns with the

Re: hadoop-2.5 - June end?

2014-06-11 Thread Karthik Kambatla
. Regards, Uma -Original Message- From: Suresh Srinivas [mailto:sur...@hortonworks.com] Sent: Tuesday, June 10, 2014 10:15 PM To: mapreduce-dev@hadoop.apache.org Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: Re: hadoop-2.5 - June end

Re: hadoop-2.5 - June end?

2014-06-10 Thread Sandy Ryza
That sounds reasonable to me. -Sandy On Mon, Jun 9, 2014 at 9:39 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, As you can see from the Roadmap wiki, it looks like several items are still a bit away from being ready. I think rather than wait for them, it will be useful to create

Re: hadoop-2.5 - June end?

2014-06-10 Thread Suresh Srinivas
We should also include extended attributes feature for HDFS from HDFS-2006 for release 2.5. On Mon, Jun 9, 2014 at 9:39 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, As you can see from the Roadmap wiki, it looks like several items are still a bit away from being ready. I think

Re: hadoop-2.5 - June end?

2014-06-10 Thread Ravi Prakash
Does this also mean that there won't be a 2.4.1 Apache release? On Tuesday, June 10, 2014 9:45 AM, Suresh Srinivas sur...@hortonworks.com wrote: We should also include extended attributes feature for HDFS from HDFS-2006 for release 2.5. On Mon, Jun 9, 2014 at 9:39 AM, Arun C Murthy

Re: hadoop-2.5 - June end?

2014-06-10 Thread Arun C Murthy
No, I'm currently in the middle of the 2.4.1 RC. Watch this space. thanks, Arun On Jun 10, 2014, at 11:46 AM, Ravi Prakash ravi...@ymail.com wrote: Does this also mean that there won't be a 2.4.1 Apache release? On Tuesday, June 10, 2014 9:45 AM, Suresh Srinivas sur...@hortonworks.com

Re: hadoop-2.5 - June end?

2014-06-10 Thread Tsuyoshi OZAWA
? Dave Marion -Original Message- From: Arun C Murthy [mailto:a...@hortonworks.com] Sent: Monday, June 09, 2014 12:40 PM To: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-dev@hadoop.apache.org Subject: hadoop-2.5 - June end? Folks

hadoop-2.5 - June end?

2014-06-09 Thread Arun C Murthy
Folks, As you can see from the Roadmap wiki, it looks like several items are still a bit away from being ready. I think rather than wait for them, it will be useful to create an intermediate release (2.5) this month - I think ATS security is pretty close, so we can ship that. I'm thinking