RE: Planning Hadoop 2.6.1 release

2015-06-09 Thread Brahma Reddy Battula
g Cc: common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; hdfs-...@hadoop.apache.org Subject: Re: Planning Hadoop 2.6.1 release Hi Akira, Can we also include YARN-3242? YARN-3242 fixed a critical ZKRMStateStore bug. It will work better with YARN-2992. thanks zhihai On Tue, May 12, 2015 a

Re: Planning Hadoop 2.6.1 release

2015-07-01 Thread Sean Busbey
Regards > Brahma Reddy Battula > > > From: Zhihai Xu [z...@cloudera.com] > Sent: Wednesday, May 13, 2015 12:04 PM > To: mapreduce-...@hadoop.apache.org > Cc: common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; > hdfs-...@hadoop.apache.

Re: Planning Hadoop 2.6.1 release

2015-07-15 Thread Vinod Kumar Vavilapalli
y Battula >> >> >> From: Zhihai Xu [z...@cloudera.com] >> Sent: Wednesday, May 13, 2015 12:04 PM >> To: mapreduce-...@hadoop.apache.org >> Cc: common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; >> hdfs-...@hadoop.apache.o

Re: Planning Hadoop 2.6.1 release

2015-07-15 Thread Vinod Kumar Vavilapalli
educe-...@hadoop.apache.org> Cc: common-dev@hadoop.apache.org<mailto:common-dev@hadoop.apache.org>; yarn-...@hadoop.apache.org<mailto:yarn-...@hadoop.apache.org>; hdfs-...@hadoop.apache.org<mailto:hdfs-...@hadoop.apache.org> Subject: Re: Planning Hadoop 2.6.1 release Hi Akira, Can we a

Re: Planning Hadoop 2.6.1 release

2015-07-15 Thread Akira AJISAKA
apache.org>; yarn-...@hadoop.apache.org<mailto:yarn-...@hadoop.apache.org>; hdfs-...@hadoop.apache.org<mailto:hdfs-...@hadoop.apache.org> Subject: Re: Planning Hadoop 2.6.1 release Hi Akira, Can we also include YARN-3242? YARN-3242 fixed a critical ZKRMStateStore bug. It will work bette

Re: Planning Hadoop 2.6.1 release

2015-07-17 Thread Vinod Kumar Vavilapalli
- I also have a bunch of patches that I’d like to include, will update them right away. I’ve just finished this. The latest 2.6.1-candidate list is up at 64 JIRAs. Others, please look at the list and post anything else you’d like to get included for 2.6.1. Thanks +Vinod On Jul 15, 2015, at

Re: Planning Hadoop 2.6.1 release

2015-07-21 Thread Akira AJISAKA
Thanks Vinod for updating the candidate list. I'd like to include the followings 12 JIRAs: * YARN-3641 * YARN-3585 * YARN-2910 * HDFS-8431 * HDFS-7830 * HDFS-7763 * HDFS-7742 * HDFS-7235 * HDFS-7225 * MAPREDUCE-6324 * HADOOP-11934 * HADOOP-11491 Thanks, Akira On 7/18/15 11:13, Vinod Kumar Vavil

Re: Planning Hadoop 2.6.1 release

2015-07-21 Thread J. Rottinghuis
Hi Vinod, We've gone through the various lists of upstream jiras and wanted to provide our take on what we'd like to see in 2.6.1 release. In addition, we have ~58 jiras (some a group of work such as DN maintenance state) that we already have in production in a pre-2.6 release. I've gone through a

Re: Planning Hadoop 2.6.1 release

2015-07-22 Thread Vinod Kumar Vavilapalli
I’ve added them all to the 2.6.1-candidate list. I included everything even though some of them are major tickets. The list is getting large, we will have to cut these down once we get down to the next phase of figuring out what to include and what not to. Thanks +Vinod > On Jul 21, 2015, at 2

Re: Planning Hadoop 2.6.1 release

2015-07-24 Thread Sangjin Lee
Out of the JIRAs we proposed, please remove HDFS-7916. I don't think it applies to 2.6. Thanks, Sangjin On Wed, Jul 22, 2015 at 4:02 PM, Vinod Kumar Vavilapalli < vino...@hortonworks.com> wrote: > I’ve added them all to the 2.6.1-candidate list. I included everything > even though some of them a

Re: Planning Hadoop 2.6.1 release

2015-07-31 Thread Akira AJISAKA
Thanks Joep and your team members for creating the list. I really appreciate your work. I looked your 'not yet marked with 2.6.1-candidate' list and categorized them. 1) Now marked as 2.6.1-candidate and I agree with you to keep it marked. * HDFS-7213 * HDFS-7788 * HDFS-7884 * HDFS-7930 * YARN

Re: Planning Hadoop 2.6.1 release

2015-07-31 Thread Sangjin Lee
Thanks Akira. I'd like to make one small correction. If we're getting HDFS-7704, then we should also get HDFS-7916. My earlier comment was assuming HDFS-7704 was not included in the list. But if is (and I think it should), then we should also get HDFS-7916 as it addresses an important issue relate

Re: Planning Hadoop 2.6.1 release

2015-07-31 Thread Sangjin Lee
Just for the completeness, the following JIRAs have already been committed to branch-2.6 and thus will be part of 2.6.1: HADOOP-11307 YARN-2375 HDFS-7425 HDFS-4882 HDFS-7489 HDFS-7503 HDFS-7443 HDFS-3443 HADOOP-11466 HDFS-7733 MAPREDUCE-6237 YARN-3251 HDFS-6153 reverted On Fri, Jul 31, 2015 at 1

Re: Planning Hadoop 2.6.1 release

2015-08-03 Thread Vinod Kumar Vavilapalli
Tx for the list, Joep! > Jiras not yet marked with 2.6.1-candidate that we'd like to see in 2.6.1: A whole bunch of them already are marked so, presumably from my list. I’ve added the remaining for discussion. > HDFS-7281 (committed in 3.0) This is an incompatible change, so not adding it. >

Re: Planning Hadoop 2.6.1 release

2015-08-03 Thread Vinod Kumar Vavilapalli
Makes sense, it was caused by HDFS-7704 which got into 2.7.0 only and is not part of the candidate list. Removed HDFS-7916 from the list. Thanks +Vinod > On Jul 24, 2015, at 6:32 PM, Sangjin Lee wrote: > > Out of the JIRAs we proposed, please remove HDFS-7916. I don't think it > applies to 2.6

Re: Planning Hadoop 2.6.1 release

2015-08-03 Thread Sangjin Lee
See my later update in the thread. HDFS-7704 is in the list. Thanks, Sangjin On Mon, Aug 3, 2015 at 1:19 PM, Vinod Kumar Vavilapalli < vino...@hortonworks.com> wrote: > Makes sense, it was caused by HDFS-7704 which got into 2.7.0 only and is > not part of the candidate list. Removed HDFS-7916 fr

Re: Planning Hadoop 2.6.1 release

2015-08-05 Thread Wangda Tan
Can we add following two fixes to 2.6.1? https://issues.apache.org/jira/browse/YARN-2922 and https://issues.apache.org/jira/browse/YARN-3487. They're not fatal issue, but they can cause lots of issue in a large cluster. Thanks, Wangda On Mon, Aug 3, 2015 at 1:21 PM, Sangjin Lee wrote: > See

Re: Planning Hadoop 2.6.1 release

2015-08-05 Thread Zhijie Shen
@hadoop.apache.org; hdfs-...@hadoop.apache.org Subject: Re: Planning Hadoop 2.6.1 release Can we add following two fixes to 2.6.1? https://issues.apache.org/jira/browse/YARN-2922 and https://issues.apache.org/jira/browse/YARN-3487. They're not fatal issue, but they can cause lots of issue in a

Re: Planning Hadoop 2.6.1 release

2015-08-05 Thread Rich Haase
+1 to add those fixes. Rich Haase | Sr. Software Engineer | Pandora m 303.887.1146 | rha...@pandora.com On 8/5/15, 11:42 AM, "Wangda Tan" wrote: >Can we add following two fixes to 2.6.1? > >https://issues.apache.org/jira/browse/YARN-2922 and >https://issues.apache.org/jira/browse/YARN-3487.

Re: Planning Hadoop 2.6.1 release

2015-08-05 Thread Allan Wilson
Another +1 to add those fixes. YARN-3487 bug can grind a large cluster to a halt repeatedly -Allan Allan Wilson | Sr. Software Engineer | Pandora m 919.841.2449 | awils...@pandora.com On 8/5/15, 1:52 PM, "Rich Haase" wrote: >+1 to add those fixes. > > >Rich Haase | Sr. Software En

Re: Planning Hadoop 2.6.1 release

2015-08-05 Thread Junping Du
-...@hadoop.apache.org; yarn-...@hadoop.apache.org Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org Subject: Re: Planning Hadoop 2.6.1 release +1 to add those fixes. Rich Haase | Sr. Software Engineer | Pandora m 303.887.1146 | rha...@pandora.com On 8/5/15, 11:42 AM, "Wangda Tan&qu

Re: Planning Hadoop 2.6.1 release

2015-08-05 Thread Sean Busbey
op.apache.org; hdfs-...@hadoop.apache.org > Subject: Re: Planning Hadoop 2.6.1 release > > +1 to add those fixes. > > > Rich Haase | Sr. Software Engineer | Pandora > m 303.887.1146 | rha...@pandora.com > > > > > On 8/5/15, 11:42 AM, "Wangda Tan" wro

RE: Planning Hadoop 2.6.1 release

2015-08-05 Thread Rohith Sharma K S
yarn-...@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org Subject: Re: Planning Hadoop 2.6.1 release Another +1 to add those fixes. YARN-3487 bug can grind a large cluster to a halt repeatedly -Allan Allan Wilson | Sr. Software Engineer | Pandora m 919.841.2449 | awils...@pandora.com

Re: Planning Hadoop 2.6.1 release

2015-08-10 Thread Vinod Kumar Vavilapalli
Added them both. Tx Wangda! +Vinod > On Aug 5, 2015, at 10:42 AM, Wangda Tan wrote: > > Can we add following two fixes to 2.6.1? > > https://issues.apache.org/jira/browse/YARN-2922 and > https://issues.apache.org/jira/browse/YARN-3487. > > They're not fatal issue, but they can cause lots of i

Re: Planning Hadoop 2.6.1 release

2015-08-10 Thread Vinod Kumar Vavilapalli
gt; Sent: Wednesday, August 05, 2015 10:42 AM > To: yarn-...@hadoop.apache.org > Cc: mapreduce-...@hadoop.apache.org; common-dev@hadoop.apache.org; > hdfs-...@hadoop.apache.org > Subject: Re: Planning Hadoop 2.6.1 release > > Can we add following two fixes to 2.6.1? > &g

Re: Planning Hadoop 2.6.1 release

2015-08-10 Thread Vinod Kumar Vavilapalli
anks, > > Junping > > From: Rich Haase > Sent: Thursday, August 06, 2015 1:52 AM > To: mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org > Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org > Subject: Re: Planning Hadoop 2.6.1 release > >

Re: Planning Hadoop 2.6.1 release

2015-08-10 Thread Vinod Kumar Vavilapalli
___ >> From: Rich Haase >> Sent: Thursday, August 06, 2015 1:52 AM >> To: mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org >> Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org >> Subject: Re: Planning Hadoop

Re: Planning Hadoop 2.6.1 release

2015-08-10 Thread Vinod Kumar Vavilapalli
> -Original Message- > From: Allan Wilson [mailto:awils...@pandora.com] > Sent: 05 August 2015 23:25 > To: common-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org; > yarn-...@hadoop.apache.org > Cc: hdfs-...@hadoop.apache.org > Subject: Re: Planning Hadoop 2.6.1 release &g

Re: Planning Hadoop 2.6.1 release

2015-08-10 Thread Vinod Kumar Vavilapalli
t; >> >> Thanks & Regards >> Rohith Sharma K S >> >> >> -Original Message- >> From: Allan Wilson [mailto:awils...@pandora.com] >> Sent: 05 August 2015 23:25 >> To: common-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org; &

Re: Planning Hadoop 2.6.1 release

2015-08-11 Thread Hitesh Shah
ailto:awils...@pandora.com] >>> Sent: 05 August 2015 23:25 >>> To: common-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org; >>> yarn-...@hadoop.apache.org >>> Cc: hdfs-...@hadoop.apache.org >>> Subject: Re: Planning Hadoop 2.6.1 release >>>

Re: Planning Hadoop 2.6.1 release

2015-08-14 Thread Sangjin Lee
15 1:52 AM > > To: mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org > > Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org > > Subject: Re: Planning Hadoop 2.6.1 release > > > > +1 to add those fixes. > > > > > > Rich Haase | Sr. Software Engin

Re: Planning Hadoop 2.6.1 release

2015-08-14 Thread Vinod Kumar Vavilapalli
cluster. Hope this is >> not >>>> too late. >>>> >>>> Thanks, >>>> >>>> Junping >>>> ____________ >>>> From: Rich Haase >>>> Sent: Thursday, August 06, 2015 1

Re: Planning Hadoop 2.6.1 release

2015-08-14 Thread Vinod Kumar Vavilapalli
>> >>>>> I would like to nominate YARN-3832 as 2.6.1 candidate which is critical >>>>> and I also saw it happened recently on a 2.6.0 cluster. Hope this is >>> not >>>>> too late. >>>>> >>>>> Thanks, >>>&

Re: Planning Hadoop 2.6.1 release

2015-08-16 Thread Vinayakumar B
;> On Wed, Aug 5, 2015 at 2:56 PM, Junping Du > wrote: > >>>> > >>>>> I would like to nominate YARN-3832 as 2.6.1 candidate which is > critical > >>>>> and I also saw it happened recently on a 2.6.0 cluster. Hope this is > >>> n

Re: Planning Hadoop 2.6.1 release

2015-09-09 Thread Nikhil
a straight forward fix that is > >>>> currently only in 2.8+ and would benefit 2.6 and 2.7. > >>>> > >>>> On Wed, Aug 5, 2015 at 2:56 PM, Junping Du > wrote: > >>>> > >>>>> I would like to nominate YARN-3832 as 2.6.1 candidate which is > critical > >>>>

Re: Planning Hadoop 2.6.1 release

2015-09-09 Thread Vinod Kumar Vavilapalli
g<mailto:mapreduce-...@hadoop.apache.org>; yarn-...@hadoop.apache.org<mailto:yarn-...@hadoop.apache.org> Cc: common-dev@hadoop.apache.org<mailto:common-dev@hadoop.apache.org>; hdfs-...@hadoop.apache.org<mailto:hdfs-...@hadoop.apache.org> Subject: Re: Planning Hadoop

Re: Planning Hadoop 2.6.1 release

2015-04-30 Thread Arpit Agarwal
HDFS candidates for back-porting to Hadoop 2.6.1. The first two were requested in [1]. HADOOP-11674. oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt synchronization HDFS-7009. Active NN and standb

Re: Planning Hadoop 2.6.1 release

2015-04-30 Thread Chris Nauroth
Thank you, Arpit. In addition, I suggest we include the following: HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full HADOOP-11604. Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. HADOOP-11648. S

RE: Planning Hadoop 2.6.1 release

2015-05-03 Thread Brahma Reddy Battula
Nauroth [cnaur...@hortonworks.com] Sent: Friday, May 01, 2015 4:32 AM To: mapreduce-...@hadoop.apache.org; common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; hdfs-...@hadoop.apache.org Subject: Re: Planning Hadoop 2.6.1 release Thank you, Arpit. In addition, I suggest we include the following: HAD

Re: Planning Hadoop 2.6.1 release

2015-05-12 Thread Akira AJISAKA
che.org Subject: Re: Planning Hadoop 2.6.1 release Thank you, Arpit. In addition, I suggest we include the following: HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full HADOOP-11604. Prevent ConcurrentModificationException while closing domain sockets during shutdown

Re: Planning Hadoop 2.6.1 release

2015-05-12 Thread Zhihai Xu
h = fs.makeQualified(path); >> FileContext fc = FileContext.getFileContext(path.toUri(),new >> Configuration()); >> >> >> >> Thanks & Regards >> Brahma Reddy Battula >> >> From: Chris Nauroth [cnaur...