Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Vinod Kumar Vavilapalli]

The last of the blockers went in late last week.

Re-spinning the RC now.

Thanks
+Vinod

> On Nov 13, 2015, at 10:26 AM, Vinod Kumar Vavilapalli  
> wrote:
> 
> Thanks for reporting this Jason!
> 
> Everyone, I am canceling this RC given the feedback, we will go again after 
> addressing the open issues.
> 
> Thanks
> +Vinod
> 
>> On Nov 13, 2015, at 7:57 AM, Jason Lowe > > wrote:
>> 
>> -1 (binding)
>> 
>> Ran into public localization issues and filed YARN-4354 
>> . We need that resolved 
>> before the release is ready.  We will either need a timely fix or may have 
>> to revert YARN-2902 to unblock the release if my root-cause analysis is 
>> correct.  I'll dig into this more today.
>> 
>> Jason
>> 
>> From: Vinod Kumar Vavilapalli > >
>> To: common-...@hadoop.apache.org ; 
>> hdfs-dev@hadoop.apache.org ; 
>> yarn-...@hadoop.apache.org ; 
>> mapreduce-...@hadoop.apache.org  
>> Cc: vino...@apache.org  
>> Sent: Wednesday, November 11, 2015 10:31 PM
>> Subject: [VOTE] Release Apache Hadoop 2.7.2 RC0
>> 
>> Hi all,
>> 
>> 
>> I've created a release candidate RC0 for Apache Hadoop 2.7.2.
>> 
>> 
>> As discussed before, this is the next maintenance release to follow up
>> 2.7.1.
>> 
>> 
>> The RC is available for validation at:
>> 
>> *http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/ 
>> 
>> 
>> > >*
>> 
>> 
>> The RC tag in git is: release-2.7.2-RC0
>> 
>> 
>> The maven artifacts are available via repository.apache.org 
>>  at
>> 
>> *https://repository.apache.org/content/repositories/orgapachehadoop-1023/ 
>> 
>> 
>> > >*
>> 
>> 
>> As you may have noted, an unusually long 2.6.3 release caused 2.7.2 to slip
>> by quite a bit. This release's related discussion threads are linked below:
>> [1] and [2].
>> 
>> 
>> Please try the release and vote; the vote will run for the usual 5 days.
>> 
>> 
>> Thanks,
>> 
>> Vinod
>> 
>> 
>> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 
>> 
>> 
>> [2]: Planning Apache Hadoop 2.7.2
>> http://markmail.org/message/iktqss2qdeykgpqk 
>> 
>> 
>> 
> 

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Vinod Kumar Vavilapalli]

Seeing as this came up very late, I am leaning towards dropping this off from 
2.7.2.

That said, I don’t see any reason why this shouldn’t be in 2.8.0 and 2.7.3. Set 
the target-versions accordingly on JIRA. If you agree, appreciate backport help 
to those branches.

Thanks
+Vinod

> On Dec 15, 2015, at 12:59 AM, Konstantin Shvachko  
> wrote:
> 
> Sorry for bringing this up late.
> I think we should pick up HDFS-9516 for this release.
> Rather critical bug fix, but up to you, Vinod.
> 
> Thanks,
> --Konst
> 
> On Wed, Nov 11, 2015 at 8:31 PM, Vinod Kumar Vavilapalli > wrote:
> 
>> Hi all,
>> 
>> 
>> I've created a release candidate RC0 for Apache Hadoop 2.7.2.
>> 
>> 
>> As discussed before, this is the next maintenance release to follow up
>> 2.7.1.
>> 
>> 
>> The RC is available for validation at:
>> 
>> *http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/
>> 
>> *
>> 
>> 
>> The RC tag in git is: release-2.7.2-RC0
>> 
>> 
>> The maven artifacts are available via repository.apache.org at
>> 
>> *https://repository.apache.org/content/repositories/orgapachehadoop-1023/
>> 
>> >> *
>> 
>> 
>> As you may have noted, an unusually long 2.6.3 release caused 2.7.2 to slip
>> by quite a bit. This release's related discussion threads are linked below:
>> [1] and [2].
>> 
>> 
>> Please try the release and vote; the vote will run for the usual 5 days.
>> 
>> 
>> Thanks,
>> 
>> Vinod
>> 
>> 
>> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes
>> 
>> [2]: Planning Apache Hadoop 2.7.2
>> http://markmail.org/message/iktqss2qdeykgpqk
>> 

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Konstantin Shvachko]

Sorry for bringing this up late.
I think we should pick up HDFS-9516 for this release.
Rather critical bug fix, but up to you, Vinod.

Thanks,
--Konst

On Wed, Nov 11, 2015 at 8:31 PM, Vinod Kumar Vavilapalli  wrote:

> Hi all,
>
>
> I've created a release candidate RC0 for Apache Hadoop 2.7.2.
>
>
> As discussed before, this is the next maintenance release to follow up
> 2.7.1.
>
>
> The RC is available for validation at:
>
> *http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/
>
> *
>
>
> The RC tag in git is: release-2.7.2-RC0
>
>
> The maven artifacts are available via repository.apache.org at
>
> *https://repository.apache.org/content/repositories/orgapachehadoop-1023/
>
>  >*
>
>
> As you may have noted, an unusually long 2.6.3 release caused 2.7.2 to slip
> by quite a bit. This release's related discussion threads are linked below:
> [1] and [2].
>
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
>
> Thanks,
>
> Vinod
>
>
> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes
>
> [2]: Planning Apache Hadoop 2.7.2
> http://markmail.org/message/iktqss2qdeykgpqk
>

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Konstantin Boudnik]

Vinod, are you Ok with me putting it into 2.7.2?

Cos

On Mon, Nov 30, 2015 at 01:25PM, Vinod Kumar Vavilapalli wrote:
> I think we should get it in, I am still stuck on a couple of HDFS patches.
> 
> But I was not sure overall if the patch was right. Commented on the JIRA 
> regarding the same.
> 
> Thanks
> +Vinod
> 
> > On Nov 27, 2015, at 1:54 AM, Steve Loughran  wrote:
> > 
> > well, I'm not going to block it...it doesn't add anything more to the pom 
> > dependencies that aren't there right now
> > 
> >> On 26 Nov 2015, at 18:51, Konstantin Boudnik  wrote:
> >> 
> >> On Wed, Nov 25, 2015 at 01:51PM, Steve Loughran wrote:
> >>> 
>  On 25 Nov 2015, at 02:48, Konstantin Boudnik  wrote:
>  
>  Vinod, hopefully it isn't too late for a quick fix to be included into 
>  2.7.2
>  (sorry for jumping too late on this train). The JIRA in question is
>  HADOOP-12415 and I have committed it to trunk and branch-2 already.
>  
>  Please let me know if this is still Ok to add into 2.7.2 as it seems to 
>  be
>  going through a respin. Thanks in advance,
>  
>  Cos
>  
> >>> 
> >>> 
> >>> can you hold it off until 2.7.3? 2.7.2 was tested and we shoudn't be 
> >>> making
> >>> more changes now, even if its just to the POMs
> >> 
> >> It's up to you guys, the fix is small but pretty critical IMO. The change 
> >> in
> >> question is literally breaking the build from the get go. In Bigtop we had 
> >> to
> >> patch 2.7.1 so we at least can build it into the stack. 
> >> 
> >> For the users using official release tarball it won't simply work unless 
> >> they
> >> are going to patch it themselves.
> >> 
> >> Cos
> > 
> > 
> 


signature.asc
Description: Digital signature

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Konstantin Boudnik]

On Wed, Nov 25, 2015 at 01:51PM, Steve Loughran wrote:
> 
> > On 25 Nov 2015, at 02:48, Konstantin Boudnik  wrote:
> > 
> > Vinod, hopefully it isn't too late for a quick fix to be included into 2.7.2
> > (sorry for jumping too late on this train). The JIRA in question is
> > HADOOP-12415 and I have committed it to trunk and branch-2 already.
> > 
> > Please let me know if this is still Ok to add into 2.7.2 as it seems to be
> > going through a respin. Thanks in advance,
> > 
> > Cos
> > 
> 
> 
> can you hold it off until 2.7.3? 2.7.2 was tested and we shoudn't be making
> more changes now, even if its just to the POMs

It's up to you guys, the fix is small but pretty critical IMO. The change in
question is literally breaking the build from the get go. In Bigtop we had to
patch 2.7.1 so we at least can build it into the stack. 

For the users using official release tarball it won't simply work unless they
are going to patch it themselves.

Cos


signature.asc
Description: Digital signature

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Steve Loughran]

> On 25 Nov 2015, at 02:48, Konstantin Boudnik  wrote:
> 
> Vinod, hopefully it isn't too late for a quick fix to be included into 2.7.2
> (sorry for jumping too late on this train). The JIRA in question is
> HADOOP-12415 and I have committed it to trunk and branch-2 already.
> 
> Please let me know if this is still Ok to add into 2.7.2 as it seems to be
> going through a respin. Thanks in advance,
> 
> Cos
> 


can you hold it off until 2.7.3? 2.7.2 was tested and we shoudn't be making 
more changes now, even if its just to the POMs

RE: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Vinayakumar B]

I think one recent critical issue
HDFS-9413, getContentSummary() on standby should throw StandbyException,
Found by Brahma, is a good candidate for 2.7.2 as well.

-vinay
On Nov 14, 2015 5:20 AM, "Naganarasimha G R (Naga)" <
garlanaganarasi...@huawei.com> wrote:

> Hi Vinod,
>
> Can you also  look at YARN-2859, if its important then we might have to
> revert that one and fix it for 2.7.2.
>
> + Naga
> 
> From: Vinod Kumar Vavilapalli [vino...@apache.org]
> Sent: Friday, November 13, 2015 23:56
> To: Jason Lowe
> Cc: mapreduce-...@hadoop.apache.org; common-...@hadoop.apache.org;
> hdfs-dev@hadoop.apache.org; yarn-...@hadoop.apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.7.2 RC0
>
> Thanks for reporting this Jason!
>
> Everyone, I am canceling this RC given the feedback, we will go again
> after addressing the open issues.
>
> Thanks
> +Vinod
>
> > On Nov 13, 2015, at 7:57 AM, Jason Lowe <jl...@yahoo-inc.com> wrote:
> >
> > -1 (binding)
> >
> > Ran into public localization issues and filed YARN-4354 <
> https://issues.apache.org/jira/browse/YARN-4354>. We need that resolved
> before the release is ready.  We will either need a timely fix or may have
> to revert YARN-2902 to unblock the release if my root-cause analysis is
> correct.  I'll dig into this more today.
> >
> > Jason
> >
> > From: Vinod Kumar Vavilapalli <vino...@apache.org>
> > To: common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org;
> yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
> > Cc: vino...@apache.org
> > Sent: Wednesday, November 11, 2015 10:31 PM
> > Subject: [VOTE] Release Apache Hadoop 2.7.2 RC0
> >
> > Hi all,
> >
> >
> > I've created a release candidate RC0 for Apache Hadoop 2.7.2.
> >
> >
> > As discussed before, this is the next maintenance release to follow up
> > 2.7.1.
> >
> >
> > The RC is available for validation at:
> >
> > *http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/ <
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/>
> >
> > <http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/ <
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/>>*
> >
> >
> > The RC tag in git is: release-2.7.2-RC0
> >
> >
> > The maven artifacts are available via repository.apache.org at
> >
> > *
> https://repository.apache.org/content/repositories/orgapachehadoop-1023/ <
> https://repository.apache.org/content/repositories/orgapachehadoop-1023/>
> >
> > <
> https://repository.apache.org/content/repositories/orgapachehadoop-1023/ <
> https://repository.apache.org/content/repositories/orgapachehadoop-1023/
> >>*
> >
> >
> > As you may have noted, an unusually long 2.6.3 release caused 2.7.2 to
> slip
> > by quite a bit. This release's related discussion threads are linked
> below:
> > [1] and [2].
> >
> >
> > Please try the release and vote; the vote will run for the usual 5 days.
> >
> >
> > Thanks,
> >
> > Vinod
> >
> >
> > [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes <
> http://markmail.org/message/oozq3gvd4nhzsaes>
> >
> > [2]: Planning Apache Hadoop 2.7.2
> > http://markmail.org/message/iktqss2qdeykgpqk <
> http://markmail.org/message/iktqss2qdeykgpqk>
> >
> >

Re: Release votes and git-tags [Was Re: [VOTE] Release Apache Hadoop 2.7.2 RC0]

[Steve Loughran]

> On 12 Nov 2015, at 20:23, Vinod Kumar Vavilapalli  wrote:
> 
> We have always voted on release tar-balls, not svn branches / git commit-ids 
> or tags.
> 
> When we were on SVN, we used to paste in the voting thread the release branch 
> URL.
> 
> Since we moved to git, we stopped creating release branches and have always 
> used signed tags for snapshotting and posted tags in the voting threads.
> 
> To my knowledge, we never reuse tags - as they are themselves versioned - for 
> e.g. hadoop-2.7.1-RC0 etc. So we don’t run the risk of tags getting replaced 
> from under the rug.
> 
> To me, tags are a simple way of going back to the code we ship in a release 
> without creating and maintaining explicit release branches. No one can 
> remember Commit IDs.
> 
> All that said, we can post the commit-IDs in future release votes for the 
> sake of convenience, but I disagree with the statement that we vote on 
> git-commits.
> 
> +Vinod
> 

I recognise that we vote on the src distro, but that source has an origin. And 
that has to be a commit #, not a tag, as somebody *may* change that tag later.

the ASF incubator will only approve of git-based releases with that checksum 
—so its the one we should all be using

FWIW, the RC tag is: 6f38ccc ; I've checked it out and verifying it builds on 
Windows, including all the native libs

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Jason Lowe]

-1 (binding)
Ran into public localization issues and filed YARN-4354. We need that resolved 
before the release is ready.  We will either need a timely fix or may have to 
revert YARN-2902 to unblock the release if my root-cause analysis is correct.  
I'll dig into this more today.

Jason

  From: Vinod Kumar Vavilapalli 
 To: common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org 
Cc: vino...@apache.org 
 Sent: Wednesday, November 11, 2015 10:31 PM
 Subject: [VOTE] Release Apache Hadoop 2.7.2 RC0
   
Hi all,


I've created a release candidate RC0 for Apache Hadoop 2.7.2.


As discussed before, this is the next maintenance release to follow up
2.7.1.


The RC is available for validation at:

*http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/

*


The RC tag in git is: release-2.7.2-RC0


The maven artifacts are available via repository.apache.org at

*https://repository.apache.org/content/repositories/orgapachehadoop-1023/

*


As you may have noted, an unusually long 2.6.3 release caused 2.7.2 to slip
by quite a bit. This release's related discussion threads are linked below:
[1] and [2].


Please try the release and vote; the vote will run for the usual 5 days.


Thanks,

Vinod


[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes

[2]: Planning Apache Hadoop 2.7.2
http://markmail.org/message/iktqss2qdeykgpqk


  

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Kihwal Lee]

We found HDFS-9426. The rolling upgrade finalization is not backward 
compatible.I.e. 2.7.1 or 2.6.x datanodes will ignore finalization.

So -1.
Kihwal
  From: Vinod Kumar Vavilapalli 
 To: common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org 
Cc: vino...@apache.org 
 Sent: Wednesday, November 11, 2015 10:31 PM
 Subject: [VOTE] Release Apache Hadoop 2.7.2 RC0
   
Hi all,


I've created a release candidate RC0 for Apache Hadoop 2.7.2.


As discussed before, this is the next maintenance release to follow up
2.7.1.


The RC is available for validation at:

*http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/

*


The RC tag in git is: release-2.7.2-RC0


The maven artifacts are available via repository.apache.org at

*https://repository.apache.org/content/repositories/orgapachehadoop-1023/

*


As you may have noted, an unusually long 2.6.3 release caused 2.7.2 to slip
by quite a bit. This release's related discussion threads are linked below:
[1] and [2].


Please try the release and vote; the vote will run for the usual 5 days.


Thanks,

Vinod


[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes

[2]: Planning Apache Hadoop 2.7.2
http://markmail.org/message/iktqss2qdeykgpqk


   

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Wangda Tan]

+1 (Non-binding):
- Deployed local cluster from binary
- Configured CS with node label
- Ran jobs with/without labels
- Ran distributed shell / MR jobs.

Thanks,
Wangda


On Wed, Nov 11, 2015 at 8:31 PM, Vinod Kumar Vavilapalli  wrote:

> Hi all,
>
>
> I've created a release candidate RC0 for Apache Hadoop 2.7.2.
>
>
> As discussed before, this is the next maintenance release to follow up
> 2.7.1.
>
>
> The RC is available for validation at:
>
> *http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/
>
> *
>
>
> The RC tag in git is: release-2.7.2-RC0
>
>
> The maven artifacts are available via repository.apache.org at
>
> *https://repository.apache.org/content/repositories/orgapachehadoop-1023/
>
>  >*
>
>
> As you may have noted, an unusually long 2.6.3 release caused 2.7.2 to slip
> by quite a bit. This release's related discussion threads are linked below:
> [1] and [2].
>
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
>
> Thanks,
>
> Vinod
>
>
> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes
>
> [2]: Planning Apache Hadoop 2.7.2
> http://markmail.org/message/iktqss2qdeykgpqk
>

Release votes and git-tags [Was Re: [VOTE] Release Apache Hadoop 2.7.2 RC0]

[Vinod Kumar Vavilapalli]

We have always voted on release tar-balls, not svn branches / git commit-ids or 
tags.

When we were on SVN, we used to paste in the voting thread the release branch 
URL.

Since we moved to git, we stopped creating release branches and have always 
used signed tags for snapshotting and posted tags in the voting threads.

To my knowledge, we never reuse tags - as they are themselves versioned - for 
e.g. hadoop-2.7.1-RC0 etc. So we don’t run the risk of tags getting replaced 
from under the rug.

To me, tags are a simple way of going back to the code we ship in a release 
without creating and maintaining explicit release branches. No one can remember 
Commit IDs.

All that said, we can post the commit-IDs in future release votes for the sake 
of convenience, but I disagree with the statement that we vote on git-commits.

+Vinod


> On Nov 12, 2015, at 10:01 AM, Steve Loughran  wrote:
> 
> we should be voting on git commits, not tags. 
> 
> What's the relevant SHA1?

RE: [VOTE] Release Apache Hadoop 2.7.2 RC0

[andreina j]

1. Verified for basics in HDFS, YARN and MR in below environment

I. Secure (3 Node Cluster)
Both HA and Non-HA

II. Non_secure (4 Node cluster)
Both HA and Non-HA

2. Verified for document contents in hadoop-2.7.2-RC0.tar.gz 
(hadoop-2.7.2\share\doc) and found that in configuration section , clicking on  
*-default.xml , leads to an empty page.
If this is expected behavior, then +1 (Non-binding).

Thanks
Andreina J




-Original Message-
From: Vinod Kumar Vavilapalli [mailto:vino...@apache.org] 
Sent: 12 November 2015 AM 10:01
To: common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Cc: vino...@apache.org
Subject: [VOTE] Release Apache Hadoop 2.7.2 RC0

Hi all,


I've created a release candidate RC0 for Apache Hadoop 2.7.2.


As discussed before, this is the next maintenance release to follow up 2.7.1.


The RC is available for validation at:

*http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/

*


The RC tag in git is: release-2.7.2-RC0


The maven artifacts are available via repository.apache.org at

*https://repository.apache.org/content/repositories/orgapachehadoop-1023/

*


As you may have noted, an unusually long 2.6.3 release caused 2.7.2 to slip by 
quite a bit. This release's related discussion threads are linked below:
[1] and [2].


Please try the release and vote; the vote will run for the usual 5 days.


Thanks,

Vinod


[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes

[2]: Planning Apache Hadoop 2.7.2
http://markmail.org/message/iktqss2qdeykgpqk