RE: [DISCUSS] Hadoop-3.2.1 release proposal

[Bibinchundatt]

Hi Rohith 

Thank you for initiating this

Few critical/blocker jira's we could consider

YARN-9714
YARN-9642
YARN-9640

Regards
Bibin
-Original Message-
From: Rohith Sharma K S [mailto:rohithsharm...@apache.org] 
Sent: 21 August 2019 11:42
To: Wei-Chiu Chuang 
Cc: Hdfs-dev ; yarn-dev 
; mapreduce-dev ; 
Hadoop Common 
Subject: Re: [DISCUSS] Hadoop-3.2.1 release proposal

On Tue, 20 Aug 2019 at 22:28, Wei-Chiu Chuang  wrote:

> Hi Rohith,
> Thanks for initiating this.
> I want to bring up one blocker issue: HDFS-13596 
>  (NN restart fails 
> after RollingUpgrade from 2.x to 3.x)
>

> This should be a blocker for all active Hadoop 3.x releases: 3.3.0, 
> 3.2.1, 3.1.3. Hopefully we can get this fixed within this week.
> Additionally, HDFS-14396
>  (Failed to load 
> image from FSImageFile when downgrade from 3.x to 2.x).Probably not a 
> blocker but nice to have.
>

 Please set target version so that I don't miss in blockers/critical
list for 3.2.1 https://s.apache.org/7yjh5.


>
> On Tue, Aug 20, 2019 at 3:22 AM Rohith Sharma K S < 
> rohithsharm...@apache.org> wrote:
>
>> Hello folks,
>>
>> It's been more than six month Hadoop-3.2.0 is released i.e 16th Jan,2019.
>> We have several important fixes landed in branch-3.2 (around 48 
>> blockers/critical https://s.apache.org/ozd6o).
>>
>> I am planning to do a maintenance release of 3.2.1 in next few weeks 
>> i.e around 1st week of September.
>>
>> So far I don't see any blockers/critical in 3.2.1. I see few pending 
>> issues on 3.2.1 are https://s.apache.org/ni6v7.
>>
>> *Proposal*:
>> Code Freezing Date:  30th August 2019 Release Date : 7th Sept 2019
>>
>> Please let me know if you have any thoughts or comments on this plan.
>>
>> Thanks & Regards
>> Rohith Sharma K S
>>
>

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

RE: [Discuss] Merge discussion for Node attribute support feature YARN-3409

[Bibinchundatt]

+1 for merge. Fetaure would be a good addition to 3.2 release.

--
Bibin A Chundatt
M: +91-9742095715
E: bibin.chund...@huawei.com
2012实验室-印研IT&Cloud BU分部
2012 Laboratories-IT&Cloud BU Branch Dept.
From:Naganarasimha Garla
To:common-...@hadoop.apache.org,Hdfs-dev,yarn-dev@hadoop.apache.org,mapreduce-...@hadoop.apache.org,
Date:2018-08-29 20:00:44
Subject:[Discuss] Merge discussion for Node attribute support feature YARN-3409

Hi All,

We would like to hear your thoughts on merging “Node Attributes Support in
YARN” branch (YARN-3409) [2] into trunk in a few weeks. The goal is to get
it in for HADOOP 3.2.

*Major work happened in this branch*

YARN-6858. Attribute Manager to store and provide node attributes in RM
YARN-7871. Support Node attributes reporting from NM to RM( distributed
node attributes)
YARN-7863. Modify placement constraints to support node attributes
YARN-7875. Node Attribute store for storing and recovering attributes

*Detailed Design:*

Please refer [1] for detailed design document.

*Testing Efforts:*

We did detailed tests for the feature in the last few weeks.
This feature will be enabled only when Node Attributes constraints are
specified through SchedulingRequest from AM.
Manager implementation will help to store and recover Node Attributes. This
works with existing placement constraints.

*Regarding to API stability:*

All newly added @Public APIs are @Unstable.

Documentation jira [3] could help to provide detailed configuration
details. This feature works from end-to-end and we tested this in our local
cluster. Branch code is run against trunk and tracked via [4].

We would love to get your thoughts before opening a voting thread.

Special thanks to a team of folks who worked hard and contributed towards
this efforts including design discussion / patch / reviews, etc.: Weiwei
Yang, Bibin Chundatt, Wangda Tan, Vinod Kumar Vavilappali, Konstantinos
Karanasos, Arun Suresh, Varun Saxena, Devaraj Kavali, Lei Guo, Chong Chen.

[1] :
https://issues.apache.org/jira/secure/attachment/12937633/Node-Attributes-Requirements-Design-doc_v2.pdf
[2] : https://issues.apache.org/jira/browse/YARN-3409
[3] : https://issues.apache.org/jira/browse/YARN-7865
[4] : https://issues.apache.org/jira/browse/YARN-8718

Thanks,
+ Naga & Sunil Govindan

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC1)

[Bibinchundatt]

+1 (non-binding)

- Build from source 1.8.0_111
- Deployed on 3 node secure setup
- Ran few mapreduce jobs with multiple users.
- Verified basic resource localization
- Failover of Resource Manager.
- Log aggregation verification
- Sanity check of JHS

Thanks
Bibin
--
Bibin A Chundatt Bibin A Chundatt
M: +91-9742095715
E: bibin.chund...@huawei.com
2012实验室-印研IT&Cloud BU分部
2012 Laboratories-IT&Cloud BU Branch Dept.

> On 20/10/17, 6:12 AM, "Junping Du"  wrote:
>
> >Hi folks,
> > I've created our new release candidate (RC1) for Apache Hadoop 2.8.2.
> >
> > Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line
> and will be the latest stable/production release for Apache Hadoop - it
> includes 315 new fixed issues since 2.8.1 and 69 fixes are marked as
> blocker/critical issues.
> >
> >  More information about the 2.8.2 release plan can be found here:
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
> >
> >  New RC is available at: http://home.apache.org/~
> junping_du/hadoop-2.8.2-RC1 du/hadoop-2.8.2-RC0>
> >
> >  The RC tag in git is: release-2.8.2-RC1, and the latest commit id
> is: 66c47f2a01ad9637879e95f80c41f798373828fb
> >
> >  The maven artifacts are available via repository.apache.org repository.apache.org/> at: https://repository.apache.org/
> content/repositories/orgapachehadoop-1064 repository.apache.org/content/repositories/orgapachehadoop-1062>
> >
> >  Please try the release and vote; the vote will run for the usual 5
> days, ending on 10/24/2017 6pm PST time.
> >
> >Thanks,
> >
> >Junping
> >
>
> -
> To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
>
>