[RESULT] [VOTE] Release Apache Hadoop 2.8.3 (RC0)

, NodeManager, etc - Verify rolling upgrade features from 2.7.4, include MR over distributed cache, NM restart with work preserving, etc. Now, we have: 8 binding +1s, from: Eric Payne, Jason Lowe, Jian He, Wangda Tan, Rohith Sharma K S, Sunil G, Naganarasimha Garla, Junping Du 5 non

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Thanks Andrew for pushing new RC for 3.0.0. I was out last week, just get chance to validate new RC now. Basically, I found two critical issues with the same rolling upgrade scenario as where HADOOP-15059 get found previously: HDFS-12920, we changed value format for some hdfs configurations

[jira] [Created] (YARN-7646) MR job (based on old version tarball) get failed due to incompatible resource request

Junping Du created YARN-7646: Summary: MR job (based on old version tarball) get failed due to incompatible resource request Key: YARN-7646 URL: https://issues.apache.org/jira/browse/YARN-7646 Project

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

md5 checksum for given source tar ball? Thanks, Junping From: Konstantin Shvachko <shv.had...@gmail.com> Sent: Saturday, December 9, 2017 11:06 AM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

be it is necessary to extend the voting period for a few more days. But please try as much as possible to verify our release bits. Thanks! Thanks, Junping? From: Eric Payne <eric.payne1...@yahoo.com> Sent: Monday, December 11, 2017 1:51 PM To: Junping Du;

[VOTE] Release Apache Hadoop 2.8.3 (RC0)

Hi all, I've created the first release candidate (RC0) for Apache Hadoop 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79 important fixes and improvements. The RC artifacts are available at: http://home.apache.org/~junping_du/hadoop-2.8.3-RC0 The RC

Re: Apache Hadoop 2.8.3 Release Plan

uesday, November 21, 2017 7:45 PM To: Junping Du; Konstantin Shvachko Cc: Wangda Tan; Andrew Wang; Zheng, Kai; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: Apache Hadoop 2.8.3 Release Plan Agree with Kons

Re: [DISCUSS] A final minor release off branch-2?

be recognized as "rolling". Do I miss anything? Thanks, Junping From: Andrew Wang <andrew.w...@cloudera.com> Sent: Wednesday, November 15, 2017 10:34 AM To: Junping Du Cc: Wangda Tan; Steve Loughran; Vinod Kumar Vavilapalli; Kai Zheng; Arun

Re:

Just filed HADOOP-15059 to track this. Thanks, Junping From: Junping Du Sent: Tuesday, November 21, 2017 1:09 PM To: Vinod Kumar Vavilapalli; Allen Wittenauer Cc: common-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org; hdfs

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

Another issue I just found is we have token format compatibility issue between 2.x and 3.0. I tried to run a simple MR job on 3.0 RC0 against with 2.9.0 tarball which is failed. This incompatibility change should also break other applications which will break rolling upgrade. I think it is

Re: Apache Hadoop 2.8.3 Release Plan

/critical fixes landing on branch-2.8.3. RC0 will get cut-off shortly. Thanks, Junping From: Wangda Tan <wheele...@gmail.com> Sent: Tuesday, November 21, 2017 10:52 AM To: Andrew Wang Cc: Junping Du; Zheng, Kai; common-...@hadoop.apache.org;

Re: Apache Hadoop 2.8.3 Release Plan

ber 20, 2017 10:22 PM To: Zheng, Kai Cc: Junping Du; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: Apache Hadoop 2.8.3 Release Plan I'm against including new features in maintenance releases, since they're meant to

Re: [DISCUSS] A final minor release off branch-2?

Thanks Vinod to bring up this discussion, which is just in time. I agree with most responses that option C is not a good choice as our community bandwidth is precious and we should focus on very limited mainstream branches to develop, test and deployment. Of course, we should still follow

Apache Hadoop 2.8.3 Release Plan

Hi, We have several important fixes get landed on branch-2.8 and I would like to cut off branch-2.8.3 now to start 2.8.3 release work. So far, I don't see any pending blockers on 2.8.3, so my current plan is to cut off 1st RC of 2.8.3 in next several days: - For all coming

Re: Cutting branch-2.9

Below is some findings from my recently run of JACC (https://builds.apache.org/job/Hadoop-2.9-JACC/12/artifact/target/compat-check/report.html) job against 2.9 and 2.8.2. I have discussed with Arun and Subru offline on jdiff report who convinced me some of items are not a big concern. Just

Re: Cutting branch-2.9

Hi Subru and Arun, Thanks for moving forward with 2.9 release. Is the first cut of 2.9 release supposed to be a stable version or just an alpha version? If it is supposed to be a stable version, we should run jdiff test and check for API compatibility before releasing out. Please let me

[RESULT] [VOTE] Release Apache Hadoop 2.8.2 (RC1)

, NodeManager, etc. Now, we have: 7 binding +1s, from: John Zhuge, Jason Lowe, Chris Douglas, Wangda Tan, Ravi Prakash, Eric Payne, Junping Du 10 non-binding +1s, from: Hanisha Koneru, Wei Yan, Brahma Reddy Battula, Shane Kumpf, Ajay Kumar, Bharat Viswanadham, Mukul Kumar Singh, Eric

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

Allen, Do we have any solid evidence to show the HDFS unit tests going through the roof are due to serious memory leak by HDFS? Normally, I don't expect memory leak are identified in our UTs - mostly, it (test jvm gone) is just because of test or deployment issues. Unless there is

[VOTE] Release Apache Hadoop 2.8.2 (RC1)

Hi folks, I've created our new release candidate (RC1) for Apache Hadoop 2.8.2. Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 315 new fixed issues since 2.8.1 and 69 fixes are marked

[Update] Apache Hadoop 2.8.2 Release Status

is still open for blocker/critical issues landing, but for major/minor/trivial issues, please commit to branch-2.8 and marked the fixed version as 2.8.3. Thanks all for heads up. Have a good weekend! Thanks, Junping From: Junping Du &l

[jira] [Created] (YARN-7230) Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature

Junping Du created YARN-7230: Summary: Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature Key: YARN-7230 URL: https://issues.apache.org/jira/browse/YARN-7230

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)

work out a patch soon, I am open to accept it. Thanks, Junping From: Junping Du <j...@hortonworks.com> Sent: Monday, September 11, 2017 5:32 PM To: Daniel Templeton; Chris Douglas Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; map

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)

From: Daniel Templeton <dan...@cloudera.com> Sent: Monday, September 11, 2017 4:45 PM To: Chris Douglas; Junping Du Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du Subject: Re: [VOTE] Release Apache Hadoop

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)

From: Chris Douglas <cdoug...@apache.org> Sent: Monday, September 11, 2017 12:00 PM To: Junping Du Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du Subject: Re: [VOTE] R

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)

reduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0) Hello Junping, Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental". Thank you, Miklos On Sun, S

[VOTE] Release Apache Hadoop 2.8.2 (RC0)

Hi folks, With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2. Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues

Re: Apache Hadoop 2.8.2 Release Plan

, Junping From: Junping Du <j...@hortonworks.com> Sent: Friday, September 1, 2017 12:37 PM To: larry mccay; Steve Loughran Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subje

Re: Apache Hadoop 2.8.2 Release Plan

Should we fix this? If so, Hadoop 2.8.2 is the time to do it > > > > On 1 Sep 2017, at 11:14, Junping Du <j...@hortonworks.com> wrote: > > > > HADOOP-14814 get committed and HADOOP-9747 get push out to 2.8.3, so we > are clean on blocker/critical issues now. >

Re: Apache Hadoop 2.8.2 Release Plan

before doing any commits. branch-2.8 is still open for landing. Thanks for your cooperation! Thanks, Junping From: Junping Du <j...@hortonworks.com> Sent: Wednesday, August 30, 2017 12:35 AM To: Brahma Reddy Battula; common-...@hadoop.apache.org;

[jira] [Created] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5521

Junping Du created YARN-7138: Summary: Fix incompatible API change for YarnScheduler involved by YARN-5521 Key: YARN-7138 URL: https://issues.apache.org/jira/browse/YARN-7138 Project: Hadoop YARN

Re: Apache Hadoop 2.8.2 Release Plan

off RC0 around holiday (this weekend). Thanks, ​Junping From: Brahma Reddy Battula <brahmareddy.batt...@hotmail.com> Sent: Tuesday, August 29, 2017 8:42 AM To: Junping Du; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; map

[jira] [Created] (YARN-7124) CLONE - Log aggregation deletes/renames while file is open

Junping Du created YARN-7124: Summary: CLONE - Log aggregation deletes/renames while file is open Key: YARN-7124 URL: https://issues.apache.org/jira/browse/YARN-7124 Project: Hadoop YARN Issue

[jira] [Created] (YARN-7027) Log aggregation finish time should get logged for trouble shooting.

Junping Du created YARN-7027: Summary: Log aggregation finish time should get logged for trouble shooting. Key: YARN-7027 URL: https://issues.apache.org/jira/browse/YARN-7027 Project: Hadoop YARN

[jira] [Resolved] (YARN-1038) LocalizationProtocolPBClientImpl RPC failing

[ https://issues-test.apache.org/jira/browse/YARN-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-1038. -- Resolution: Cannot Reproduce I don't think trunk branch has this problem now, just resolve

Re: Apache Hadoop 2.8.2 Release Plan

: Junping Du <j...@hortonworks.com> Sent: Monday, July 24, 2017 1:41 PM To: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: I have done the change. All committers, 2.8.2 release is supposed to be a

[jira] [Resolved] (YARN-6891) Can kill other user's applications via RM UI

[ https://issues.apache.org/jira/browse/YARN-6891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-6891. -- Resolution: Duplicate > Can kill other user's applications via RM

[jira] [Created] (YARN-6890) If UI is not secured, we allow user to kill other users' job even yarn cluster is secured.

Junping Du created YARN-6890: Summary: If UI is not secured, we allow user to kill other users' job even yarn cluster is secured. Key: YARN-6890 URL: https://issues.apache.org/jira/browse/YARN-6890

Re:

bug fixes/improvements, please commit to branch-2.8 (trunk/branch-2) only and mark JIRA fixed as 2.8.3. Thanks for your cooperation! Thanks, Junping From: Junping Du Sent: Monday, July 24, 2017 10:36 AM To: Brahma Reddy Battula; Vinod Kumar Vavilapalli Cc

Re: Apache Hadoop 2.8.2 Release Plan

<brahmareddy.batt...@hotmail.com> Sent: Sunday, July 23, 2017 1:50 AM To: Junping Du; Vinod Kumar Vavilapalli Cc: Kihwal Lee; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; Jason Lowe; humbed...@apache.org Subject: Re:

Re: Apache Hadoop 2.8.2 Release Plan

. I will also adjust fix version on all affected JIRA accordingly. If you have any concerns on above operations, please raise it before the end of this Sunday (7/23). Thanks, Junping From: Junping Du <j...@hortonworks.com> Sent: Friday, July 21,

Re: Apache Hadoop 2.8.2 Release Plan

Make sense, just raise: https://issues.apache.org/jira/browse/INFRA-14669 Thanks, Junping From: Vinod Kumar Vavilapalli <vino...@apache.org> Sent: Friday, July 21, 2017 12:31 PM To: Junping Du Cc: Kihwal Lee; common-...@hadoop.apache.org

Re: Apache Hadoop 2.8.2 Release Plan

From: Jason Lowe <jl...@yahoo-inc.com.INVALID> Sent: Friday, July 21, 2017 8:17 AM To: Kihwal Lee; Junping Du; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: Apache Hadoop 2.8.2 Release Pl

Apache Hadoop 2.8.2 Release Plan

Hi all, Per Vinod's previous email, we just announce Apache Hadoop 2.8.1 get released today which is a special security release. Now, we should work towards 2.8.2 release which aim for production deployment. The focus obviously is to fix blocker/critical issues [2], bug-fixes and *no*

Re: 2.8 Release activities

Haohui, I am waiting for a special security release on branch-2.8 get out to resume the release work for production release of 2.8. You should be on security alias and ask for update there. Thanks, Junping From: Haohui Mai Sent:

[jira] [Resolved] (YARN-5007) Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster

[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-5007. -- Resolution: Later Assignee: (was: Andras Bokor) > Remove deprecated construct

[jira] [Created] (YARN-6534) ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled

Junping Du created YARN-6534: Summary: ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled Key: YARN-6534 URL: https://issues.apache.org/jira/browse/YARN-6534

Re: Apache Hadoop 2.8.1 Release Plan

I just cut off branch-2.8.1 from branch-2.8 for 2.8.1 release. So from now, all patch target for 2.8.1 need to be checked into branch-2.8.1 in addition to branch-2.8. Thanks, Junping From: Junping Du <j...@hortonworks.com> Sent: Monday, April 03,

Re: Upgrading minimum version of Maven to 3.1 from 3.0

Thanks Sunil to bring it up. However, any reason not to go to latest version of maven (3.3+)? Even version 3.1 is quite old - released 3+ years from now (please refer: https://archive.apache.org/dist/maven/binaries/). btw, I assume we only plan to change maven version on trunk given new YARN UI

Apache Hadoop 2.8.1 Release Plan

Hi all, We just released Apache Hadoop 2.8.0 recently [1] but it is not for production yet due to some issues identified. Now, we should work towards 2.8.1 release which aim for production deployment. The focus obviously is to fix blocker/critical issues [2], bug-fixes and *no* features /

Re: [RESULT] [VOTE] Release Apache Hadoop 2.8.0 (RC3)

are missing from mirror sites which get reported in https://issues.apache.org/jira/browse/INFRA-13755. The Apache infrastructure team is investigating right now. Will send release news when issue get fixed. Stay tuned! Thanks, Junping From: Junping Du &l

Re: [RESULT] [VOTE] Release Apache Hadoop 2.8.0 (RC3)

From: Allen Wittenauer <a...@effectivemachines.com> Sent: Thursday, March 23, 2017 5:27 PM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [RESULT] [VOTE] Release Apache Hadoop 2.8.0 (RC3)

[RESULT] [VOTE] Release Apache Hadoop 2.8.0 (RC3)

some example MR jobs, like: PI, sleep, etc. Now, we have: 7 binding +1s, from: Wangda Tan, Jason Lowe, Akira Ajisaka, Ravi Prakash, Karthik Kambatla, Jian He, Junping Du 18 non-binding +1s, from: Miklos Szegedi, Eric Payne, Daniel Templeton, Mingliang Liu, Sunil Govind, Marton

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

if founded - I will check if another round of RC is needed based on your findings. Thanks! Thanks, Junping From: Kuhu Shukla <kshu...@yahoo-inc.com> Sent: Tuesday, March 21, 2017 3:17 PM Cc: Junping Du; common-...@hadoop.apache.org; hdfs-...@hadoop.apac

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

jzh...@cloudera.com> Sent: Monday, March 20, 2017 10:31 AM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3) Yes, it only affects ADL. There is a work

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

From: John Zhuge <jzh...@cloudera.com> Sent: Monday, March 20, 2017 9:07 AM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.

[VOTE] Release Apache Hadoop 2.8.0 (RC3)

Hi all, With fix of HDFS-11431 get in, I've created a new release candidate (RC3) for Apache Hadoop 2.8.0. This is the next minor release to follow up 2.7.0 which has been released for more than 1 year. It comprises 2,900+ fixes, improvements, and new features. Most of these commits

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC2)

, March 16, 2017 7:27 AM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC2) > On 16 Mar 2017, at 00:25, Junping Du <j...@hortonworks.com> wrote: > &

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC2)

when HDFS-11431 get fixed. Thanks, Junping From: Andrew Wang <andrew.w...@cloudera.com> Sent: Wednesday, March 15, 2017 2:04 PM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC2)

_ From: Andrew Wang <andrew.w...@cloudera.com> Sent: Tuesday, March 14, 2017 2:50 PM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC2) Hi Junping, Noti

[jira] [Created] (YARN-6336) Jenkins report YARN new UI build failure

Junping Du created YARN-6336: Summary: Jenkins report YARN new UI build failure Key: YARN-6336 URL: https://issues.apache.org/jira/browse/YARN-6336 Project: Hadoop YARN Issue Type: Bug

[VOTE] Release Apache Hadoop 2.8.0 (RC2)

Hi all, With several important fixes get merged last week, I've created a new release candidate (RC2) for Apache Hadoop 2.8.0. This is the next minor release to follow up 2.7.0 which has been released for more than 1 year. It comprises 2,919 fixes, improvements, and new features.

[jira] [Created] (YARN-6294) ATS client should better handle Socket closed case

Junping Du created YARN-6294: Summary: ATS client should better handle Socket closed case Key: YARN-6294 URL: https://issues.apache.org/jira/browse/YARN-6294 Project: Hadoop YARN Issue Type: Bug

Re: [Continued] [Release thread] 2.8.0 release activities

:48 AM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: [Continued] [Release thread] 2.8.0 release activities You can check the error message by clicking on it, a bunch like this: Missing Sig

Re: [Continued] [Release thread] 2.8.0 release activities

he problem? Thanks, Junping ____ From: Junping Du <j...@hortonworks.com> Sent: Thursday, January 19, 2017 6:46 PM To: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Cc: Varun Vas

Re: [Continued] [Release thread] 2.8.0 release activities

to branch-2.8.0 at this moment. Thanks! Cheers, Junping From: Junping Du <j...@hortonworks.com> Sent: Wednesday, January 18, 2017 3:26 PM To: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; ya

Re: [VOTE] Release cadence and EOL

+1 on Sangjin's proposal - "A minor release line is end-of-lifed 2 years after it is released or there are 2 newer minor releases, whichever is sooner. The community reserves the right to extend or shorten the life of a release line if there is a good reason to do so." I also noticed Karthik

Re: [Continued] [Release thread] 2.8.0 release activities

have more comments or suggestions. Thanks, Junping From: Junping Du <j...@hortonworks.com> Sent: Wednesday, January 04, 2017 1:41 AM To: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apac

[jira] [Resolved] (YARN-6079) simple spelling errors in yarn test code

[ https://issues.apache.org/jira/browse/YARN-6079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-6079. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.9.0

[jira] [Created] (YARN-6071) Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only)

Junping Du created YARN-6071: Summary: Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only) Key: YARN-6071 URL: https://issues.apache.org/jira/browse/YARN-6071 Project: Hadoop YARN

[jira] [Created] (YARN-6068) Log aggregation get failed when NM restart even with recovery

Junping Du created YARN-6068: Summary: Log aggregation get failed when NM restart even with recovery Key: YARN-6068 URL: https://issues.apache.org/jira/browse/YARN-6068 Project: Hadoop YARN

Re: [Continued] [Release thread] 2.8.0 release activities

, Junping From: Junping Du <j...@hortonworks.com> Sent: Wednesday, December 07, 2016 11:31 AM To: Akira Ajisaka; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: [Con

Re: YARN Jenkins Build get consistent failed.

Thanks Ted. I noticed that Jenkins test for YARN is back to work now. Resolving the infra ticket. Thanks, Junping From: Ted Yu <yuzhih...@gmail.com> Sent: Wednesday, December 21, 2016 12:25 PM To: Junping Du Cc: yarn-dev@hadoop.apache.org;

YARN Jenkins Build get consistent failed.

Hi hadoop folks, I noticed that our recent YARN jenkins tests are consistently failed (https://builds.apache.org/job/PreCommit-YARN-Build) due to test environment issues below. I already filed blocker issue https://issues.apache.org/jira/browse/INFRA-13141 to our INFRA team yesterday

Re: [Continued] [Release thread] 2.8.0 release activities

he.org/view/H-L/view/Hadoop/job/Hadoop-trunk-JACC/24/artifact/target/compat-check/report.html Regards, Akira On 2016/12/02 2:08, Junping Du wrote: > Thanks Andrew! That's also a nice suggestion. I already create a similar job: > https://builds.apache.org/view/H-L/view/Hadoop/job/Hadoop-2.8-J

Re: [Continued] [Release thread] 2.8.0 release activities

: Andrew Wang <andrew.w...@cloudera.com> Sent: Wednesday, November 30, 2016 4:18 PM To: Junping Du Cc: Sangjin Lee; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; Vinod Vavilapalli; Jian He; Wangda Tan; sj...@twitter.com S

Re: [Continued] [Release thread] 2.8.0 release activities

. Non-critical fixes can wait for next one. Any other comments and suggestions? Thanks, Junping From: sjl...@gmail.com <sjl...@gmail.com> on behalf of Sangjin Lee <sj...@apache.org> Sent: Wednesday, November 30, 2016 3:24 PM To: Junping D

[Continued] [Release thread] 2.8.0 release activities

Hi folks, Per asked by Vinod offline, I would like to continue the effort to push 2.8 release out in next several weeks. The plan is as following: - We only have 5 blockers and 3 critical issues (https://s.apache.org/6kwx) so far, and most of them are in good progress now. I put them

[jira] [Created] (YARN-5718) TimelineClient (and other places in YARN) shouldn't over-write HDFS client retry settings which could cause unexpected behavior

Junping Du created YARN-5718: Summary: TimelineClient (and other places in YARN) shouldn't over-write HDFS client retry settings which could cause unexpected behavior Key: YARN-5718 URL: https://issues.apache.org

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

+1 binding, based on: - Download and build from source, check signatures - Deploy a single node cluster and run some simple jobs, like sleep, PI, etc. Thanks Sangjin and Chris for working on 2.6.5 release! Thanks, Junping From: larry mccay

Re: [REMINDER] How to set fix versions when committing

Hi Andrew and all, Thanks for the notice on the change. I still concern this rule change may cause some confusion from conflicting against our previous rule - no need to set trunk version if it is landing on 2.x branch. As we can see, there are 4 cases of version setting for JIRA landing

Re: [VOTE] Release Apache Hadoop 2.7.3 RC2

Thanks Vinod for creating new RC for 2.7.3 release. +1 (binding) based on following verifications: - Download src and binary tar ball and verify signature (gpg --verify). - Build from source Java 1.8.0_31-b13 on Mac native successfully. - Build from source with Java 1.7.0_79-b15 on Ubuntu VM

[jira] [Created] (YARN-5536) Multiple format support (JSON, etc.) for exclude node file in NM graceful decommission with timeout

Junping Du created YARN-5536: Summary: Multiple format support (JSON, etc.) for exclude node file in NM graceful decommission with timeout Key: YARN-5536 URL: https://issues.apache.org/jira/browse/YARN-5536

Re: [VOTE] Release Apache Hadoop 2.7.3 RC1

I think Allen's previous comments are very misleading. In my understanding, only incompatible API (RPC, CLIs, WebService, etc.) shouldn't land on branch-2, but other incompatible behaviors (logs, audit-log, daemon's restart, etc.) should get flexible for landing. Otherwise, how could 52 issues

Re: [VOTE] Release Apache Hadoop 2.7.3 RC1

>From my quick understanding, HDFS-9395 is more like a bug fix and improvement >for audit logging instead of incompatible changes. We mark incompatible >probably because the audit log behavior could be corrected/updated in some >exception cases. I think it still belongs to 2.7.3 scope. Kuhu

Re: [Release thread] 2.6.5 release activities

; > Thanks > Karthik > > On Thu, Aug 11, 2016 at 12:50 PM, Allen Wittenauer < > a...@effectivemachines.com > > wrote: > > > > > > On Aug 11, 2016, at 8:10 AM, Junping Du <j...@hortonworks.com> wrote: > > > > > > Allen, to be clear, I am not aga

Re: [Release thread] 2.6.5 release activities

more reasonable to the whole community. More thoughts? Thanks, Junping From: Allen Wittenauer <a...@effectivemachines.com> Sent: Thursday, August 11, 2016 3:13 PM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; map

Re: [Release thread] 2.6.5 release activities

ris Trezzo <ctre...@gmail.com> Sent: Wednesday, August 10, 2016 9:30 PM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org; Jason Lowe Subject: Re: [Release thread] 2.6.5 release activities Thanks J

Re: [Release thread] 2.6.5 release activities

Thanks Chris for bring up this discussion. Before we going to detail discussion of releasing 2.6.5, I have a quick question here: do we think it is necessary to continue to release branch-2.6, like 2.6.5, etc after 2.7 is out for more than 1 year. Any reason to not suggest users to upgrade to

Re: [DISCUSS] Release numbering semantics with concurrent (>2) releases [Was Setting JIRA fix versions for 3.0.0 releases]

I think that incompatible API between 3.0.0-alpha and 3.1.0-beta is something less confusing than incompatible between 2.8/2.9 and 2.98.x alphas/2.99.x betas. Why not just follow our previous practice in the beginning of branch-2? we can have 3.0.0-alpha, 3.1.0-alpha/beta, but once when we are

[jira] [Created] (YARN-5475) Test failed for TestAggregatedLogFormat on trunk

Junping Du created YARN-5475: Summary: Test failed for TestAggregatedLogFormat on trunk Key: YARN-5475 URL: https://issues.apache.org/jira/browse/YARN-5475 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-5416) TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stopped

Junping Du created YARN-5416: Summary: TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stopped Key: YARN-5416 URL: https

[jira] [Created] (YARN-5311) Document graceful decommission CLI and usage

Junping Du created YARN-5311: Summary: Document graceful decommission CLI and usage Key: YARN-5311 URL: https://issues.apache.org/jira/browse/YARN-5311 Project: Hadoop YARN Issue Type: Sub-task

Re: [DISCUSS] Increased use of feature branches

Comparing with advantages, I believe the disadvantages of shipping any releases directly from trunk are more obvious and significant: - A lot of commits (incompatible, risky, uncompleted feature, etc.) have to wait to commit to trunk or put into a separated branch that could delay feature

[jira] [Resolved] (YARN-5217) Close FileInputStream in NMWebServices#getLogs in branch-2.8

[ https://issues.apache.org/jira/browse/YARN-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-5217. -- Resolution: Duplicate > Close FileInputStream in NMWebServices#getLogs in branch-

[jira] [Created] (YARN-5214) Pending on synchronized method DirectoryCollection#checkDirs can hang NM's NodeStatusUpdater

Junping Du created YARN-5214: Summary: Pending on synchronized method DirectoryCollection#checkDirs can hang NM's NodeStatusUpdater Key: YARN-5214 URL: https://issues.apache.org/jira/browse/YARN-5214

Re: Why there are so many revert operations on trunk?

Andrew Wang Cc: Junping Du; Aaron T. Myers; common-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: Why there are so many revert operations on trunk? Folks, It is truly disappointing how we are escalating situations th

Re: Why there are so many revert operations on trunk?

responsible, work hardly and carefully and open communication with all community. Only through this, the success of Hadoop in age of 3.0 are guranteed. Thanks, Junping From: Aaron T. Myers <a...@cloudera.com> Sent: Monday, June 06, 2016 4:46 PM To: Junping

Why there are so many revert operations on trunk?

Hi Andrew, I just noticed you revert 8 commits on trunk last Friday: HADOOP-13226 HDFS-10430 HDFS-10431 HDFS-10390 HADOOP-13168 HDFS-10390 HADOOP-13168 HDFS-10346 HADOOP-12957 HDFS-10224 And I didn't see you have any comments on JIRA or email discussion before you did this. I

Re: Different JIRA permissions for HADOOP and HDFS

From: sjl...@gmail.com <sjl...@gmail.com> on behalf of Sangjin Lee <sj...@apache.org> Sent: Monday, May 16, 2016 11:43 PM To: Zhihai Xu Cc: Junping Du; Arun Suresh; Zheng, Kai; Andrew Wang; common-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: Re: Di

Re: Different JIRA permissions for HADOOP and HDFS

Zhihai, I just set you with committer permissions on MAPREDUCE JIRA. Would you try if the JIRA assignment works now? I cannot help on Hive project. It is better to ask hive project community for help. For Arun's problem. from my check, the Edit permission on JIRA only authorized to

  1   2   3   >