Re: [E] [VOTE] Hadoop 3.1.x EOL

2021-06-03 Thread Jim Brennan
+1 On Thu, Jun 3, 2021 at 1:14 AM Akira Ajisaka wrote: > Dear Hadoop developers, > > Given the feedback from the discussion thread [1], I'd like to start > an official vote > thread for the community to vote and start the 3.1 EOL process. > > What this entails: > > (1) an official announcement

Re: [E] Re: Java 8 Lambdas

2021-04-29 Thread Jim Brennan
I just think that we should be cognizant of changes (particularly bug fixes), that will need to be ported to branch-2.10. Since it is still on Java7, anytime you use a lambda in code on trunk, we need to change it for branch-2.10. While not difficult, this is extra work and it increases the diff

[jira] [Resolved] (MAPREDUCE-7320) ClusterMapReduceTestCase does not clean directories

2021-02-26 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved MAPREDUCE-7320. Fix Version/s: 3.2.3 2.10.2 3.3.1

[jira] [Created] (MAPREDUCE-7319) Log list of mappers at trace level in ShuffleHandler audit log

2021-02-08 Thread Jim Brennan (Jira)
Jim Brennan created MAPREDUCE-7319: -- Summary: Log list of mappers at trace level in ShuffleHandler audit log Key: MAPREDUCE-7319 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7319 Project

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-21 Thread Jim Brennan
I put up a patch for https://issues.apache.org/jira/browse/YARN-10540. Thanks for bringing it to my attention. Jim On Mon, Dec 21, 2020 at 10:36 AM Sunil Govindan wrote: > I had some offline talks with a few folks. > This issue is happening only in Mac, hence ideally it does not cause much > of

Re: [E] Re: the v2 commit algorithm

2020-09-23 Thread Jim Brennan
I replied in the Jira. The speed up provided by the v2 commit algorithm is very important to us at Verizon Media (Yahoo). Please do not remove it. I referred to this comment from Jason Lowe on the original Jira: https://issues.apache.org/jira/browse/MAPREDUCE-4815?focusedCommentId=14271115&page=

Re: [E] [VOTE] Release Apache Hadoop 2.10.1 (RC0)

2020-09-16 Thread Jim Brennan
Thanks for your work on this Masatake! I am +1 (non-binding) on this 2.10.1 release. I built from source and ran hdfs, resourcemanager, and nodemanager unit tests. I set up a one-node-cluster and ran some example jobs (pi, sleep). I tested NM/RM recovery by killing NM/RM during jobs and verifying

Re: [E] Re: [DISCUSS] Hadoop 2.10.1 release

2020-09-02 Thread Jim Brennan
Thanks Masatake Iwasaki! I am willing to help out with Hadoop 2.10.1 release. Jim Brennan On Tue, Sep 1, 2020 at 2:13 AM Masatake Iwasaki wrote: > Thanks, Mingliang Liu. > > I volunteer to take the RM role then. > I will appreciate advice from who have the experience. > >

Re: [DISCUSS] Making 2.10 the last minor 2.x release

2019-12-31 Thread Jim Brennan
It looks like QBT tests are still being run on branch-2 ( https://builds.apache.org/view/H-L/view/Hadoop/job/hadoop-qbt-branch2-java7-linux-x86/), and they are not very helpful at this point. Can we change the QBT tests to run against branch-2.10 instead? Jim On Mon, Dec 23, 2019 at 7:44 PM Akira

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

2019-10-25 Thread Jim Brennan
+1 (non-binding) on RC1 I built from source on Mac and RHEL7, ran hdfs, nodemanager, and resourcemanager unit tests, and set up a one-node cluster and ran some test jobs (pi and sleep). - Jim On Tue, Oct 22, 2019 at 4:55 PM Jonathan Hung wrote: > Hi folks, > > This is the second release candida

Re: [VOTE] Merge YARN-8200 to branch-2 and branch-3.0

2019-08-26 Thread Jim Brennan
+1 (non-binding). I have built branch-2 with the latest YARN-8200 patch (YARN-8200-branch-2.003.patch). I ran all of the NM/RM tests and ran a few test jobs on a one-node cluster with default settings. On Mon, Aug 26, 2019 at 3:51 PM Oliver Hu wrote: > +1 (non-binding) > > We have used this pa

Re: [DISCUSS] Merging YARN-8200 to branch-3.0 and branch-2

2019-08-21 Thread Jim Brennan
ritize this. Hoping to get to this next >> week. >> >> Jonathan >> >> -- >> *From:* Jim Brennan >> *Sent:* Thursday, April 18, 2019 7:28 AM >> *To:* Jonathan Hung >> *Cc:* yarn-...@hadoop.apache.org; mapreduce-dev@hadoop.

Re: [DISCUSS] Merging YARN-8200 to branch-3.0 and branch-2

2019-04-18 Thread Jim Brennan
ing an > issue, but we’ll try it out and report back. > > Jonathan > > ------ > *From:* Jim Brennan > *Sent:* Tuesday, April 2, 2019 9:17 AM > *To:* Jonathan Hung > *Cc:* yarn-...@hadoop.apache.org; mapreduce-dev@hadoop.apache.org > *Subject:* Re: [

Re: [DISCUSS] Merging YARN-8200 to branch-3.0 and branch-2

2019-04-02 Thread Jim Brennan
Thanks for working on this! One concern for us is support for a rolling upgrade. If we are running a cluster based on branch-2.8, will we be able to do a rolling upgrade (no cluster down-time) to a branch containing these changes? Have you tested rolling upgrades? Thanks. Jim On Fri, Mar 29, 20

Re: [ANNOUNCE] Eric Badger is now a committer!

2019-03-05 Thread Jim Brennan
Congratulations Eric! On Tue, Mar 5, 2019 at 11:20 AM Eric Payne wrote: > It is my pleasure to announce that Eric Badger has accepted an invitation > to become a Hadoop Core committer. > > Congratulations, Eric! This is well-deserved! > > -Eric Payne >

[jira] [Created] (MAPREDUCE-7069) Add ability to specify user environment variables individually

2018-03-28 Thread Jim Brennan (JIRA)
Jim Brennan created MAPREDUCE-7069: -- Summary: Add ability to specify user environment variables individually Key: MAPREDUCE-7069 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7069 Project