Re: [E] [NOTICE] Attaching patches in JIRA issue no longer works

at 1:18 PM Eric Badger wrote: > If we're not using patches on JIRA anymore, why are we using JIRA at all? > Why don't we just use GitHub Issues? Using JIRA to then redirect to GitHub > seems unintuitive and will fracture the information between two different > places. Do the conversa

Re: [E] [NOTICE] Attaching patches in JIRA issue no longer works

If we're not using patches on JIRA anymore, why are we using JIRA at all? Why don't we just use GitHub Issues? Using JIRA to then redirect to GitHub seems unintuitive and will fracture the information between two different places. Do the conversations happen on JIRA or on a GitHub PR? Having

Re: [E] Re: [VOTE] Hadoop 3.1.x EOL

+1 On Thu, Jun 3, 2021 at 6:14 AM Surendra Singh Lilhore < surendralilh...@gmail.com> wrote: > +1 > > Thanks and Regards > Surendra > > > On Thu, Jun 3, 2021 at 4:31 PM tom lee wrote: > > > +1 > > > > Masatake Iwasaki 于2021年6月3日周四 下午5:43写道： > > > > > +1 > > > > > > Masatake Iwasaki > > > > > >

Java 8 Lambdas

Hello all, I'd like to gauge the community on the usage of lambdas within Hadoop code. I've been reviewing a lot of patches recently that either add or modify lambdas and I'm beginning to think that sometimes we, as a community, are writing lambdas because we can rather than because we should. To

[jira] [Created] (MAPREDUCE-7324) ClientHSSecurityInfo class is in wrong META-INF file

Eric Badger created MAPREDUCE-7324: -- Summary: ClientHSSecurityInfo class is in wrong META-INF file Key: MAPREDUCE-7324 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7324 Project: Hadoop Map

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

I've committed https://issues.apache.org/jira/browse/YARN-10540. Xiaoqiao, feel free to cherry-pick this into the 3.2.2 release branch if you think it is relevant. Also, can someone tell me which releases we should be targeting? Currently these versions are all Unreleased on JIRA: 3.4.1, 3.4.0

Re: [E] Re: Hadoop 3.2.2 Release Code Freeze Plan

Hi Xiaoqiao, I believe that https://github.com/apache/hadoop/commit/3274fd139d9b612e449fc234f8804a2a97ae6c47 broke compilation for branch-3.2. Looks like you missed a 3.2.2 -> 3.2.3 in pom.xml in the top-level directory.

Remove whitelist/blacklist terminology from Hadoop

Hi, Could I get some people to review this JIRA? It is a large patch and touches a lot of files. Additionally, it makes some incompatible changes, notably changing the names of config keys. https://issues.apache.org/jira/browse/HADOOP-17169 Eric

Re: [E] Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

+1 (non-binding) - Verified all hashes and checksums - Built from source on RHEL 7 - Deployed a single node pseudo cluster - Ran some example jobs Only minor thing is that the DockerLinuxContainerRuntime won't run in a secure environment using kerberos and nscd because there is no way to

Re: [E] [ANNOUNCE] Jim Brennan is a new Hadoop Committer

Congrats, Jim! Well-deserved and much overdue! Eric On Mon, Aug 3, 2020 at 11:38 AM epa...@apache.org wrote: > I am pleased to announce that Jim Brennan has accepted the invitation to > become a Hadoop committer focusing on the YARN space. > > Please reach out to Jim and welcome him in his new

[jira] [Created] (MAPREDUCE-7285) Junit class missing from hadoop-mapreduce-client-jobclient-*-tests jar

Eric Badger created MAPREDUCE-7285: -- Summary: Junit class missing from hadoop-mapreduce-client-jobclient-*-tests jar Key: MAPREDUCE-7285 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7285

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

+1 (binding) - Built from source on RHEL 7.6 - Deployed on a single-node cluster - Verified DefaultContainerRuntime - Verified RuncContainerRuntime (after setting things up with the docker-to-squash tool available on YARN-9564) Eric

[jira] [Reopened] (MAPREDUCE-7277) IndexCache totalMemoryUsed differs from cache contents.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reopened MAPREDUCE-7277: > IndexCache totalMemoryUsed differs from cache conte

Re: [Announcement] DiDi HDFS successfully upgraded from 2.7.2 to 3.2.0

Hi Runlin, Awesome to hear that you've been able to upgrade! Do you mind sharing some thoughts on your experience with the upgrade? Did you take a cluster downtime to do the upgrade? How long did the upgrade take? Did you find any incompatibilities or issues during or after the upgrade? Do you

Re: [DISCUSS] Making 2.10 the last minor 2.x release

Hello all, Is it written anywhere what the difference is between a minor release and a point/dot/maintenance (I'll use "point" from here on out) release? I have looked around and I can't find anything other than some compatibility documentation in 2.x that has since been removed in 3.x [1] [2]. I

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

Hi Jonathan, Thanks for putting this RC together. You stated that there are improvements related to rolling upgrades from 2.x to 3.x and I know I have seen multiple JIRAs getting committed to that effect. Could you describe any tests that you have done to verify rolling upgrade compatibility for

Re: Incompatible changes between branch-2.8 and branch-2.9

tegy? It should be OK to remove/add optional > > fields (removing the field with id 12, and adding the field with id 13). > > The difficulties I see here are, we would have to leave id 12 blank in > > 2.8.6 (so we cannot have YARN-6164 in branch-2.8), and users on 2.8.4/5 > > w

Re: Incompatible changes between branch-2.8 and branch-2.9

From: Jonathan Hung > Sent: Tuesday, September 24, 2019 11:38 AM > To: Eric Badger > Cc: Hadoop Common; yarn-dev; mapreduce-dev; Hdfs-dev > Subject: Re: Incompatible changes between branch-2.8 and branch-2.9 > > Hi Eric, thanks for the investigation. > > * For YARN-661

Incompatible changes between branch-2.8 and branch-2.9

We (Verizon Media) are currently moving towards upgrading our clusters from our internal fork of branch-2.8 to an internal fork of branch-2. During this process, we have found multiple incompatible changes in protobufs between branch-2.8 and branch-2. These incompatibilities were all introduced

Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL

- Stuff has been going into branch-2 sporadically but I don't who is actively using that code other than as part of a cherrypick backwards strategy. - Should we do a 2.10.x release? Or just say "time to upgrade?" We have talked at a few different Hadoop contributors meetups and community syncs

Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL

+1 On Wed, Aug 21, 2019 at 9:40 AM Sean Busbey wrote: > +1 > > On Tue, Aug 20, 2019 at 10:03 PM Wangda Tan wrote: > > > > Hi all, > > > > This is a vote thread to mark any versions smaller than 2.7 (inclusive), > > and 3.0 EOL. This is based on discussions of [1] > > > > This discussion runs

Re: [DISCUSS] Prefer Github PR Integration over patch in JIRA

Where would JIRA fit into the PR workflow? Would we file JIRAs just to track github PRs and have all of the discussion on the PR? Eric On Mon, Jul 22, 2019 at 1:10 PM Dinesh Chitlangia wrote: > +1 Absolutely. It also makes it easy/clean for reviewers to leave specific > comments and the

Re: [DISCUSS] A unified and open Hadoop community sync up schedule?

Is there a YARN call today (in 16 minutes)? I saw it on the calendar until a few minutes ago. Eric On Tue, Jun 18, 2019 at 11:18 PM Wangda Tan wrote: > Thanks @Wei-Chiu Chuang . updated gdoc > > On Tue, Jun 18, 2019 at 7:35 PM Wei-Chiu Chuang > wrote: > > > Thanks Wangda, > > > > I just like

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1

+1 (non-binding) - Verified all hashes and checksums - Built from source on RHEL 7 - Deployed a single node pseudo cluster - Ran some example jobs - Verified the Docker environment works with non-entrypoint mode Eric On Tue, Jan 8, 2019 at 5:42 AM Sunil G wrote: > Hi folks, > > > Thanks to

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.14.1, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Eric On Tue, Nov 27, 2018 at 7:02 AM Ayush Saxena wrote: > Sunil, Thanks for driving this release!!! > > +1 (non-binding) > -Built from

Re: [VOTE] Release Apache Hadoop 2.8.5 (RC0)

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.13.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Eric On Tue, Sep 11, 2018 at 1:39 PM, Gabor Bota wrote: > Thanks for the work Junping! > > +1 (non-binding) > > - checked out git

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.13.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs On Tue, Aug 7, 2018 at 8:46 AM, Shashikant Banerjee < sbaner...@hortonworks.com> wrote: > +1(non-binding) > > * checked out git tag

Re: Apache Hadoop 3.0.3 Release plan

My thinking is to cut the branch in next couple of days and create RC for vote at the end of month. > We plan to cut branch-3.0.3 by the coming Wednesday (May 9th) and vote for RC on May 30th I much prefer to wait to cut the branch until just before the production of the release and the vote.

Re: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.13.4, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Eric On Thu, Apr 26, 2018 at 11:16 PM, Takanobu Asanuma wrote: > Thanks for working on this, Sammi! > > +1

Re: [VOTE] Release Apache Hadoop 2.7.5 (RC1)

Thanks, Konstantin. Everything looks good to me +1 (non-binding) - Verified all signatures and digests - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Eric On Tue, Dec 12, 2017 at 11:01 AM, Jason Lowe wrote: >

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

Thanks, Junping +1 (non-binding) looks good from my end - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Eric On Tue, Dec 12, 2017 at 12:55 PM, Konstantin Shvachko wrote: >

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Thanks, Eric On Wed, Nov 15, 2017 at 10:24 AM, Carlo Aldo Curino wrote: > +1 (binding) > > On Nov 15, 2017 8:23

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

+1 (non-binding) pending the issue that Sunil/Rohith pointed out - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Thanks, Eric On Tue, Nov 7, 2017 at 4:03 PM, Wangda Tan wrote: >

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC1)

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Thanks, Eric On Tue, Oct 24, 2017 at 12:59 AM, Mukul Kumar Singh wrote: > Thanks Junping, > > +1 (non-binding)

Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0

+1 (non-binding) - Verified all checksums and signatures - Built native from source on macOS 10.12.6 and RHEL 7.1 - Deployed a single node pseudo cluster - Ran pi and sleep jobs - Verified Docker was marked as experimental Thanks, Eric On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge

Re: [DISCUSS] official docker image(s) for hadoop

+1 definitely think an official Hadoop docker image (possibly 1 per major or minor release) would be a positive both for contributors and for users of Hadoop. Eric On Wed, Sep 13, 2017 at 1:19 PM, Wangda Tan wrote: > +1 to add Hadoop docker image for easier testing /

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

- Verified all checksums signatures - Built from src on macOS 10.12.6 with Java 1.8.0u65 - Deployed single node pseudo cluster - Successfully ran sleep and pi jobs - Navigated the various UIs +1 (non-binding) Thanks, Eric On Wednesday, August 2, 2017 12:31 PM, Chris Douglas

[jira] [Created] (MAPREDUCE-6927) MR job should only set tracking url if history was successfully written

Eric Badger created MAPREDUCE-6927: -- Summary: MR job should only set tracking url if history was successfully written Key: MAPREDUCE-6927 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6927

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

- Verified all checksums signatures - Built from src on macOS 10.12.5 with Java 1.8.0u65 - Deployed single node pseudo cluster - Successfully ran sleep and pi jobs - Navigated the various UIs +1 (non-binding) Thanks, Eric On Thursday, July 6, 2017 3:31 PM, Aaron Fabbri

[jira] [Created] (MAPREDUCE-6911) TestMapreduceConfigFields.testCompareXmlAgainstConfigurationClass fails consistently

Eric Badger created MAPREDUCE-6911: -- Summary: TestMapreduceConfigFields.testCompareXmlAgainstConfigurationClass fails consistently Key: MAPREDUCE-6911 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6911

[jira] [Created] (MAPREDUCE-6882) Increase MapReduce test timeouts from 1 second to 10 seconds

Eric Badger created MAPREDUCE-6882: -- Summary: Increase MapReduce test timeouts from 1 second to 10 seconds Key: MAPREDUCE-6882 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6882 Project

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

+1 (non-binding) - Verified checksums and signatures of all files - Built from source on MacOS Sierra via JDK 1.8.0 u65 - Deployed single-node cluster - Successfully ran a few sample jobs Thanks, Eric On Tuesday, March 21, 2017 2:56 PM, John Zhuge wrote: +1. Thanks

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

+1 (non-binding) - Verified signatures and md5- Built from source- Started single-node cluster on my mac- Ran some sleep jobs Eric On Tuesday, January 24, 2017 4:32 PM, Yufei Gu wrote: Hi Andrew, Thanks for working on this. +1 (Non-Binding) 1. Downloaded the

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

PM, Allen Wittenauer <a...@effectivemachines.com> wrote: > On Aug 30, 2016, at 2:06 PM, Eric Badger <ebad...@yahoo-inc.com.INVALID> > wrote: > > > WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete. ^^ > >

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

wed a successful job, but as you can see, I did not have anything printed onto the command line. Hopefully this is just a misconfiguration on my part, but I figured that I would point it out just in case. Thanks, Eric On Tuesday, August 30, 2016 4:00 PM, Eric Badger <ebad...@yahoo-inc.com.INVALI

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

All on OSX 10.11.6: Verified the hashes. However, Andrew, I don't know where to find your public key, so I wasn't able to verify that they were signed by you.Built from sourceDeployed a pseudo-distributed clusterRan a few sample jobsPoked around the RM UIPoked around the attached website

Re: [VOTE] Release Apache Hadoop 2.7.3 RC2

+1 non-binding All on OSX 10.11.6:Verified signatures of source and binary tarballsCompiled from sourceDeployed pseudo clusterRan sample jobs Thanks, Eric On Tuesday, August 23, 2016 1:26 PM, Xuan Gong wrote: +1 Binding. Built from source code. Deployed single

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

* Verified mds and pgp signatures of both source and binary* Built tarball from source on OS X 10.11.6 (El Capitan)* Deployed in pseudo-distributed mode* Ran sleep jobs and other randomly selected tests on both MapReduce and Tez* Visually verified the RM and history server UIs  Thanks, Eric

[jira] [Created] (MAPREDUCE-6744) Increase timeout on TestDFSIO tests

Eric Badger created MAPREDUCE-6744: -- Summary: Increase timeout on TestDFSIO tests Key: MAPREDUCE-6744 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6744 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-6649) getFailureInfo not returning any failure info

Eric Badger created MAPREDUCE-6649: -- Summary: getFailureInfo not returning any failure info Key: MAPREDUCE-6649 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6649 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-6630) TestUserGroupInformation#testGetServerSideGroups fails in chroot

Eric Badger created MAPREDUCE-6630: -- Summary: TestUserGroupInformation#testGetServerSideGroups fails in chroot Key: MAPREDUCE-6630 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6630 Project