Re: [E] [NOTICE] Attaching patches in JIRA issue no longer works

at 1:18 PM Eric Badger wrote: > If we're not using patches on JIRA anymore, why are we using JIRA at all? > Why don't we just use GitHub Issues? Using JIRA to then redirect to GitHub > seems unintuitive and will fracture the information between two different > places. Do the conversa

Re: [E] [NOTICE] Attaching patches in JIRA issue no longer works

If we're not using patches on JIRA anymore, why are we using JIRA at all? Why don't we just use GitHub Issues? Using JIRA to then redirect to GitHub seems unintuitive and will fracture the information between two different places. Do the conversations happen on JIRA or on a GitHub PR? Having

Re: [E] Re: [VOTE] Hadoop 3.1.x EOL

+1 On Thu, Jun 3, 2021 at 6:14 AM Surendra Singh Lilhore < surendralilh...@gmail.com> wrote: > +1 > > Thanks and Regards > Surendra > > > On Thu, Jun 3, 2021 at 4:31 PM tom lee wrote: > > > +1 > > > > Masatake Iwasaki 于2021年6月3日周四 下午5:43写道： > > > > > +1 > > > > > > Masatake Iwasaki > > > > > >

Re: [E] Re: Do I need a +1 to merge a backport PR?

I'm of a similar opinion to most here. If the backport is clean, I think it's ok to do it with just the +1 on the original patch. However, please please please build the code on the target branch before backporting Eric On Wed, Jun 2, 2021 at 2:46 PM Ayush Saxena wrote: > For trivial changes,

Java 8 Lambdas

Hello all, I'd like to gauge the community on the usage of lambdas within Hadoop code. I've been reviewing a lot of patches recently that either add or modify lambdas and I'm beginning to think that sometimes we, as a community, are writing lambdas because we can rather than because we should. To

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

I've committed https://issues.apache.org/jira/browse/YARN-10540. Xiaoqiao, feel free to cherry-pick this into the 3.2.2 release branch if you think it is relevant. Also, can someone tell me which releases we should be targeting? Currently these versions are all Unreleased on JIRA: 3.4.1, 3.4.0

Re: [E] Re: Hadoop 3.2.2 Release Code Freeze Plan

Hi Xiaoqiao, I believe that https://github.com/apache/hadoop/commit/3274fd139d9b612e449fc234f8804a2a97ae6c47 broke compilation for branch-3.2. Looks like you missed a 3.2.2 -> 3.2.3 in pom.xml in the top-level directory.

Remove whitelist/blacklist terminology from Hadoop

Hi, Could I get some people to review this JIRA? It is a large patch and touches a lot of files. Additionally, it makes some incompatible changes, notably changing the names of config keys. https://issues.apache.org/jira/browse/HADOOP-17169 Eric

Re: [E] Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

+1 (non-binding) - Verified all hashes and checksums - Built from source on RHEL 7 - Deployed a single node pseudo cluster - Ran some example jobs Only minor thing is that the DockerLinuxContainerRuntime won't run in a secure environment using kerberos and nscd because there is no way to

Unstable Unit Tests in Trunk

While putting up patches for HADOOP-17169 I noticed that the unit tests in trunk, specifically in HDFS, are incredibly unstable. Every time I put up a new patch, 4-8 unit tests failed with failures that were completely unrelated to the patch.

Re: [E] Re: A more inclusive elephant...

Subramanian > > On Thu, Jul 30, 2020 at 3:54 PM Eric Badger > wrote: > > > Thanks for the responses, Jon and Carlo! > > > > It makes sense to me to prevent future patches from re-introducing the > > terminology. I can file a JIRA to add the +1/-1 functionality to

[jira] [Created] (HADOOP-17187) Report non-inclusive language as part of code contribution pre-commit check

Eric Badger created HADOOP-17187: Summary: Report non-inclusive language as part of code contribution pre-commit check Key: HADOOP-17187 URL: https://issues.apache.org/jira/browse/HADOOP-17187

Re: [E] [ANNOUNCE] Jim Brennan is a new Hadoop Committer

Congrats, Jim! Well-deserved and much overdue! Eric On Mon, Aug 3, 2020 at 11:38 AM epa...@apache.org wrote: > I am pleased to announce that Jim Brennan has accepted the invitation to > become a Hadoop committer focusing on the YARN space. > > Please reach out to Jim and welcome him in his new

Re: [E] Re: A more inclusive elephant...

gt; further in cases where feature experts need to weigh in on compatibility > > (usually with regards to persistence or wire compatibility). This can be > > done case-by-case basis. > > > > Regards, > > jeagles > > > > On Thu, Jul 30, 2020 at 1:28 PM Eric

Re: [E] Re: A more inclusive elephant...

rics should we >>> collect, and what actions can we take. >>> >>> >>> >>> On Fri, Jul 10, 2020 at 11:29 AM Carlo Aldo Curino < >>> carlo.cur...@gmail.com> >>> wrote: >>> >>> > Eric, >>> > >>> > Than

[jira] [Created] (HADOOP-17170) Remove master/slave terminology from Hadoop

Eric Badger created HADOOP-17170: Summary: Remove master/slave terminology from Hadoop Key: HADOOP-17170 URL: https://issues.apache.org/jira/browse/HADOOP-17170 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-17169) Remove whitelist/blacklist from Hadoop

Eric Badger created HADOOP-17169: Summary: Remove whitelist/blacklist from Hadoop Key: HADOOP-17169 URL: https://issues.apache.org/jira/browse/HADOOP-17169 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-17168) Remove non-inclusive terminology from Hadoop

Eric Badger created HADOOP-17168: Summary: Remove non-inclusive terminology from Hadoop Key: HADOOP-17168 URL: https://issues.apache.org/jira/browse/HADOOP-17168 Project: Hadoop Common Issue

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

+1 (binding) - Built from source on RHEL 7.6 - Deployed on a single-node cluster - Verified DefaultContainerRuntime - Verified RuncContainerRuntime (after setting things up with the docker-to-squash tool available on YARN-9564) Eric

Re: A more inclusive elephant...

Thanks for writing this up, Carlo. I'm +1 (idk if I'm technically binding on this or not) for the changes moving forward and I think we refactor away any instances that are internal to the code (i.e. not APIs or other things that would break compatibility) in all active branches and then also

Re: [DISCUSS] Removing the archiac master branch

+1 Eric On Fri, Jun 19, 2020 at 1:14 PM Ayush Saxena wrote: > Thanx Owen for initiating. > +1 > -Ayush > > > On 19-Jun-2020, at 10:52 PM, Zhe Zhang wrote: > > > > +1 Thanks Owen > > > > I scratched my head for a while and couldn't think of a downside. > > > >> On Fri, Jun 19, 2020 at 10:20

Re: Next Hadoop Storage Online Meetup (APAC Mandarin)

For those of us that don't speak Mandarin, would someone be able to take notes in English? I'm very interested in hearing about the experience in moving from Hadoop 2.x to 3.x. Eric On Thu, Dec 19, 2019 at 2:07 PM Wei-Chiu Chuang wrote: > As you have probably aware, DiDi upgrade a large

Re: [DISCUSS] Making 2.10 the last minor 2.x release

Hello all, Is it written anywhere what the difference is between a minor release and a point/dot/maintenance (I'll use "point" from here on out) release? I have looked around and I can't find anything other than some compatibility documentation in 2.x that has since been removed in 3.x [1] [2]. I

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

Hi Jonathan, Thanks for putting this RC together. You stated that there are improvements related to rolling upgrades from 2.x to 3.x and I know I have seen multiple JIRAs getting committed to that effect. Could you describe any tests that you have done to verify rolling upgrade compatibility for

Re: Incompatible changes between branch-2.8 and branch-2.9

tegy? It should be OK to remove/add optional > > fields (removing the field with id 12, and adding the field with id 13). > > The difficulties I see here are, we would have to leave id 12 blank in > > 2.8.6 (so we cannot have YARN-6164 in branch-2.8), and users on 2.8.4/5 > > w

Re: Incompatible changes between branch-2.8 and branch-2.9

From: Jonathan Hung > Sent: Tuesday, September 24, 2019 11:38 AM > To: Eric Badger > Cc: Hadoop Common; yarn-dev; mapreduce-dev; Hdfs-dev > Subject: Re: Incompatible changes between branch-2.8 and branch-2.9 > > Hi Eric, thanks for the investigation. > > * For YARN-661

Incompatible changes between branch-2.8 and branch-2.9

We (Verizon Media) are currently moving towards upgrading our clusters from our internal fork of branch-2.8 to an internal fork of branch-2. During this process, we have found multiple incompatible changes in protobufs between branch-2.8 and branch-2. These incompatibilities were all introduced

Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL

- Stuff has been going into branch-2 sporadically but I don't who is actively using that code other than as part of a cherrypick backwards strategy. - Should we do a 2.10.x release? Or just say "time to upgrade?" We have talked at a few different Hadoop contributors meetups and community syncs

Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL

+1 On Wed, Aug 21, 2019 at 9:40 AM Sean Busbey wrote: > +1 > > On Tue, Aug 20, 2019 at 10:03 PM Wangda Tan wrote: > > > > Hi all, > > > > This is a vote thread to mark any versions smaller than 2.7 (inclusive), > > and 3.0 EOL. This is based on discussions of [1] > > > > This discussion runs

Re: [DISCUSS] Prefer Github PR Integration over patch in JIRA

Where would JIRA fit into the PR workflow? Would we file JIRAs just to track github PRs and have all of the discussion on the PR? Eric On Mon, Jul 22, 2019 at 1:10 PM Dinesh Chitlangia wrote: > +1 Absolutely. It also makes it easy/clean for reviewers to leave specific > comments and the

Re: [DISCUSS] A unified and open Hadoop community sync up schedule?

Is there a YARN call today (in 16 minutes)? I saw it on the calendar until a few minutes ago. Eric On Tue, Jun 18, 2019 at 11:18 PM Wangda Tan wrote: > Thanks @Wei-Chiu Chuang . updated gdoc > > On Tue, Jun 18, 2019 at 7:35 PM Wei-Chiu Chuang > wrote: > > > Thanks Wangda, > > > > I just like

ebugs JIRAs

It seems as though ebugs is running a static code analyzer across all of hadoop and creating a new JIRA for every issue it finds (15 JIRAs in the past 3 hours). While this could potentially be useful, I don't think it's a good idea at all to file a new JIRA for every single issue that is found. It

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1

+1 (non-binding) - Verified all hashes and checksums - Built from source on RHEL 7 - Deployed a single node pseudo cluster - Ran some example jobs - Verified the Docker environment works with non-entrypoint mode Eric On Tue, Jan 8, 2019 at 5:42 AM Sunil G wrote: > Hi folks, > > > Thanks to

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.14.1, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Eric On Tue, Nov 27, 2018 at 7:02 AM Ayush Saxena wrote: > Sunil, Thanks for driving this release!!! > > +1 (non-binding) > -Built from

Re: [VOTE] Release Apache Hadoop 2.8.5 (RC0)

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.13.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Eric On Tue, Sep 11, 2018 at 1:39 PM, Gabor Bota wrote: > Thanks for the work Junping! > > +1 (non-binding) > > - checked out git

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.13.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs On Tue, Aug 7, 2018 at 8:46 AM, Shashikant Banerjee < sbaner...@hortonworks.com> wrote: > +1(non-binding) > > * checked out git tag

Re: [VOTE] Release Apache Hadoop 2.7.7

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.13.5, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs On Mon, Jul 16, 2018 at 2:18 PM, Kihwal Lee wrote: > +1 (binding) > -Built from the source > -Brought up a single node

Re: Apache Hadoop 3.0.3 Release plan

My thinking is to cut the branch in next couple of days and create RC for vote at the end of month. > We plan to cut branch-3.0.3 by the coming Wednesday (May 9th) and vote for RC on May 30th I much prefer to wait to cut the branch until just before the production of the release and the vote.

Re: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.13.4, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Eric On Thu, Apr 26, 2018 at 11:16 PM, Takanobu Asanuma wrote: > Thanks for working on this, Sammi! > > +1

Re: [VOTE] Release Apache Hadoop 2.7.5 (RC1)

Thanks, Konstantin. Everything looks good to me +1 (non-binding) - Verified all signatures and digests - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Eric On Tue, Dec 12, 2017 at 11:01 AM, Jason Lowe wrote: >

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

Thanks, Junping +1 (non-binding) looks good from my end - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Eric On Tue, Dec 12, 2017 at 12:55 PM, Konstantin Shvachko wrote: >

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Thanks, Eric On Wed, Nov 15, 2017 at 10:24 AM, Carlo Aldo Curino wrote: > +1 (binding) > > On Nov 15, 2017 8:23

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

+1 (non-binding) pending the issue that Sunil/Rohith pointed out - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Thanks, Eric On Tue, Nov 7, 2017 at 4:03 PM, Wangda Tan wrote: >

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC1)

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Thanks, Eric On Tue, Oct 24, 2017 at 12:59 AM, Mukul Kumar Singh wrote: > Thanks Junping, > > +1 (non-binding)

Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0

+1 (non-binding) - Verified all checksums and signatures - Built native from source on macOS 10.12.6 and RHEL 7.1 - Deployed a single node pseudo cluster - Ran pi and sleep jobs - Verified Docker was marked as experimental Thanks, Eric On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge

Re: [DISCUSS] official docker image(s) for hadoop

+1 definitely think an official Hadoop docker image (possibly 1 per major or minor release) would be a positive both for contributors and for users of Hadoop. Eric On Wed, Sep 13, 2017 at 1:19 PM, Wangda Tan wrote: > +1 to add Hadoop docker image for easier testing /

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

- Verified all checksums signatures - Built from src on macOS 10.12.6 with Java 1.8.0u65 - Deployed single node pseudo cluster - Successfully ran sleep and pi jobs - Navigated the various UIs +1 (non-binding) Thanks, Eric On Wednesday, August 2, 2017 12:31 PM, Chris Douglas

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

- Verified all checksums signatures - Built from src on macOS 10.12.5 with Java 1.8.0u65 - Deployed single node pseudo cluster - Successfully ran sleep and pi jobs - Navigated the various UIs +1 (non-binding) Thanks, Eric On Thursday, July 6, 2017 3:31 PM, Aaron Fabbri

[jira] [Created] (HADOOP-14440) Add metrics for connections dropped

Eric Badger created HADOOP-14440: Summary: Add metrics for connections dropped Key: HADOOP-14440 URL: https://issues.apache.org/jira/browse/HADOOP-14440 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-14377) Increase Common tests from 1 second to 10 seconds

Eric Badger created HADOOP-14377: Summary: Increase Common tests from 1 second to 10 seconds Key: HADOOP-14377 URL: https://issues.apache.org/jira/browse/HADOOP-14377 Project: Hadoop Common

[jira] [Created] (HADOOP-14372) TestSymlinkLocalFS timeouts are too low

Eric Badger created HADOOP-14372: Summary: TestSymlinkLocalFS timeouts are too low Key: HADOOP-14372 URL: https://issues.apache.org/jira/browse/HADOOP-14372 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-14320) TestIPC.testIpcWithReaderQueuing fails intermittently

Eric Badger created HADOOP-14320: Summary: TestIPC.testIpcWithReaderQueuing fails intermittently Key: HADOOP-14320 URL: https://issues.apache.org/jira/browse/HADOOP-14320 Project: Hadoop Common

Re: Local trunk build is flaky

For what it's worth, I successfully built trunk just now on macOS Sierra using mvn install -Pdist -Dtar -DskipTests -DskipShade -Dmaven.javadoc.skip On Monday, April 17, 2017 12:32 PM, Zhe Zhang wrote: Starting from last week, building trunk on my local Mac has been

[jira] [Created] (HADOOP-14306) TestLocalFileSystem tests have very low timeouts

Eric Badger created HADOOP-14306: Summary: TestLocalFileSystem tests have very low timeouts Key: HADOOP-14306 URL: https://issues.apache.org/jira/browse/HADOOP-14306 Project: Hadoop Common

[jira] [Created] (HADOOP-14277) TestTrash.testTrashRestarts is flaky

Eric Badger created HADOOP-14277: Summary: TestTrash.testTrashRestarts is flaky Key: HADOOP-14277 URL: https://issues.apache.org/jira/browse/HADOOP-14277 Project: Hadoop Common Issue Type

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC2)

All on MacOS Sierra Verified signatures - Minor note: Junping, I had a hard time finding your key. I grabbed the keys for hadoop from http://home.apache.org/keys/group/hadoop.asc and you had a key there, but it wasn't the one that you signed this commit with. Then with some help from Jason

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

+1 (non-binding) - Verified signatures and md5- Built from source- Started single-node cluster on my mac- Ran some sleep jobs Eric On Tuesday, January 24, 2017 4:32 PM, Yufei Gu wrote: Hi Andrew, Thanks for working on this. +1 (Non-Binding) 1. Downloaded the

[jira] [Created] (HADOOP-13976) Path globbing does not match newlines

Eric Badger created HADOOP-13976: Summary: Path globbing does not match newlines Key: HADOOP-13976 URL: https://issues.apache.org/jira/browse/HADOOP-13976 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-13709) Clean up subprocesses spawned by Shell.java:runCommand when the shell process exits

Eric Badger created HADOOP-13709: Summary: Clean up subprocesses spawned by Shell.java:runCommand when the shell process exits Key: HADOOP-13709 URL: https://issues.apache.org/jira/browse/HADOOP-13709

[jira] [Created] (HADOOP-13571) ServerSocketUtil.getPort() should use loopback address, not 0.0.0.0

Eric Badger created HADOOP-13571: Summary: ServerSocketUtil.getPort() should use loopback address, not 0.0.0.0 Key: HADOOP-13571 URL: https://issues.apache.org/jira/browse/HADOOP-13571 Project

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

PM, Allen Wittenauer <a...@effectivemachines.com> wrote: > On Aug 30, 2016, at 2:06 PM, Eric Badger <ebad...@yahoo-inc.com.INVALID> > wrote: > > > WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete. ^^ > >

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

wed a successful job, but as you can see, I did not have anything printed onto the command line. Hopefully this is just a misconfiguration on my part, but I figured that I would point it out just in case. Thanks, Eric On Tuesday, August 30, 2016 4:00 PM, Eric Badger <ebad...@yahoo-inc.com.INVALI

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

All on OSX 10.11.6: Verified the hashes. However, Andrew, I don't know where to find your public key, so I wasn't able to verify that they were signed by you.Built from sourceDeployed a pseudo-distributed clusterRan a few sample jobsPoked around the RM UIPoked around the attached website

Re: [VOTE] Release Apache Hadoop 2.7.3 RC2

+1 non-binding All on OSX 10.11.6:Verified signatures of source and binary tarballsCompiled from sourceDeployed pseudo clusterRan sample jobs Thanks, Eric On Tuesday, August 23, 2016 1:26 PM, Xuan Gong wrote: +1 Binding. Built from source code. Deployed single

[jira] [Created] (HADOOP-13462) Increase timeout of TestAmFilter.testFilter

Eric Badger created HADOOP-13462: Summary: Increase timeout of TestAmFilter.testFilter Key: HADOOP-13462 URL: https://issues.apache.org/jira/browse/HADOOP-13462 Project: Hadoop Common Issue

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

* Verified mds and pgp signatures of both source and binary* Built tarball from source on OS X 10.11.6 (El Capitan)* Deployed in pseudo-distributed mode* Ran sleep jobs and other randomly selected tests on both MapReduce and Tez* Visually verified the RM and history server UIs  Thanks, Eric

[jira] [Reopened] (HADOOP-10980) TestActiveStandbyElector fails occasionally in trunk

[ https://issues.apache.org/jira/browse/HADOOP-10980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reopened HADOOP-10980: -- Assignee: Eric Badger This test failed for me locally when I was running a separate

[jira] [Created] (HADOOP-13053) FS Shell should use File system API, not FileContext

Eric Badger created HADOOP-13053: Summary: FS Shell should use File system API, not FileContext Key: HADOOP-13053 URL: https://issues.apache.org/jira/browse/HADOOP-13053 Project: Hadoop Common