Hadoop & ApacheCon

Hello, This year's ApacheCon will take place online between 9/29 and 10/1. There are lots of sessions made by our fellow Hadoop developers: https://apachecon.com/acah2020/tracks/bigdata-1.html https://apachecon.com/acah2020/tracks/bigdata-2.html In case you didn't realize, the registration is

[jira] [Created] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

Akira Ajisaka created HDFS-1: Summary: RBF: Refresh cacheNS when SocketException occurs Key: HDFS-1 URL: https://issues.apache.org/jira/browse/HDFS-1 Project: Hadoop HDFS Issue

[DISCUSS] Hadoop 3.2.2 release

Hi folks, I was reminded by Xiaoqiao that Hadoop 3.2.1 was made almost a year ago (released on September 22, 2019) and we're overdue for a follow-up. @Rohith Sharma K S you were the RM for Hadoop 3.2.1. Are we planning to make the 3.2.2 releases soon? Xiaoqiao wants to help with the release.

[jira] [Created] (HDFS-15554) RBF: force router check file existence before adding/updating mount points

Fengnan Li created HDFS-15554: - Summary: RBF: force router check file existence before adding/updating mount points Key: HDFS-15554 URL: https://issues.apache.org/jira/browse/HDFS-15554 Project: Hadoop

Unstable Unit Tests in Trunk

While putting up patches for HADOOP-17169 I noticed that the unit tests in trunk, specifically in HDFS, are incredibly unstable. Every time I put up a new patch, 4-8 unit tests failed with failures that were completely unrelated to the patch.

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/252/ [Aug 31, 2020 5:59:48 AM] (noreply) HDFS-15542. Add identified snapshot corruption tests for ordered snapshot deletion (#2251) [Aug 31, 2020 6:49:12 AM] (Xiaoqiao He) HDFS-15550. Remove unused

Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC1

Hi All, The voting has ended with: 12binding +1 (including me) 3 non-binding +1 0 -1 0 0 With above data, Ozone 1.0.0 RC1 voting is passed. Thank you all for your verifying and voting effort. I will proceed with releasing the artifacts and announce the release after that.

Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC1

+1 - Verified ozone version of binary package - Verified ozone source package content with ozone-1.0.0-RC1 tag - Build ozone from source package - Deployed a new 1+3 cluster using RC1 binary package - Checked Ozone UI, SCM UI, Datanode UI and Recon UI - Run TestDFSIO

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/43/ [Aug 31, 2020 4:52:29 AM] (noreply) YARN-10358. Fix findbugs warnings in hadoop-yarn-project on branch-2.10. (#2164) -1 overall The following subsystems voted -1: asflicense hadolint

[jira] [Created] (HDFS-15552) Let DeadNode Detector also work for EC cases

dark_num created HDFS-15552: --- Summary: Let DeadNode Detector also work for EC cases Key: HDFS-15552 URL: https://issues.apache.org/jira/browse/HDFS-15552 Project: Hadoop HDFS Issue Type: Sub-task

Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC1

+1 * Built from source * Verified checksums & signature * Ran some basic shell commands. Thanx Sammi for driving the release. Good Luck!!! -Ayush On Tue, 1 Sep 2020 at 13:20, Mukul Kumar Singh wrote: > Thanks for preparing the RC Sammi. > > +1 (binding) > > 1. Verified Signatures > > 2.

[jira] [Created] (HDFS-15551) Tiny Improve for DeadNode detector

dark_num created HDFS-15551: --- Summary: Tiny Improve for DeadNode detector Key: HDFS-15551 URL: https://issues.apache.org/jira/browse/HDFS-15551 Project: Hadoop HDFS Issue Type: Sub-task

Re: [VOTE] End of Life Hadoop 2.9

+1 Thanks, Lisheng Sun Adam Antal 于2020年9月1日周二 下午4:24写道： > +1 > > Thanks, > Adam > > On Tue, Sep 1, 2020 at 9:18 AM Stephen O'Donnell > wrote: > > > +1 > > > > Thanks, > > > > Stephen. > > > > > > On Tue, Sep 1, 2020 at 7:25 AM Masatake Iwasaki < > > iwasak...@oss.nttdata.co.jp> > > wrote: > >

Re: [VOTE] End of Life Hadoop 2.9

+1 Thanks, Adam On Tue, Sep 1, 2020 at 9:18 AM Stephen O'Donnell wrote: > +1 > > Thanks, > > Stephen. > > > On Tue, Sep 1, 2020 at 7:25 AM Masatake Iwasaki < > iwasak...@oss.nttdata.co.jp> > wrote: > > > +1 > > > > Thanks, > > Masatake Iwasaki > > > > On 2020/09/01 4:09, Wei-Chiu Chuang wrote:

Re: [VOTE] End of Life Hadoop 2.9

+1 Thanks, Stephen. On Tue, Sep 1, 2020 at 7:25 AM Masatake Iwasaki wrote: > +1 > > Thanks, > Masatake Iwasaki > > On 2020/09/01 4:09, Wei-Chiu Chuang wrote: > > Dear fellow Hadoop developers, > > > > Given the overwhelming feedback from the discussion thread > >

Re: [DISCUSS] Hadoop 2.10.1 release

Thanks, Mingliang Liu. I volunteer to take the RM role then. I will appreciate advice from who have the experience. Masatake Iwasaki On 2020/09/01 10:38, Mingliang Liu wrote: I can see how I can help, but I can not take the RM role this time. Thanks, On Mon, Aug 31, 2020 at 12:15 PM

Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC1

Thanks Sammi for getting this out! +1 (binding) * Verified signatures. * Built from source. * Deployed small non-HA un-secure cluster. * Verified basic Ozone file system. * Tried out a few basic Ozone shell commands - create, list, delete * Ran a few Freon benchmark

Re: [VOTE] End of Life Hadoop 2.9

+1 Thanks, Masatake Iwasaki On 2020/09/01 4:09, Wei-Chiu Chuang wrote: Dear fellow Hadoop developers, Given the overwhelming feedback from the discussion thread https://s.apache.org/hadoop2.9eold, I'd like to start an official vote thread for the community to vote and start the 2.9 EOL

Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC1

+1 (binding) 1. Verified signatures 2. Built from source 3. deployed with docker 4. tested with basic s3 apis. On Tue, Aug 25, 2020 at 7:01 AM Sammi Chen wrote: > RC1 artifacts are at: > https://home.apache.org/~sammichen/ozone-1.0.0-rc1/ >