Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

2023-03-20 Thread Ayush Saxena
I am not sure what classifies as a Hack and what not, I thought reflections are part of Java. Whatever solution but pulling in just the HDFS specific stuff to FileSystem just for Ozone, because Hbase guys didn’t agree and we have people in Hadoop who we can convince, I am -1 to such an approach

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

2023-03-20 Thread Tsz Wo Sze
It makes a lot sense to use PathCapabilities. Reflection is a hack but not a solution. Tsz-WoOn Tuesday, March 21, 2023, 09:43:15 AM GMT+8, Ayush Saxena wrote: Hbase doesn’t want to add Ozone as a dependency sounds to me like a ‘Hbase having resistance against the people proposing or

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

2023-03-20 Thread Ayush Saxena
Hbase doesn’t want to add Ozone as a dependency sounds to me like a ‘Hbase having resistance against the people proposing or against Ozone’ Anyway doesn’t ViewDistributedFileSystem not solve this Ozone problem, I remember Uma chasing that to solve these problems only? Pulling up the core HDFS

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2023-03-20 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/972/ No changes ERROR: File 'out/email-report.txt' does not exist - To unsubscribe, e-mail:

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2023-03-20 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/1171/ No changes -1 overall The following subsystems voted -1: blanks hadolint pathlen spotbugs unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc

[jira] [Created] (HDFS-16959) RBF: state store cache loading metrics

2023-03-20 Thread Viraj Jasani (Jira)
Viraj Jasani created HDFS-16959: --- Summary: RBF: state store cache loading metrics Key: HDFS-16959 URL: https://issues.apache.org/jira/browse/HDFS-16959 Project: Hadoop HDFS Issue Type:

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

2023-03-20 Thread Wei-Chiu Chuang
Thank you. Makes sense to me. Yes, as part of this effort we are going to need contract tests. On Fri, Mar 17, 2023 at 3:52 AM Steve Loughran wrote: >1. I think a new interface would be good as FileContext could do the >same thing >2. using PathCapabilities probes should still be

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-20 Thread Chris Nauroth
+1 Thank you for the release candidate, Steve! * Verified all checksums. * Verified all signatures. * Built from source, including native code on Linux. * mvn clean package -Pnative -Psrc -Drequire.openssl -Drequire.snappy -Drequire.zstd -DskipTests * Tests passed. * mvn --fail-never

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-20 Thread Ayush Saxena
+1(Binding) * Built from source (x86 & ARM) * Successful Native Build (x86 & ARM) * Verified Checksums (x86 & ARM) * Verified Signature (x86 & ARM) * Checked the output of hadoop version (x86 & ARM) * Verified the output of hadoop checknative (x86 & ARM) * Ran some basic HDFS shell commands. *

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

2023-03-20 Thread Xiaoqiao He
+1 * Verified signature and checksum of the source tarball. * Built the source code on Ubuntu and OpenJDK 11 by `mvn clean package -DskipTests -Pnative -Pdist -Dtar`. * Setup pseudo cluster with HDFS and YARN. * Run simple FsShell - mkdir/put/get/mv/rm (include EC) and check the result. * Run