Re: HADOOP-18207 hadoop-logging module about to land

Thank you Wei-Chiu for the thread and extensive help with reviews! Thank you Ayush for responding to the thread! Let me try to address some points. Please pardon my ignorance if I am not supposed to respond to any of the questions. > Regarding this entire activity including the parent tickets: Do

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

+1 (non-binding) * Signature: ok * Checksum: ok * Rat check (1.8.0_362): ok - mvn clean apache-rat:check * Built from source (1.8.0_362): ok - mvn clean install -DskipTests * Built tar from source (1.8.0_362): ok - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true * Brought up

[jira] [Created] (HDFS-17041) RBF: Fix putAll impl for mysql and file based state stores

Viraj Jasani created HDFS-17041: --- Summary: RBF: Fix putAll impl for mysql and file based state stores Key: HDFS-17041 URL: https://issues.apache.org/jira/browse/HDFS-17041 Project: Hadoop HDFS

[jira] [Created] (HDFS-17020) RBF: mount table addAll should print failed records in std error

Viraj Jasani created HDFS-17020: --- Summary: RBF: mount table addAll should print failed records in std error Key: HDFS-17020 URL: https://issues.apache.org/jira/browse/HDFS-17020 Project: Hadoop HDFS

[jira] [Created] (HDFS-17009) RBF: state store putAll should also return failed records

Viraj Jasani created HDFS-17009: --- Summary: RBF: state store putAll should also return failed records Key: HDFS-17009 URL: https://issues.apache.org/jira/browse/HDFS-17009 Project: Hadoop HDFS

[jira] [Created] (HDFS-17008) Fix rbf jdk 11 javadoc warnings

Viraj Jasani created HDFS-17008: --- Summary: Fix rbf jdk 11 javadoc warnings Key: HDFS-17008 URL: https://issues.apache.org/jira/browse/HDFS-17008 Project: Hadoop HDFS Issue Type: Task

[jira] [Created] (HDFS-16998) RBF: Add ops metrics for getSlowDatanodeReport in RouterClientActivity

Viraj Jasani created HDFS-16998: --- Summary: RBF: Add ops metrics for getSlowDatanodeReport in RouterClientActivity Key: HDFS-16998 URL: https://issues.apache.org/jira/browse/HDFS-16998 Project: Hadoop

[jira] [Created] (HDFS-16978) RBF: New Router admin command to support bulk add of mount points

Viraj Jasani created HDFS-16978: --- Summary: RBF: New Router admin command to support bulk add of mount points Key: HDFS-16978 URL: https://issues.apache.org/jira/browse/HDFS-16978 Project: Hadoop HDFS

[jira] [Created] (HDFS-16973) RBF: MountTableResolver cache size lookup should take read lock

Viraj Jasani created HDFS-16973: --- Summary: RBF: MountTableResolver cache size lookup should take read lock Key: HDFS-16973 URL: https://issues.apache.org/jira/browse/HDFS-16973 Project: Hadoop HDFS

[jira] [Created] (HDFS-16967) RBF: File based state stores should allow concurrent access to the records

Viraj Jasani created HDFS-16967: --- Summary: RBF: File based state stores should allow concurrent access to the records Key: HDFS-16967 URL: https://issues.apache.org/jira/browse/HDFS-16967 Project

Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

IIRC some of the ongoing major dependency upgrades (log4j 1 to 2, jersey 1 to 2 and junit 4 to 5) are blockers for java 11 compile + test stability. On Tue, Mar 28, 2023 at 4:55 AM Steve Loughran wrote: > Now that hadoop 3.3.5 is out, i want to propose something new > > we switch branch-3.3 an

[jira] [Created] (HDFS-16959) RBF: state store cache loading metrics

Viraj Jasani created HDFS-16959: --- Summary: RBF: state store cache loading metrics Key: HDFS-16959 URL: https://issues.apache.org/jira/browse/HDFS-16959 Project: Hadoop HDFS Issue Type

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

+1 (non-binding) * Signature/Checksum: ok * Rat check (1.8.0_341): ok - mvn clean apache-rat:check * Built from source (1.8.0_341): ok - mvn clean install -DskipTests * Built tar from source (1.8.0_341): ok - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true Containerized

[jira] [Created] (HDFS-16957) RBF: Exit status of dfsrouteradmin -rm should be non-zero for unsuccessful attempt

Viraj Jasani created HDFS-16957: --- Summary: RBF: Exit status of dfsrouteradmin -rm should be non-zero for unsuccessful attempt Key: HDFS-16957 URL: https://issues.apache.org/jira/browse/HDFS-16957

[jira] [Created] (HDFS-16953) RBF Mount table store APIs should update cache only if state store record is successfully updated

Viraj Jasani created HDFS-16953: --- Summary: RBF Mount table store APIs should update cache only if state store record is successfully updated Key: HDFS-16953 URL: https://issues.apache.org/jira/browse/HDFS-16953

[jira] [Created] (HDFS-16947) RBF NamenodeHeartbeatService to report error for not being able to register namenode in state store

Viraj Jasani created HDFS-16947: --- Summary: RBF NamenodeHeartbeatService to report error for not being able to register namenode in state store Key: HDFS-16947 URL: https://issues.apache.org/jira/browse/HDFS-16947

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC2)

gt;> > call and discretion. As far as I know a release can not be vetoed by > >> > "anybody" as per the apache by laws.( > >> > https://www.apache.org/legal/release-policy.html#release-approval). > >> Even > >> > our bylaws say that p

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC2)

While this RC is not going to be final, I just wanted to share the results of the testing I have done so far with RC1 and RC2. * Signature: ok * Checksum : ok * Rat check (1.8.0_341): ok - mvn clean apache-rat:check * Built from source (1.8.0_341): ok - mvn clean install -DskipTests * Built tar

[jira] [Created] (HDFS-16938) Utility to trigger heartbeat and wait until BP thread queue is fully processed

Viraj Jasani created HDFS-16938: --- Summary: Utility to trigger heartbeat and wait until BP thread queue is fully processed Key: HDFS-16938 URL: https://issues.apache.org/jira/browse/HDFS-16938 Project

Socket timeout settings

We have a specific environment where we need to harmonize socket connection timeouts for all Hadoop daemons and some downstreamers too. While reviewing the socket connection timeouts set in NetUtils, UrlConnection (HttpURLConnection), I compiled a list of the following configurations: - ipc.cli

[jira] [Resolved] (HDFS-16918) Optionally shut down datanode if it does not stay connected to active namenode

[ https://issues.apache.org/jira/browse/HDFS-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani resolved HDFS-16918. - Resolution: Won't Fix > Optionally shut down datanode if it does not stay connected t

[jira] [Created] (HDFS-16925) Fix regex pattern for namenode audit log tests

Viraj Jasani created HDFS-16925: --- Summary: Fix regex pattern for namenode audit log tests Key: HDFS-16925 URL: https://issues.apache.org/jira/browse/HDFS-16925 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-16918) Optionally shut down datanode if it does not stay connected to active namenode

Viraj Jasani created HDFS-16918: --- Summary: Optionally shut down datanode if it does not stay connected to active namenode Key: HDFS-16918 URL: https://issues.apache.org/jira/browse/HDFS-16918 Project

[jira] [Created] (HDFS-16907) BP service actor LastHeartbeat is not sufficient to track realtime connection breaks

Viraj Jasani created HDFS-16907: --- Summary: BP service actor LastHeartbeat is not sufficient to track realtime connection breaks Key: HDFS-16907 URL: https://issues.apache.org/jira/browse/HDFS-16907

[jira] [Created] (HDFS-16902) Add Namenode status to BPServiceActor metrics and improve logging in offerservice

Viraj Jasani created HDFS-16902: --- Summary: Add Namenode status to BPServiceActor metrics and improve logging in offerservice Key: HDFS-16902 URL: https://issues.apache.org/jira/browse/HDFS-16902

[jira] [Created] (HDFS-16891) Avoid the overhead of copy-on-write exception list while loading inodes sub sections in parallel

Viraj Jasani created HDFS-16891: --- Summary: Avoid the overhead of copy-on-write exception list while loading inodes sub sections in parallel Key: HDFS-16891 URL: https://issues.apache.org/jira/browse/HDFS-16891

[jira] [Created] (HDFS-16887) Log start and end of phase/step in startup progress

Viraj Jasani created HDFS-16887: --- Summary: Log start and end of phase/step in startup progress Key: HDFS-16887 URL: https://issues.apache.org/jira/browse/HDFS-16887 Project: Hadoop HDFS Issue

Re: [VOTE] Release Apache Hadoop 3.3.5

-0 (non-binding) Output of hadoop-vote.sh: * Signature: ok * Checksum : ok * Rat check (1.8.0_341): ok - mvn clean apache-rat:check * Built from source (1.8.0_341): ok - mvn clean install -DskipTests * Built tar from source (1.8.0_341): ok - mvn clean package -Pdist -DskipTests -Dtar -Dmaven

[jira] [Created] (HDFS-16637) TestHDFSCLI#testAll consistently failing

Viraj Jasani created HDFS-16637: --- Summary: TestHDFSCLI#testAll consistently failing Key: HDFS-16637 URL: https://issues.apache.org/jira/browse/HDFS-16637 Project: Hadoop HDFS Issue Type: Test

[jira] [Created] (HDFS-16634) Dynamically adjust slow peer report size on JMX metrics

Viraj Jasani created HDFS-16634: --- Summary: Dynamically adjust slow peer report size on JMX metrics Key: HDFS-16634 URL: https://issues.apache.org/jira/browse/HDFS-16634 Project: Hadoop HDFS

[jira] [Created] (HDFS-16618) sync_file_range error should include more volume and file info

Viraj Jasani created HDFS-16618: --- Summary: sync_file_range error should include more volume and file info Key: HDFS-16618 URL: https://issues.apache.org/jira/browse/HDFS-16618 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

ood to have patches, but doesn't look like blockers to me. kind of build > related stuffs only, nothing bad with our core Hadoop code. > > -Ayush > > On Sat, 28 May 2022 at 01:04, Viraj Jasani wrote: > >> +0 (non-binding), >> >> * Signature/Checksum looks

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

+0 (non-binding), * Signature/Checksum looks good, though I am not sure where "target/artifacts" is coming from for the tars, here is the diff (this was the case for 2.10.1 as well but checksum was correct): 1c1 < SHA512 (hadoop-2.10.2-site.tar.gz) = 3055a830003f5012660d92da68a317e15da5b73301c2c7

[jira] [Created] (HDFS-16595) Slow peer metrics - add median, mad and upper latency limits

Viraj Jasani created HDFS-16595: --- Summary: Slow peer metrics - add median, mad and upper latency limits Key: HDFS-16595 URL: https://issues.apache.org/jira/browse/HDFS-16595 Project: Hadoop HDFS

[jira] [Created] (HDFS-16582) Expose aggregate latency of slow node as perceived by the reporting node

Viraj Jasani created HDFS-16582: --- Summary: Expose aggregate latency of slow node as perceived by the reporting node Key: HDFS-16582 URL: https://issues.apache.org/jira/browse/HDFS-16582 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)

+1 (non-binding) * Signature: ok * Checksum : ok * Rat check (1.8.0_301): ok - mvn clean apache-rat:check * Built from source (1.8.0_301): ok - mvn clean install -DskipTests * Built tar from source (1.8.0_301): ok - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true HDFS, M

Re: [VOTE] Release Apache Hadoop 3.3.3

+1 (non-binding), With a minor change in hadoop-vote, * Signature: ok * Checksum : ok * Rat check (1.8.0_301): ok - mvn clean apache-rat:check * Built from source (1.8.0_301): ok - mvn clean install -DskipTests * Built tar from source (1.8.0_301): o

[jira] [Created] (HDFS-16568) dfsadmin -reconfig option to start/query reconfig on all live datanodes

Viraj Jasani created HDFS-16568: --- Summary: dfsadmin -reconfig option to start/query reconfig on all live datanodes Key: HDFS-16568 URL: https://issues.apache.org/jira/browse/HDFS-16568 Project: Hadoop

[jira] [Created] (HDFS-16528) Reconfigure slow peer enable for Namenode

Viraj Jasani created HDFS-16528: --- Summary: Reconfigure slow peer enable for Namenode Key: HDFS-16528 URL: https://issues.apache.org/jira/browse/HDFS-16528 Project: Hadoop HDFS Issue Type: Task

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC1

+1 (non-binding) * Signature: ok * Checksum : ok * Rat check (1.8.0_301): ok - mvn clean apache-rat:check * Built from source (1.8.0_301): ok - mvn clean install -DskipTests * Built tar from source (1.8.0_301): ok - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true * Funct

[jira] [Created] (HDFS-16522) Set Http and Ipc ports for Datanodes in MiniDFSCluster

Viraj Jasani created HDFS-16522: --- Summary: Set Http and Ipc ports for Datanodes in MiniDFSCluster Key: HDFS-16522 URL: https://issues.apache.org/jira/browse/HDFS-16522 Project: Hadoop HDFS

[jira] [Created] (HDFS-16521) DFS API to retrieve slow datanodes

Viraj Jasani created HDFS-16521: --- Summary: DFS API to retrieve slow datanodes Key: HDFS-16521 URL: https://issues.apache.org/jira/browse/HDFS-16521 Project: Hadoop HDFS Issue Type: New Feature

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

+1 (non-binding) Using hadoop-vote.sh * Signature: ok * Checksum : ok * Rat check (1.8.0_301): ok - mvn clean apache-rat:check * Built from source (1.8.0_301): ok - mvn clean install -DskipTests * Built tar from source (1.8.0_301): ok - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.java

[jira] [Created] (HDFS-16502) Reconfigure Block Invalidate limit

Viraj Jasani created HDFS-16502: --- Summary: Reconfigure Block Invalidate limit Key: HDFS-16502 URL: https://issues.apache.org/jira/browse/HDFS-16502 Project: Hadoop HDFS Issue Type: Task

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC5

+1 (non-binding) Using hadoop-vote.sh: * Signature: ok * Checksum : ok * Rat check (1.8.0_301): ok - mvn clean apache-rat:check * Built from source (1.8.0_301): ok - mvn clean install -DskipTests * Built tar from source (1.8.0_301): ok - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.jav

[jira] [Created] (HDFS-16481) Provide support to set Http and Rpc ports in MiniJournalCluster

Viraj Jasani created HDFS-16481: --- Summary: Provide support to set Http and Rpc ports in MiniJournalCluster Key: HDFS-16481 URL: https://issues.apache.org/jira/browse/HDFS-16481 Project: Hadoop HDFS

[jira] [Created] (HDFS-16461) Expose JournalNode storage info in the jmx metrics

Viraj Jasani created HDFS-16461: --- Summary: Expose JournalNode storage info in the jmx metrics Key: HDFS-16461 URL: https://issues.apache.org/jira/browse/HDFS-16461 Project: Hadoop HDFS Issue

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4

ranch-3.3.2? > https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24 > HADOOP-18066 is resolved as invalid so I just removed the fix version tag. > > Please check again when you have a chance. Thanks. > > Best, > Chao > > > > > > > > > > > On Mon,

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4

ate you putting effort to do a thorough check on this. > > Chao > > On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani wrote: > >> -0 (non-binding), due to git/jira version discrepancies. Once resolved and >> changelist updated, will change my vote to +1 (non-binding). &

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4

1 HDFS-16350 HDFS-16336 HADOOP-17975 YARN-10991 HDFS-16332 HADOOP-17857 HDFS-16271 HADOOP-17195 HADOOP-17290 HADOOP-17819 YARN-9551 On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani wrote: > Thanks Chao. Yes contents are now present, I will start the testing. > > > On Mon, 14 Feb 2022 at

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4

Thanks Chao. Yes contents are now present, I will start the testing. On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun wrote: > Oops, sorry about that. They should be there now. Can you check again? > Thanks! > > Chao > > On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani wrote: > >

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4

> The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ Chao, the RC folder seems empty as of now. On Sat, Feb 12, 2022 at 3:12 AM Chao Sun wrote: > Hi all, > > Sorry for the delay! was waiting for a few fixes that people have requested > to backport. I've just put togeth

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

> * ATSv2 functional tests: ok Ran against hbase 1.7 cluster On Thu, Jan 27, 2022 at 5:03 PM Viraj Jasani wrote: > +1 (non-binding) > > * Signature: ok > * Checksum: ok > * Build from source: ok > * Ran some large tests from hbase 2.5 branch against RC2: looks good

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3

+1 (non-binding) * Signature: ok * Checksum: ok * Build from source: ok * Ran some large tests from hbase 2.5 branch against RC2: looks good (carry forward from previous RC) * HDFS functional tests: ok * Ran a couple of MapReduce Jobs: ok * ATSv2 functional tests: ok On Thu, Jan 27, 2022 at 12:4

[jira] [Created] (HDFS-16358) HttpFS implementation for getSnapshotDiffReportListing

Viraj Jasani created HDFS-16358: --- Summary: HttpFS implementation for getSnapshotDiffReportListing Key: HDFS-16358 URL: https://issues.apache.org/jira/browse/HDFS-16358 Project: Hadoop HDFS

[jira] [Reopened] (HDFS-16171) De-flake testDecommissionStatus

[ https://issues.apache.org/jira/browse/HDFS-16171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reopened HDFS-16171: - Reopening for 3.2 backport. > De-flake testDecommissionSta

[jira] [Created] (HDFS-16350) Datanode start time should be set after RPC server starts successfully

Viraj Jasani created HDFS-16350: --- Summary: Datanode start time should be set after RPC server starts successfully Key: HDFS-16350 URL: https://issues.apache.org/jira/browse/HDFS-16350 Project: Hadoop

[jira] [Created] (HDFS-16330) Fix incorrect placeholder for Exception logs in DiskBalancer

Viraj Jasani created HDFS-16330: --- Summary: Fix incorrect placeholder for Exception logs in DiskBalancer Key: HDFS-16330 URL: https://issues.apache.org/jira/browse/HDFS-16330 Project: Hadoop HDFS

[jira] [Created] (HDFS-16323) DatanodeHttpServer doesn't require handler state map while retrieving filter handlers

Viraj Jasani created HDFS-16323: --- Summary: DatanodeHttpServer doesn't require handler state map while retrieving filter handlers Key: HDFS-16323 URL: https://issues.apache.org/jira/browse/HDFS-

Re: [DISCUSS] Migrate to Yetus Interface classification annotations

t; If current org.apache.yetus:audience-annotations(:0.13.0) for Java 8 no > longer evolves, > migrating to it in short term is not much useful? > > [1] > https://issues.apache.org/jira/browse/HADOOP-15304?focusedCommentId=16418072&page=com.atlassian.jira.plugin.system.issuetabp

Re: [DISCUSS] Migrate to Yetus Interface classification annotations

a necessary first step here would be to determine if > > we have contributors willing to show up over in that project to get > things > > into a good state for future JDK adoption. > > > > > > > > > > > > [1]: > > > https://s.apache.org/ybdl6 &g

[DISCUSS] Migrate to Yetus Interface classification annotations

Since the early days, Hadoop has provided Interface classification annotations to represent the scope and stability for downstream applications to select Hadoop APIs carefully. After some time, these annotations (InterfaceAudience and InterfaceStability) have been migrated to Apache Yetus. As of to

[jira] [Created] (HDFS-16227) testMoverWithStripedFile fails intermittently

Viraj Jasani created HDFS-16227: --- Summary: testMoverWithStripedFile fails intermittently Key: HDFS-16227 URL: https://issues.apache.org/jira/browse/HDFS-16227 Project: Hadoop HDFS Issue Type

Re: [DISCUSS] Hadoop 3.3.2 release?

+1 (non-binding) for the release. On Tue, 7 Sep 2021 at 10:36 PM, Chao Sun wrote: > Hi all, > > It has been almost 3 months since the 3.3.1 release and branch-3.3 has > accumulated quite a few commits (118 atm). In particular, Spark community > recently found an issue which prevents one from us

[jira] [Created] (HDFS-16213) Flaky test TestFsDatasetImpl#testDnRestartWithHardLink

Viraj Jasani created HDFS-16213: --- Summary: Flaky test TestFsDatasetImpl#testDnRestartWithHardLink Key: HDFS-16213 URL: https://issues.apache.org/jira/browse/HDFS-16213 Project: Hadoop HDFS

[jira] [Created] (HDFS-16199) Resolve log placeholders in NamenodeBeanMetrics

Viraj Jasani created HDFS-16199: --- Summary: Resolve log placeholders in NamenodeBeanMetrics Key: HDFS-16199 URL: https://issues.apache.org/jira/browse/HDFS-16199 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-16184) De-flake TestBlockScanner#testSkipRecentAccessFile

Viraj Jasani created HDFS-16184: --- Summary: De-flake TestBlockScanner#testSkipRecentAccessFile Key: HDFS-16184 URL: https://issues.apache.org/jira/browse/HDFS-16184 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-16171) testDecommissionStatus is flaky (for both TestDecommissioningStatus and TestDecommissioningStatusWithBackoffMonitor)

Viraj Jasani created HDFS-16171: --- Summary: testDecommissionStatus is flaky (for both TestDecommissioningStatus and TestDecommissioningStatusWithBackoffMonitor) Key: HDFS-16171 URL: https://issues.apache.org/jira

[jira] [Created] (HDFS-16163) Avoid locking entire blockPinningFailures map

Viraj Jasani created HDFS-16163: --- Summary: Avoid locking entire blockPinningFailures map Key: HDFS-16163 URL: https://issues.apache.org/jira/browse/HDFS-16163 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-16139) Update BPServiceActor Scheduler's nextBlockReportTime atomically

Viraj Jasani created HDFS-16139: --- Summary: Update BPServiceActor Scheduler's nextBlockReportTime atomically Key: HDFS-16139 URL: https://issues.apache.org/jira/browse/HDFS-16139 Project: Hadoop

[jira] [Created] (HDFS-16108) Incorrect log placeholders used in JournalNodeSyncer

Viraj Jasani created HDFS-16108: --- Summary: Incorrect log placeholders used in JournalNodeSyncer Key: HDFS-16108 URL: https://issues.apache.org/jira/browse/HDFS-16108 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-16092) Avoid creating LayoutFlags redundant objects

Viraj Jasani created HDFS-16092: --- Summary: Avoid creating LayoutFlags redundant objects Key: HDFS-16092 URL: https://issues.apache.org/jira/browse/HDFS-16092 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

Viraj Jasani created HDFS-16090: --- Summary: Fine grained locking for datanodeNetworkCounts Key: HDFS-16090 URL: https://issues.apache.org/jira/browse/HDFS-16090 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-16082) Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer

Viraj Jasani created HDFS-16082: --- Summary: Avoid non-atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer Key: HDFS-16082 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HDFS-16080) RBF: Invoking method in all locations should break the loop after successful result

Viraj Jasani created HDFS-16080: --- Summary: RBF: Invoking method in all locations should break the loop after successful result Key: HDFS-16080 URL: https://issues.apache.org/jira/browse/HDFS-16080

[jira] [Created] (HDFS-16075) Use empty array constants present in StorageType and DatanodeInfo to avoid creating redundant objects

Viraj Jasani created HDFS-16075: --- Summary: Use empty array constants present in StorageType and DatanodeInfo to avoid creating redundant objects Key: HDFS-16075 URL: https://issues.apache.org/jira/browse/HDFS-16075

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

+1 (non-binding) * Signature: ok * Checksum : ok * Rat check (1.8.0_171): ok - mvn clean apache-rat:check * Built from source (1.8.0_171): ok - mvn clean install -DskipTests * HDFS basic testing in pseudo-distributed mode: ok * Built HBase 2.4.4 with Hadoop 3.3.1 RC and tested some basic scenar

[jira] [Created] (HDFS-16054) Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

Viraj Jasani created HDFS-16054: --- Summary: Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project Key: HDFS-16054 URL: https://issues.apache.org/jira/browse/HDFS-16054 Project: H

Re: [VOTE] Hadoop 3.1.x EOL

+1 (non-binding) On Thu, 3 Jun 2021 at 12:21 PM, Wei-Chiu Chuang wrote: > +1 > > On Thu, Jun 3, 2021 at 2:14 PM Akira Ajisaka wrote: > > > Dear Hadoop developers, > > > > Given the feedback from the discussion thread [1], I'd like to start > > an official vote > > thread for the community to vo

Re: [VOTE] Release Apache Hadoop Thirdparty 1.1.1 RC0

+1 (non-binding) * Signature: ok * Checksum : ok * Rat check (1.8.0_171): ok - mvn clean apache-rat:check * Built from source (1.8.0_171): ok - mvn clean install * Built Hadoop trunk with updated thirdparty: ok * CL/RN: ok On Wed, 26 May 2021 at 1:59 PM, Wei-Chiu Chuang wrote: > Hi folks, >

[jira] [Created] (HDFS-16035) Remove DummyGroupMapping

Viraj Jasani created HDFS-16035: --- Summary: Remove DummyGroupMapping Key: HDFS-16035 URL: https://issues.apache.org/jira/browse/HDFS-16035 Project: Hadoop HDFS Issue Type: Task

Re: [DISCUSS] Change project style guidelines to allow line length 100

+1 (non-binding) to increasing line length to 100 instead of 80 and applying this to all active branches (for the ease of backport as Stephen mentioned). On Thu, 20 May 2021 at 3:30 PM, Stephen O'Donnell wrote: > I am +1 on increasing the line length to 100. > > As for changes to address existi

Re: [VOTE] hadoop-thirdparty 1.1.0-RC0

+1 (non-binding) * Signature: ok * Checksum : ok * CHANGELOG / RELEASENOTES: ok * Rat check (1.8.0_171): ok - mvn clean apache-rat:check * Built from source (1.8.0_171): ok - mvn clean install -DskipTests - mvn clean install -DskipTests -Psrc * Built Hadoop trunk againt hadoop-thirdparty 1.1.0

Re: [DISCUSS] Hadoop 3.3.1 release

Thanks Wei-Chiu. > If you believe there are more features/bug fixes we should include in 3.3.1 (I spent the past few weeks backporting jiras but I'm sure I missed some) please shout out. Although not marked critical, I believe HDFS-15982 could get in 3.3.1 if you are fine. Thanks to Bhavik for fi

[jira] [Created] (HDFS-15989) Split TestBalancer into two classes

Viraj Jasani created HDFS-15989: --- Summary: Split TestBalancer into two classes Key: HDFS-15989 URL: https://issues.apache.org/jira/browse/HDFS-15989 Project: Hadoop HDFS Issue Type: Task

[jira] [Resolved] (HDFS-15956) Provide utility class for FSNamesystem

[ https://issues.apache.org/jira/browse/HDFS-15956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani resolved HDFS-15956. - Resolution: Won't Fix > Provide utility class for FSNa

[jira] [Created] (HDFS-15956) Provide utility class for FSNamesystem

Viraj Jasani created HDFS-15956: --- Summary: Provide utility class for FSNamesystem Key: HDFS-15956 URL: https://issues.apache.org/jira/browse/HDFS-15956 Project: Hadoop HDFS Issue Type: Task

[jira] [Created] (HDFS-15940) Some tests in TestBlockRecovery are consistently failing

Viraj Jasani created HDFS-15940: --- Summary: Some tests in TestBlockRecovery are consistently failing Key: HDFS-15940 URL: https://issues.apache.org/jira/browse/HDFS-15940 Project: Hadoop HDFS

[jira] [Created] (HDFS-15931) Fix non-static inner classes for better memory management

Viraj Jasani created HDFS-15931: --- Summary: Fix non-static inner classes for better memory management Key: HDFS-15931 URL: https://issues.apache.org/jira/browse/HDFS-15931 Project: Hadoop HDFS

[jira] [Created] (HDFS-15926) hadoop-annotations is duplicated in hadoop-hdfs

Viraj Jasani created HDFS-15926: --- Summary: hadoop-annotations is duplicated in hadoop-hdfs Key: HDFS-15926 URL: https://issues.apache.org/jira/browse/HDFS-15926 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-15911) Provide blocks moved count in Balancer iteration result

Viraj Jasani created HDFS-15911: --- Summary: Provide blocks moved count in Balancer iteration result Key: HDFS-15911 URL: https://issues.apache.org/jira/browse/HDFS-15911 Project: Hadoop HDFS

[jira] [Created] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

Viraj Jasani created HDFS-15904: --- Summary: Flaky test TestBalancer#testBalancerWithSortTopNodes() Key: HDFS-15904 URL: https://issues.apache.org/jira/browse/HDFS-15904 Project: Hadoop HDFS

[jira] [Created] (HDFS-15895) DFSAdmin#printOpenFiles has redundant String#format usage

Viraj Jasani created HDFS-15895: --- Summary: DFSAdmin#printOpenFiles has redundant String#format usage Key: HDFS-15895 URL: https://issues.apache.org/jira/browse/HDFS-15895 Project: Hadoop HDFS

[jira] [Created] (HDDS-2137) HddsClientUtils and OzoneUtils have duplicate verifyResourceName()

Viraj Jasani created HDDS-2137: -- Summary: HddsClientUtils and OzoneUtils have duplicate verifyResourceName() Key: HDDS-2137 URL: https://issues.apache.org/jira/browse/HDDS-2137 Project: Hadoop