[jira] [Created] (HDFS-17591) RBF: Router should follow X-FRAME-OPTIONS protection setting

Takanobu Asanuma created HDFS-17591: --- Summary: RBF: Router should follow X-FRAME-OPTIONS protection setting Key: HDFS-17591 URL: https://issues.apache.org/jira/browse/HDFS-17591 Project: Hadoop

[jira] [Created] (HDFS-17468) Update ISA-L to 2.31.0 in the build image

Takanobu Asanuma created HDFS-17468: --- Summary: Update ISA-L to 2.31.0 in the build image Key: HDFS-17468 URL: https://issues.apache.org/jira/browse/HDFS-17468 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-17435) Fix TestRouterRpc failed

[ https://issues.apache.org/jira/browse/HDFS-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17435. - Fix Version/s: 3.5.0 Resolution: Fixed > Fix TestRouterRpc fai

[jira] [Created] (HDFS-17441) Fix junit dependency by adding missing library in hadoop-hdfs-rbf

Takanobu Asanuma created HDFS-17441: --- Summary: Fix junit dependency by adding missing library in hadoop-hdfs-rbf Key: HDFS-17441 URL: https://issues.apache.org/jira/browse/HDFS-17441 Project

[jira] [Resolved] (HDFS-17354) Delay invoke clearStaleNamespacesInRouterStateIdContext during router start up

[ https://issues.apache.org/jira/browse/HDFS-17354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17354. - Fix Version/s: 3.5.0 Resolution: Fixed > Delay inv

[jira] [Resolved] (HDFS-17432) Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf

[ https://issues.apache.org/jira/browse/HDFS-17432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17432. - Fix Version/s: 3.4.1 3.5.0 Resolution: Fixed > Fix ju

[jira] [Created] (HDFS-17435) Fix TestRouterRpc#testClearStaleNamespacesInRouterStateIdContext() failed

Takanobu Asanuma created HDFS-17435: --- Summary: Fix TestRouterRpc#testClearStaleNamespacesInRouterStateIdContext() failed Key: HDFS-17435 URL: https://issues.apache.org/jira/browse/HDFS-17435

[jira] [Created] (HDFS-17432) Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf

Takanobu Asanuma created HDFS-17432: --- Summary: Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf Key: HDFS-17432 URL: https://issues.apache.org/jira/browse/HDFS-17432 Project

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

Regards, - Takanobu Asanuma 2024年3月14日(木) 15:19 Xiaoqiao He : > Thanks Ayush for highlighting this information. Absolutely true, we should > count RM's vote when explicit +1 here. > > Best Regards, > - He Xiaoqiao > > On Thu, Mar 14, 2024 at 3:55 AM Ayush Saxena wrote:

Re: Discussion about NameNode Fine-grained locking

jdk17 or above, so I think the major problem is > that we have to upgrade hadoop code to fit in jdk17. > We were using jdk11 with zgc to test NN, and didn't see an impressive > improvement. > > On Wed, Mar 6, 2024 at 11:53 AM Takanobu Asanuma > wrote: > > > >

Re: Discussion about NameNode Fine-grained locking

> We're trying tuning gc options and even new gc engine like zgc, but they are not very helpful. I'm afraid this is a digression, but could you elaborate on using ZGC for NameNode? Did you encounter any problems? I've never heard of using ZGC for NameNode in practice, so I'm curious about it. Reg

[jira] [Resolved] (HDFS-17361) DiskBalancer: Query command support with multiple nodes

[ https://issues.apache.org/jira/browse/HDFS-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17361. - Fix Version/s: 3.5.0 Resolution: Fixed > DiskBalancer: Query command support w

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1)

src Regards, - Takanobu Asanuma 2024年2月6日(火) 11:03 Xiaoqiao He : > cc @PJ Fanning @Ayush Saxena > @Steve > Loughran @Takanobu Asanuma @Shuyan > Zhang @inigo...@apache.org > > On Mon, Feb 5, 2024 at 11:30 AM Xiaoqiao He wrote: > >> +1(binding). >> >>

[jira] [Created] (HDFS-17370) Fix junit dependency for running parameterized tests in hadoop-hdfs-rbf

Takanobu Asanuma created HDFS-17370: --- Summary: Fix junit dependency for running parameterized tests in hadoop-hdfs-rbf Key: HDFS-17370 URL: https://issues.apache.org/jira/browse/HDFS-17370 Project

Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0

It also looks good to me, except for the diff. * Verified signatures and hashes * Reviewed the documents * Successfully built from source with `mvn clean install` * Successfully compiled Hadoop trunk and branch-3.4 using the Hadoop thirdparty 1.2.0 Anyway, since hadoop-thirdparty-1.1.1 has some h

[jira] [Resolved] (HDFS-17359) EC: recheck failed streamers should only after flushing all packets.

[ https://issues.apache.org/jira/browse/HDFS-17359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17359. - Fix Version/s: 3.3.9 3.4.1 3.5.0 Resolution

[jira] [Reopened] (HDFS-17348) Enhance Log when checkLocations in RecoveryTaskStriped

[ https://issues.apache.org/jira/browse/HDFS-17348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reopened HDFS-17348: - > Enhance Log when checkLocations in RecoveryTaskStri

[jira] [Resolved] (HDFS-17348) Enhance Log when checkLocations in RecoveryTaskStriped

[ https://issues.apache.org/jira/browse/HDFS-17348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17348. - Resolution: Duplicate I'd like to change the status to duplicate if HDFS-17358 fixe

[jira] [Created] (HDFS-17362) RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally

Takanobu Asanuma created HDFS-17362: --- Summary: RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally Key: HDFS-17362 URL: https://issues.apache.org/jira/browse/HDFS-17362

Re: [INFO] Hadoop-3.4 Release Update

Hi Shilun, Thank you for leading the 3.4.0 release. > 2. In JIRA issues where other release versions have been released, remove > the 3.4.0 entry from the fix version. As I mentioned in my comment on HADOOP-18045, I think 3.4.0 should still be included in the Fix versions, even if it was already

[jira] [Resolved] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17312. - Fix Version/s: 3.5.0 Resolution: Fixed > packetsReceived metric should ign

[jira] [Resolved] (HDFS-17315) Optimize the namenode format code logic.

[ https://issues.apache.org/jira/browse/HDFS-17315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17315. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > Optimize

[jira] [Resolved] (HDFS-17277) Delete invalid code logic in namenode format

[ https://issues.apache.org/jira/browse/HDFS-17277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17277. - Fix Version/s: 3.4.0 Resolution: Fixed > Delete invalid code logic in namen

[jira] [Resolved] (HDFS-17301) Add read and write dataXceiver threads count metrics to datanode.

[ https://issues.apache.org/jira/browse/HDFS-17301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17301. - Fix Version/s: 3.4.0 Resolution: Fixed > Add read and write dataXceiver thre

[jira] [Resolved] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17297. - Fix Version/s: 3.4.0 Resolution: Fixed > The NameNode should remove block f

[jira] [Resolved] (HDFS-17284) Fix int overflow in calculating numEcReplicatedTasks and numReplicationTasks during block recovery

[ https://issues.apache.org/jira/browse/HDFS-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17284. - Fix Version/s: 3.4.0 Resolution: Fixed > Fix int overflow in calculat

[jira] [Resolved] (HDFS-17298) Fix NPE in DataNode.handleBadBlock and BlockSender

[ https://issues.apache.org/jira/browse/HDFS-17298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17298. - Fix Version/s: 3.4.0 Resolution: Fixed > Fix NPE in DataNode.handleBadBlock

[jira] [Resolved] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17294. - Resolution: Fixed > Reconfigure the scheduling cycle of the slowPeerCollectorDae

[jira] [Resolved] (HDFS-17156) Client may receive old state ID which will lead to inconsistent reads

[ https://issues.apache.org/jira/browse/HDFS-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17156. - Fix Version/s: 3.4.0 Resolution: Fixed > Client may receive old state ID wh

[jira] [Resolved] (HDFS-16967) RBF: File based state stores should allow concurrent access to the records

[ https://issues.apache.org/jira/browse/HDFS-16967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16967. - Fix Version/s: 3.4.0 Resolution: Fixed > RBF: File based state stores sho

[jira] [Resolved] (HDFS-16958) EC: Fix bug in processing EC excess redundancy

[ https://issues.apache.org/jira/browse/HDFS-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16958. - Resolution: Not A Problem > EC: Fix bug in processing EC excess redunda

Re: [VOTE] Release Apache Hadoop 3.3.5

from the top page not to confuse Hadoop users. - Takanobu 2023年2月23日(木) 17:17 Takanobu Asanuma : > Thanks for driving the release, Steve and Mukund. > > I found that there were some jiras with wrong fix versions. > > The fix versions included 3.3.5, but actually, it isn't in

Re: [VOTE] Release Apache Hadoop 3.3.5

Thanks for driving the release, Steve and Mukund. I found that there were some jiras with wrong fix versions. The fix versions included 3.3.5, but actually, it isn't in 3.3.5-RC1: - HDFS-16845 - HADOOP-18345 The fix versions didn't include 3.3.5, but actually, it is in 3.3.5-RC1 (and it is not i

[jira] [Resolved] (HDFS-16903) Fix javadoc of Class LightWeightResizableGSet

[ https://issues.apache.org/jira/browse/HDFS-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16903. - Fix Version/s: 3.4.0 Resolution: Fixed > Fix javadoc of Cl

[jira] [Resolved] (HDFS-16821) Fix regression in HDFS-13522 that enables observer reads by default.

[ https://issues.apache.org/jira/browse/HDFS-16821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16821. - Fix Version/s: 3.4.0 Resolution: Fixed > Fix regression in HDFS-13522 t

[jira] [Resolved] (HDFS-16888) BlockManager#maxReplicationStreams, replicationStreamsHardLimit, blocksReplWorkMultiplier and PendingReconstructionBlocks#timeout should be volatile

[ https://issues.apache.org/jira/browse/HDFS-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16888. - Fix Version/s: 3.4.0 Resolution: Fixed > BlockManager#maxReplicationStre

[jira] [Resolved] (HDFS-16876) Garbage collect map entries in shared RouterStateIdContext using information from namenodeResolver instead of the map of active connectionPools.

[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16876. - Fix Version/s: 3.4.0 Resolution: Fixed > Garbage collect map entries in sha

[jira] [Created] (HDFS-16889) Backport JIRAs related to RBF SBN to branch-3.3

Takanobu Asanuma created HDFS-16889: --- Summary: Backport JIRAs related to RBF SBN to branch-3.3 Key: HDFS-16889 URL: https://issues.apache.org/jira/browse/HDFS-16889 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-16809) EC striped block is not sufficient when doing in maintenance

[ https://issues.apache.org/jira/browse/HDFS-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16809. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > EC stri

[jira] [Resolved] (HDFS-16833) NameNode should log internal EC blocks instead of the EC block group when it receives block reports

[ https://issues.apache.org/jira/browse/HDFS-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16833. - Fix Version/s: 3.4.0 Resolution: Fixed > NameNode should log internal EC blo

[jira] [Created] (HDFS-16833) NameNode should log internal EC blocks instead of the EC block group when it receives block reports

Takanobu Asanuma created HDFS-16833: --- Summary: NameNode should log internal EC blocks instead of the EC block group when it receives block reports Key: HDFS-16833 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Resolved] (HDFS-16822) HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API

[ https://issues.apache.org/jira/browse/HDFS-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16822. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed

[jira] [Created] (HDFS-16822) HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API

Takanobu Asanuma created HDFS-16822: --- Summary: HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API Key: HDFS-16822 URL: https://issues.apache.org/jira/browse

[jira] [Resolved] (HDFS-16776) Erasure Coding: The length of targets should be checked when DN gets a reconstruction task

[ https://issues.apache.org/jira/browse/HDFS-16776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16776. - Fix Version/s: 3.4.0 3.3.9 3.2.5 Resolution

[jira] [Resolved] (HDFS-16579) Fix build failure for TestBlockManager on branch-3.2

[ https://issues.apache.org/jira/browse/HDFS-16579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16579. - Fix Version/s: 3.2.4 Resolution: Fixed > Fix build failure for TestBlockMana

[jira] [Resolved] (HDFS-16519) Add throttler to EC reconstruction

[ https://issues.apache.org/jira/browse/HDFS-16519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16519. - Fix Version/s: 3.4.0 3.3.4 Resolution: Fixed > Add thrott

[jira] [Resolved] (HDFS-16552) Fix NPE for TestBlockManager

[ https://issues.apache.org/jira/browse/HDFS-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16552. - Fix Version/s: 3.4.0 3.2.4 3.3.4 Resolution

[jira] [Resolved] (HDFS-16510) Fix EC decommission when rack is not enough

[ https://issues.apache.org/jira/browse/HDFS-16510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16510. - Resolution: Duplicate I'm closing this jira as it is superceded by HDFS-16456. T

[jira] [Resolved] (HDFS-16544) EC decoding failed due to invalid buffer

[ https://issues.apache.org/jira/browse/HDFS-16544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16544. - Fix Version/s: 3.4.0 3.2.4 3.3.4 Assignee

[jira] [Resolved] (HDFS-16538) EC decoding failed due to not enough valid inputs

[ https://issues.apache.org/jira/browse/HDFS-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16538. - Fix Version/s: 3.4.0 3.2.4 3.3.4 Assignee

[jira] [Resolved] (HDFS-16479) EC: NameNode should not send a reconstruction work when the source datanodes are insufficient

[ https://issues.apache.org/jira/browse/HDFS-16479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16479. - Fix Version/s: 3.4.0 3.2.4 3.3.4 Assignee

[jira] [Resolved] (HDFS-16484) [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread

[ https://issues.apache.org/jira/browse/HDFS-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16484. - Fix Version/s: 3.4.0 3.2.4 3.3.4 Resolution

[jira] [Resolved] (HDFS-14969) Fix HDFS client unnecessary failover log printing

[ https://issues.apache.org/jira/browse/HDFS-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-14969. - Resolution: Duplicate This issue seems to be resolved by HADOOP-17116. > Fix H

[jira] [Resolved] (HDFS-16427) Add debug log for BlockManager#chooseExcessRedundancyStriped

[ https://issues.apache.org/jira/browse/HDFS-16427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16427. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution

[jira] [Resolved] (HDFS-16457) Make fs.getspaceused.classname reconfigurable

[ https://issues.apache.org/jira/browse/HDFS-16457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16457. - Fix Version/s: 3.4.0 Resolution: Fixed > Make fs.getspaceused.classn

[jira] [Resolved] (HDFS-16413) Reconfig dfs usage parameters for datanode

[ https://issues.apache.org/jira/browse/HDFS-16413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16413. - Fix Version/s: 3.4.0 Resolution: Fixed > Reconfig dfs usage parameters

[jira] [Resolved] (HDFS-16434) Add opname to read/write lock for remaining operations

[ https://issues.apache.org/jira/browse/HDFS-16434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16434. - Fix Version/s: 3.4.0 Resolution: Fixed > Add opname to read/write lock

[jira] [Resolved] (HDFS-16501) Print the exception when reporting a bad block

[ https://issues.apache.org/jira/browse/HDFS-16501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16501. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Assignee

[jira] [Resolved] (HDFS-16397) Reconfig slow disk parameters for datanode

[ https://issues.apache.org/jira/browse/HDFS-16397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16397. - Fix Version/s: 3.4.0 Resolution: Fixed Merged to trunk. I will try to backport it

[jira] [Resolved] (HDFS-16461) Expose JournalNode storage info in the jmx metrics

[ https://issues.apache.org/jira/browse/HDFS-16461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16461. - Fix Version/s: 3.4.0 Resolution: Fixed Merged to trunk. I didn't backport it

[jira] [Resolved] (HDFS-16396) Reconfig slow peer parameters for datanode

[ https://issues.apache.org/jira/browse/HDFS-16396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16396. - Fix Version/s: 3.4.0 Resolution: Fixed > Reconfig slow peer parameters

[jira] [Resolved] (HDFS-16398) Reconfig block report parameters for datanode

[ https://issues.apache.org/jira/browse/HDFS-16398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16398. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > Reconfig bl

[jira] [Resolved] (HDFS-16423) balancer should not get blocks on stale storages

[ https://issues.apache.org/jira/browse/HDFS-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16423. - Fix Version/s: 3.4.0 Resolution: Fixed > balancer should not get blocks on st

[jira] [Resolved] (HDFS-16399) Reconfig cache report parameters for datanode

[ https://issues.apache.org/jira/browse/HDFS-16399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16399. - Fix Version/s: 3.4.0 Resolution: Fixed > Reconfig cache report parameters

[jira] [Resolved] (HDFS-16426) fix nextBlockReportTime when trigger full block report force

[ https://issues.apache.org/jira/browse/HDFS-16426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16426. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution

[jira] [Resolved] (HDFS-16297) striped block was deleted less than 1 replication

[ https://issues.apache.org/jira/browse/HDFS-16297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16297. - Resolution: Duplicate It seems this issue is the same as HDFS-16420. So I'm closi

[jira] [Resolved] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16420. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution

[jira] [Resolved] (HDFS-16400) Reconfig DataXceiver parameters for datanode

[ https://issues.apache.org/jira/browse/HDFS-16400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16400. - Fix Version/s: 3.4.0 Resolution: Fixed > Reconfig DataXceiver parameters

[jira] [Resolved] (HDFS-16371) Exclude slow disks when choosing volume

[ https://issues.apache.org/jira/browse/HDFS-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16371. - Fix Version/s: 3.4.0 Resolution: Fixed > Exclude slow disks when choosing vol

[jira] [Resolved] (HDFS-16348) Mark slownode as badnode to recover pipeline

[ https://issues.apache.org/jira/browse/HDFS-16348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16348. - Fix Version/s: 3.4.0 Resolution: Fixed > Mark slownode as badnode to reco

[jira] [Resolved] (HDFS-16385) Fix Datanode retrieve slownode information bug.

[ https://issues.apache.org/jira/browse/HDFS-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16385. - Resolution: Fixed Merged the PR. Thanks for your contribution, [~JacksonWang]. I added

[jira] [Resolved] (HDFS-16377) Should CheckNotNull before access FsDatasetSpi

[ https://issues.apache.org/jira/browse/HDFS-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16377. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution

[jira] [Resolved] (HDFS-16375) The FBR lease ID should be exposed to the log

[ https://issues.apache.org/jira/browse/HDFS-16375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16375. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > The FBR le

[jira] [Resolved] (HDFS-16373) Fix MiniDFSCluster restart in case of multiple namenodes

[ https://issues.apache.org/jira/browse/HDFS-16373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16373. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution

[jira] [Resolved] (HDFS-16327) Make dfs.namenode.max.slowpeer.collect.nodes reconfigurable

[ https://issues.apache.org/jira/browse/HDFS-16327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16327. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > M

Re: Next Hadoop community online meetup (Mandarin)

Thanks for the information! 2021年12月9日(木) 13:52 Wei-Chiu Chuang : > Hello, this talk will start in about an hour. > > (I'm sorry forgot to add this is 2PM Beijing time) > > On Thu, Dec 9, 2021 at 11:00 AM Takanobu Asanuma > wrote: > >> What is the timezone? >

[jira] [Resolved] (HDFS-16333) fix balancer bug when transfer an EC block

[ https://issues.apache.org/jira/browse/HDFS-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16333. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution

Re: Next Hadoop community online meetup (Mandarin)

What is the timezone? 2021年11月29日(月) 14:50 Wei-Chiu Chuang : > Hello HDFS devs > > After a long hiatus, I'm happy to share that we'll have Yiyang from Shopee > who is going to talk about their experience of using HDFS at Shopee. > > This is a Mandarin talk. > > 题目：《HDFS在Shopee的演进》 > > 概要：HDFS作为最底

[jira] [Resolved] (HDFS-16331) Make dfs.blockreport.intervalMsec reconfigurable

[ https://issues.apache.org/jira/browse/HDFS-16331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16331. - Fix Version/s: 3.4.0 Resolution: Fixed > Make dfs.blockreport.intervalM

[jira] [Resolved] (HDFS-16344) Improve DirectoryScanner.Stats#toString

[ https://issues.apache.org/jira/browse/HDFS-16344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16344. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > Impr

[jira] [Resolved] (HDFS-16339) Show the threshold when mover threads quota is exceeded

[ https://issues.apache.org/jira/browse/HDFS-16339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16339. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution

[jira] [Resolved] (HDFS-16335) Fix HDFSCommands.md

[ https://issues.apache.org/jira/browse/HDFS-16335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16335. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed >

[jira] [Resolved] (HDFS-16326) Simplify the code for DiskBalancer

[ https://issues.apache.org/jira/browse/HDFS-16326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16326. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution

[jira] [Resolved] (HDFS-16310) RBF: Add client port to CallerContext for Router

[ https://issues.apache.org/jira/browse/HDFS-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16310. - Fix Version/s: 3.4.0 Resolution: Fixed > RBF: Add client port to CallerCont

[jira] [Resolved] (HDFS-16323) DatanodeHttpServer doesn't require handler state map while retrieving filter handlers

[ https://issues.apache.org/jira/browse/HDFS-16323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16323. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed

[jira] [Resolved] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

[ https://issues.apache.org/jira/browse/HDFS-16315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16315. - Fix Version/s: 3.4.0 Resolution: Fixed > Add metrics related to Transfer

[jira] [Resolved] (HDFS-16311) Metric metadataOperationRate calculation error in DataNodeVolumeMetrics

[ https://issues.apache.org/jira/browse/HDFS-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16311. - Fix Version/s: 3.4.0 2.10.2 3.3.2

[jira] [Resolved] (HDFS-16312) Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents

[ https://issues.apache.org/jira/browse/HDFS-16312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16312. - Fix Version/s: 3.4.0 2.10.2 3.3.2

[jira] [Resolved] (HDFS-16298) Improve error msg for BlockMissingException

[ https://issues.apache.org/jira/browse/HDFS-16298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16298. - Fix Version/s: 3.4.0 2.10.2 3.3.2

[jira] [Resolved] (HDFS-16301) Improve BenchmarkThroughput#SIZE naming standardization

[ https://issues.apache.org/jira/browse/HDFS-16301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16301. - Fix Version/s: 3.4.0 2.10.2 3.3.2

[jira] [Resolved] (HDFS-16299) Fix bug for TestDataNodeVolumeMetrics#verifyDataNodeVolumeMetrics

[ https://issues.apache.org/jira/browse/HDFS-16299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16299. - Fix Version/s: 3.4.0 3.3.2 3.2.4 Resolution

[jira] [Resolved] (HDFS-16273) RBF: RouterRpcFairnessPolicyController add availableHandleOnPerNs metrics

[ https://issues.apache.org/jira/browse/HDFS-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16273. - Fix Version/s: 3.4.0 Resolution: Fixed > RBF: RouterRpcFairnessPolicyControl

[jira] [Resolved] (HDFS-16294) Remove invalid DataNode#CONFIG_PROPERTY_SIMULATED

[ https://issues.apache.org/jira/browse/HDFS-16294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16294. - Fix Version/s: 3.2.4 3.3.2 2.10.2

[jira] [Resolved] (HDFS-16266) Add remote port information to HDFS audit log

[ https://issues.apache.org/jira/browse/HDFS-16266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16266. - Fix Version/s: 3.4.0 Resolution: Fixed > Add remote port information to H

[jira] [Resolved] (HDFS-16279) Print detail datanode info when process first storage report

[ https://issues.apache.org/jira/browse/HDFS-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16279. - Fix Version/s: 3.2.4 3.3.2 3.4.0 Resolution

Re: [DISCUSS] Add remote port information to HDFS audit log

I think many users parse audit logs in their own way, and they will be affected if the format is changed. So I agree with Masatake's suggestion. - Takanobu 2021年10月11日(月) 18:19 tom lee : > Thanks @Masatake Iwasaki for your > suggestion. This is a good idea. > > Masatake Iwasaki 于2021年10月11日周一 下

[jira] [Resolved] (HDFS-15018) DataNode doesn't shutdown although the number of failed disks reaches dfs.datanode.failed.volumes.tolerated

[ https://issues.apache.org/jira/browse/HDFS-15018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15018. - Resolution: Duplicate > DataNode doesn't shutdown although the number of fail

[jira] [Resolved] (HDFS-16203) Discover datanodes with unbalanced block pool usage by the standard deviation

[ https://issues.apache.org/jira/browse/HDFS-16203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16203. - Fix Version/s: 3.4.0 Resolution: Fixed > Discover datanodes with unbalanced bl

Re: [DISCUSS] Checkin Hadoop code formatter

Thanks for the initiative, Viraj. I agree to add the code formatter. - Takanobu 2021年9月12日(日) 5:01 Ayush Saxena : > Thanx Viraj for initiating, Makes sense to me to include a formmater > inline with our checkstyle rules in the code, would make life simpler for > all devs. > > -Ayush > > > On 12-

[jira] [Resolved] (HDFS-16076) Avoid using slow DataNodes for reading by sorting locations

[ https://issues.apache.org/jira/browse/HDFS-16076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16076. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > Avoid us

  1   2   3   >