[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991411#comment-14991411 ] Hadoop QA commented on HDFS-9038: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6481: -- Attachment: h6481_20151105.patch h6481_20151105.patch: throws

[jira] [Updated] (HDFS-9360) Storage type usage isn't updated properly after file deletion

[ https://issues.apache.org/jira/browse/HDFS-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9360: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9360) Storage type usage isn't updated properly after file deletion

[ https://issues.apache.org/jira/browse/HDFS-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991418#comment-14991418 ] Hudson commented on HDFS-9360: -- FAILURE: Integrated in Hadoop-trunk-Commit #8758 (See

[jira] [Commented] (HDFS-8574) When block count for a volume exceeds dfs.blockreport.split.threshold, block report causes exception

[ https://issues.apache.org/jira/browse/HDFS-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991717#comment-14991717 ] Brahma Reddy Battula commented on HDFS-8574:

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991615#comment-14991615 ] Yi Liu commented on HDFS-4937: -- This time, it's correct now. The logic of current patch is straight. +1 for

[jira] [Commented] (HDFS-9360) Storage type usage isn't updated properly after file deletion

[ https://issues.apache.org/jira/browse/HDFS-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991635#comment-14991635 ] Hudson commented on HDFS-9360: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2570 (See

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991640#comment-14991640 ] Brahma Reddy Battula commented on HDFS-4937: Yes,V1 Patch LGTM, +1 (non-binding). >

[jira] [Commented] (HDFS-6804) race condition between transferring block and appending block causes "Unexpected checksum mismatch exception"

[ https://issues.apache.org/jira/browse/HDFS-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991579#comment-14991579 ] Max Schmidt commented on HDFS-6804: --- We can confirm this in a 3-node cluster with replication-factor=2.

[jira] [Commented] (HDFS-9360) Storage type usage isn't updated properly after file deletion

[ https://issues.apache.org/jira/browse/HDFS-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991642#comment-14991642 ] Hudson commented on HDFS-9360: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #573 (See

[jira] [Commented] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991458#comment-14991458 ] Robert Metzger commented on HDFS-6481: -- Hi, sorry for not replying to this earlier. [~szetszwo], you

[jira] [Commented] (HDFS-9360) Storage type usage isn't updated properly after file deletion

[ https://issues.apache.org/jira/browse/HDFS-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991457#comment-14991457 ] Hudson commented on HDFS-9360: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1363 (See

[jira] [Commented] (HDFS-9360) Storage type usage isn't updated properly after file deletion

[ https://issues.apache.org/jira/browse/HDFS-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991529#comment-14991529 ] Hudson commented on HDFS-9360: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #640 (See

[jira] [Commented] (HDFS-8968) New benchmark throughput tool for striping erasure coding

[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991596#comment-14991596 ] Rui Li commented on HDFS-8968: -- Hi [~rakeshr], One more question. What do you mean by running a real cluster

[jira] [Updated] (HDFS-9352) Test : Hadoop-HdfsTrunk test cases after HDFS-4937

[ https://issues.apache.org/jira/browse/HDFS-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9352: --- Summary: Test : Hadoop-HdfsTrunk test cases after HDFS-4937 (was: Hadoop-Trunk test

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991545#comment-14991545 ] Brahma Reddy Battula commented on HDFS-9038: {quote}-1 mvninstall 0m 33s

[jira] [Commented] (HDFS-9360) Storage type usage isn't updated properly after file deletion

[ https://issues.apache.org/jira/browse/HDFS-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991599#comment-14991599 ] Hudson commented on HDFS-9360: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #629 (See

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991924#comment-14991924 ] Allen Wittenauer commented on HDFS-9038: Yup. Working as intended. > Reserved space is erroneously

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992056#comment-14992056 ] Allen Wittenauer commented on HDFS-9038: bq. should be executed in dependency order

[jira] [Updated] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9381: Component/s: erasure-coding > When same block came for replication for Striped mode, we can move that block

[jira] [Updated] (HDFS-9271) Implement basic NN operations

[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9271: - Description: Expose via C and C++ API: * mkdirs * rename * delete * stat * chmod * chown * getListing *

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991879#comment-14991879 ] Tony Wu commented on HDFS-9282: --- The failed test {[TestDeleteRace}} is not relevant to the change. Also

[jira] [Commented] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

[ https://issues.apache.org/jira/browse/HDFS-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991889#comment-14991889 ] Hudson commented on HDFS-9378: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2512 (See

[jira] [Commented] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991939#comment-14991939 ] Xiao Chen commented on HDFS-9364: - Thanks [~zhz] for the review! bq. Is there a downside of always doing

[jira] [Commented] (HDFS-9271) Implement basic NN operations

[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991870#comment-14991870 ] Bob Hansen commented on HDFS-9271: -- Dig deeper: * diffs between rename and rename2 messages * getFsStats

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991888#comment-14991888 ] Hudson commented on HDFS-4937: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2512 (See

[jira] [Updated] (HDFS-9372) Remove dead code in DataStorage.recoverTransitionRead

[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9372: - Summary: Remove dead code in DataStorage.recoverTransitionRead (was: Typo in

[jira] [Updated] (HDFS-9383) TestByteArrayManager#testByteArrayManager fails

[ https://issues.apache.org/jira/browse/HDFS-9383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9383: - Attachment: hdfs-9383.log Test log attached. > TestByteArrayManager#testByteArrayManager fails >

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992009#comment-14992009 ] Hudson commented on HDFS-4937: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #641 (See

[jira] [Commented] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

[ https://issues.apache.org/jira/browse/HDFS-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992010#comment-14992010 ] Hudson commented on HDFS-9378: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #641 (See

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992041#comment-14992041 ] Vinayakumar B commented on HDFS-9038: - same case happened with HDFS-9057 > Reserved space is

[jira] [Commented] (HDFS-8820) Simplify enabling NameNode RPC congestion control and FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992079#comment-14992079 ] Ming Ma commented on HDFS-8820: --- Thanks [~arpitagarwal]. Regarding the {{RpcEngine}} backward compatibility,

[jira] [Commented] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

[ https://issues.apache.org/jira/browse/HDFS-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992046#comment-14992046 ] Hudson commented on HDFS-9378: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #630 (See

[jira] [Updated] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4937: - Attachment: (was: HDFS-4937.v2.patch) > ReplicationMonitor can infinite-loop in >

[jira] [Created] (HDFS-9383) TestByteArrayManager#testByteArrayManager fails

Kihwal Lee created HDFS-9383: Summary: TestByteArrayManager#testByteArrayManager fails Key: HDFS-9383 URL: https://issues.apache.org/jira/browse/HDFS-9383 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992026#comment-14992026 ] Vinayakumar B commented on HDFS-9038: - bq. Yup. Working as intended. IMO, since the patch contains

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992070#comment-14992070 ] Yongjun Zhang commented on HDFS-9236: - Seems jenkins was not triggered, I did one here

[jira] [Commented] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

[ https://issues.apache.org/jira/browse/HDFS-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991911#comment-14991911 ] Hudson commented on HDFS-9378: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1364 (See

[jira] [Commented] (HDFS-9360) Storage type usage isn't updated properly after file deletion

[ https://issues.apache.org/jira/browse/HDFS-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991909#comment-14991909 ] Ming Ma commented on HDFS-9360: --- Thanks [~xyao]. > Storage type usage isn't updated properly after file

[jira] [Updated] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9249: -- Attachment: HDFS-9249.005.patch Thanks [~yzhangal]! Rev 5 is based on Yongjun's suggestions.

[jira] [Commented] (HDFS-9383) TestByteArrayManager#testByteArrayManager fails

[ https://issues.apache.org/jira/browse/HDFS-9383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991968#comment-14991968 ] Kihwal Lee commented on HDFS-9383: -- [~szetszwo], do you think it is just a test issue or actual bug in the

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992023#comment-14992023 ] Hudson commented on HDFS-4937: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1365 (See

[jira] [Commented] (HDFS-9379) Make NNThroughputBenchmark support more than 10 numThreads

[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992199#comment-14992199 ] Mingliang Liu commented on HDFS-9379: - Failing tests seem not related. findbugs and asflicense issues

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992312#comment-14992312 ] Hudson commented on HDFS-4937: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #631 (See

[jira] [Commented] (HDFS-9372) Remove dead code in DataStorage.recoverTransitionRead

[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992396#comment-14992396 ] Hudson commented on HDFS-9372: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #642 (See

[jira] [Updated] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7163: - Attachment: HDFS-7163.002.patch New patch (HDFS-7163.002.patch). Fixed unit test failures for

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992122#comment-14992122 ] Hudson commented on HDFS-4937: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2571 (See

[jira] [Commented] (HDFS-8820) Simplify enabling NameNode RPC congestion control and FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992148#comment-14992148 ] Arpit Agarwal commented on HDFS-8820: - Thanks [~mingma], yeah that was my initial thought too. (Filed

[jira] [Updated] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9282: Resolution: Fixed Fix Version/s: 2.8.0 3.0.0 Status: Resolved

[jira] [Commented] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992280#comment-14992280 ] Colin Patrick McCabe commented on HDFS-9252: Looks like some unit tests failed because they

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992349#comment-14992349 ] Hadoop QA commented on HDFS-9236: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992379#comment-14992379 ] Hadoop QA commented on HDFS-9384: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9385) Enable config substitutions in libhdfs++

Bob Hansen created HDFS-9385: Summary: Enable config substitutions in libhdfs++ Key: HDFS-9385 URL: https://issues.apache.org/jira/browse/HDFS-9385 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9318) considerLoad factor can be improved

[ https://issues.apache.org/jira/browse/HDFS-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992167#comment-14992167 ] Kuhu Shukla commented on HDFS-9318: --- The test failures are not seen when run locally and the reason for

[jira] [Commented] (HDFS-8965) Harden edit log reading code against out of memory errors

[ https://issues.apache.org/jira/browse/HDFS-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992293#comment-14992293 ] Colin Patrick McCabe commented on HDFS-8965: bq. 1. What do we do with the corrupted edit log

[jira] [Updated] (HDFS-9385) Enable config substitutions in libhdfs++

[ https://issues.apache.org/jira/browse/HDFS-9385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9385: - Attachment: HDFS-9385.patch Implementation of config and environment substitution > Enable config

[jira] [Updated] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9384: Attachment: HDFS-9384.002.patch I just realized that this test suite has no timeout. I'd like to

[jira] [Created] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

Chris Nauroth created HDFS-9384: --- Summary: TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. Key: HDFS-9384 URL:

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992209#comment-14992209 ] Lei (Eddy) Xu commented on HDFS-9282: - +1. Thanks [~twu] > Make data directory count and storage raw

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992339#comment-14992339 ] Hadoop QA commented on HDFS-9249: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

[ https://issues.apache.org/jira/browse/HDFS-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992123#comment-14992123 ] Hudson commented on HDFS-9378: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2571 (See

[jira] [Commented] (HDFS-9372) Remove dead code in DataStorage.recoverTransitionRead

[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992118#comment-14992118 ] Haohui Mai commented on HDFS-9372: -- +1. The findbugs warnings are unrelated. I'll commit it shortly. >

[jira] [Updated] (HDFS-9117) Config file reader / options classes for libhdfs++

[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9117: - Attachment: HDFS-9117.HDFS-8707.011.patch I had left the TODO refactoring out of the last patch. New

[jira] [Updated] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9328: -- Attachment: HDFS-9328.HDFS-8707.000.patch I've put together basic coding requirements based on

[jira] [Updated] (HDFS-9117) Config file reader / options classes for libhdfs++

[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9117: - Attachment: HDFS-9117.HDFS-8707.012.patch Removed all references to substitution > Config file reader /

[jira] [Commented] (HDFS-9372) Remove dead code in DataStorage.recoverTransitionRead

[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992152#comment-14992152 ] Hudson commented on HDFS-9372: -- FAILURE: Integrated in Hadoop-trunk-Commit #8761 (See

[jira] [Updated] (HDFS-9372) Remove dead code in DataStorage.recoverTransitionRead

[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9372: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992217#comment-14992217 ] Chris Nauroth commented on HDFS-9384: - [~xyao], would you please code review? Thank you! >

[jira] [Updated] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9384: Status: Patch Available (was: Open) > TestWebHdfsContentLength intermittently hangs and fails due

[jira] [Updated] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9384: Attachment: HDFS-9384.001.patch I'm attaching a patch to fix the problem. I've run with this patch

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992366#comment-14992366 ] Hudson commented on HDFS-9282: -- FAILURE: Integrated in Hadoop-trunk-Commit #8762 (See

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992619#comment-14992619 ] Mingliang Liu commented on HDFS-9377: - Thanks to [~yzhangal] for review and commit. Thanks to

[jira] [Created] (HDFS-9387) Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument()

Mingliang Liu created HDFS-9387: --- Summary: Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument() Key: HDFS-9387 URL: https://issues.apache.org/jira/browse/HDFS-9387

[jira] [Commented] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992790#comment-14992790 ] Hadoop QA commented on HDFS-7163: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992801#comment-14992801 ] Hudson commented on HDFS-9377: -- FAILURE: Integrated in Hadoop-trunk-Commit #8763 (See

[jira] [Resolved] (HDFS-4764) TestBlockReaderLocalLegacy flakes in MiniDFSCluster#shutdown

[ https://issues.apache.org/jira/browse/HDFS-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-4764. Resolution: Cannot Reproduce Closing this as stale. > TestBlockReaderLocalLegacy flakes in

[jira] [Commented] (HDFS-9372) Remove dead code in DataStorage.recoverTransitionRead

[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992683#comment-14992683 ] Hudson commented on HDFS-9372: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2513 (See

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992684#comment-14992684 ] Hudson commented on HDFS-9282: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2513 (See

[jira] [Updated] (HDFS-9387) Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument()

[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9387: Attachment: HDFS-9387.000.patch > Parse namenodeUri parameter only once in >

[jira] [Updated] (HDFS-9387) Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument()

[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9387: Status: Patch Available (was: Open) > Parse namenodeUri parameter only once in >

[jira] [Commented] (HDFS-9371) Code cleanup for DatanodeManager

[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992785#comment-14992785 ] Jing Zhao commented on HDFS-9371: - Currently I think we can do this cleanup in trunk. I will update the

[jira] [Updated] (HDFS-9371) Code cleanup for DatanodeManager

[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9371: Status: Patch Available (was: Open) > Code cleanup for DatanodeManager > >

[jira] [Updated] (HDFS-9371) Code cleanup for DatanodeManager

[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9371: Attachment: HDFS-9371.001.patch > Code cleanup for DatanodeManager > > >

[jira] [Updated] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9377: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992724#comment-14992724 ] Tony Wu commented on HDFS-9236: --- Looked at the failed tests and none are related to block recovery. Also

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992431#comment-14992431 ] James Clampffer commented on HDFS-9103: --- Thanks for the comments Bob! "Include an abstraction

[jira] [Updated] (HDFS-9280) Document NFS gateway export point parameter

[ https://issues.apache.org/jira/browse/HDFS-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9280: Labels: supportability (was: ) > Document NFS gateway export point parameter >

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Component/s: performance ha > Unnecessary DNS resolution attempts when creating

[jira] [Commented] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992514#comment-14992514 ] Xiaoyu Yao commented on HDFS-9384: -- Sorry for the late. The fix looks good to me. I only have one

[jira] [Created] (HDFS-9386) Erasure coding: updateBlockForPipeline sometimes returns non-striped block for striped file

Zhe Zhang created HDFS-9386: --- Summary: Erasure coding: updateBlockForPipeline sometimes returns non-striped block for striped file Key: HDFS-9386 URL: https://issues.apache.org/jira/browse/HDFS-9386

[jira] [Updated] (HDFS-9379) Make NNThroughputBenchmark support more than 10 numThreads

[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9379: Description: Currently, the {{NNThroughputBenchmark}} test {{BlockReportStats}} relies on sorted

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992613#comment-14992613 ] Yongjun Zhang commented on HDFS-9377: - Thanks [~liuml07]. I will commit it momentarily. > Fix

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9079: Attachment: HDFS-9079.08.patch The new patch fixed a few bugs: # DN failures can happen in 2 cases: i) while

[jira] [Resolved] (HDFS-2881) org.apache.hadoop.hdfs.TestDatanodeBlockScanner Fails Intermittently

[ https://issues.apache.org/jira/browse/HDFS-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-2881. Resolution: Not A Problem Closing this jira. Likely already fixed. >

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992636#comment-14992636 ] Hudson commented on HDFS-9282: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #643 (See

[jira] [Commented] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992742#comment-14992742 ] Hadoop QA commented on HDFS-9384: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992575#comment-14992575 ] Hadoop QA commented on HDFS-9117: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992606#comment-14992606 ] Mingliang Liu commented on HDFS-9377: - The failing tests are not related. > Fix findbugs warnings in

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992484#comment-14992484 ] Hadoop QA commented on HDFS-9377: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992486#comment-14992486 ] Haohui Mai commented on HDFS-9328: -- It's better to have the file in markdown format, preferably naming it

  1   2   >