[jira] [Commented] (HDFS-8967) Create a BlockManagerLock class to represent the lock used in the BlockManager

[ https://issues.apache.org/jira/browse/HDFS-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14725796#comment-14725796 ] Hadoop QA commented on HDFS-8967: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9000) Allow reconfiguration without restart for parameters where applicable.

[ https://issues.apache.org/jira/browse/HDFS-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9000: Description: Many parameters can be re-configured without requiring a restart. > Allow

[jira] [Updated] (HDFS-7831) Fix the starting index and end condition of the loop in FileDiffList.findEarlierSnapshotBlocks()

[ https://issues.apache.org/jira/browse/HDFS-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7831: -- Labels: 2.6.1-candidate (was: ) Re-adding 2.6.1-candidate label for tracking.

[jira] [Commented] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14725709#comment-14725709 ] Jitendra Nath Pandey commented on HDFS-8763: [~jingzhao] raised a very valid point that when

[jira] [Updated] (HDFS-8981) Adding revision to data node jmx getVersion() method

[ https://issues.apache.org/jira/browse/HDFS-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-8981: -- Attachment: HDFS-8981.v2.patch > Adding revision to data node jmx getVersion() method >

[jira] [Updated] (HDFS-8967) Create a BlockManagerLock class to represent the lock used in the BlockManager

[ https://issues.apache.org/jira/browse/HDFS-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8967: - Attachment: HDFS-8967.002.patch > Create a BlockManagerLock class to represent the lock used in the

[jira] [Updated] (HDFS-9000) Allow reconfiguration without restart for parameters where applicable.

[ https://issues.apache.org/jira/browse/HDFS-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9000: Affects Version/s: 2.7.0 > Allow reconfiguration without restart for parameters where applicable. >

[jira] [Commented] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14725833#comment-14725833 ] Kihwal Lee commented on HDFS-8995: -- Reran the failed test cases. They pass. {noformat}

[jira] [Updated] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7763: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1. I just pushed the

[jira] [Created] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

Jitendra Nath Pandey created HDFS-8999: -- Summary: Namenode need not wait for {{blockReceived}} for the last block before completing a file. Key: HDFS-8999 URL: https://issues.apache.org/jira/browse/HDFS-8999

[jira] [Commented] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14725725#comment-14725725 ] Jitendra Nath Pandey commented on HDFS-8763: Created HDFS-8999 to discuss the points raised by

[jira] [Created] (HDFS-9000) Allow reconfiguration without restart for parameters where applicable.

Xiaobing Zhou created HDFS-9000: --- Summary: Allow reconfiguration without restart for parameters where applicable. Key: HDFS-9000 URL: https://issues.apache.org/jira/browse/HDFS-9000 Project: Hadoop

[jira] [Updated] (HDFS-7009) Active NN and standby NN have different live nodes

[ https://issues.apache.org/jira/browse/HDFS-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7009: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1. I just pushed the

[jira] [Resolved] (HDFS-9000) Allow reconfiguration without restart for parameters where applicable.

[ https://issues.apache.org/jira/browse/HDFS-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-9000. Resolution: Duplicate Duplicate of HDFS-1477 and HDFS-7106 > Allow reconfiguration

[jira] [Commented] (HDFS-8967) Create a BlockManagerLock class to represent the lock used in the BlockManager

[ https://issues.apache.org/jira/browse/HDFS-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14725790#comment-14725790 ] Daryn Sharp commented on HDFS-8967: --- While I can't see anything in the patch that would cause it, I find

[jira] [Commented] (HDFS-8967) Create a BlockManagerLock class to represent the lock used in the BlockManager

[ https://issues.apache.org/jira/browse/HDFS-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14725817#comment-14725817 ] Haohui Mai commented on HDFS-8967: -- Kicking the jenkins again. > Create a BlockManagerLock class to

[jira] [Updated] (HDFS-8977) NNBench result wrong when number of reducers greater than 1

[ https://issues.apache.org/jira/browse/HDFS-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated HDFS-8977: --- Status: Patch Available (was: Open) > NNBench result wrong when number of reducers greater

[jira] [Updated] (HDFS-8701) WebHDFS write commands fail when running multiple DataNodes on one machine

[ https://issues.apache.org/jira/browse/HDFS-8701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8701: --- Assignee: (was: Jagadesh Kiran N) > WebHDFS write commands fail when running multiple

[jira] [Commented] (HDFS-8937) Fix the exception when set replication to Erasure Coding files

[ https://issues.apache.org/jira/browse/HDFS-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724874#comment-14724874 ] Hadoop QA commented on HDFS-8937: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8477) ZKFC port config key can be described in hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724884#comment-14724884 ] kanaka kumar avvaru commented on HDFS-8477: --- Test failure in the build doesn't seems to be

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724911#comment-14724911 ] Kai Zheng commented on HDFS-8833: - It's great to be here! When this is updated, our side would give it a

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724891#comment-14724891 ] kanaka kumar avvaru commented on HDFS-6955: --- Test failure looks not related to the changes done

[jira] [Commented] (HDFS-7786) Handle slow writers for DFSStripedOutputStream

[ https://issues.apache.org/jira/browse/HDFS-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724894#comment-14724894 ] Keisuke Ogiwara commented on HDFS-7786: --- Hi Li Bo, I have two questions. 1. Slow streamer is caused

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724907#comment-14724907 ] Zhe Zhang commented on HDFS-8833: - Thanks Jing for the comment and suggestions! Very good points on

[jira] [Commented] (HDFS-8989) Allow rate-limiting the DirectoryScanner via time-slicing

[ https://issues.apache.org/jira/browse/HDFS-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726434#comment-14726434 ] Andrew Wang commented on HDFS-8989: --- This looks like a dupe of HDFS-8873 which has more watchers; want to

[jira] [Updated] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7587: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1. I just pushed the

[jira] [Updated] (HDFS-8923) Add -source flag to balancer usage message

[ https://issues.apache.org/jira/browse/HDFS-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8923: --- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-8825) > Add -source flag to balancer

[jira] [Updated] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8763: Status: Open (was: Patch Available) > After file closed, a race condition between IBR of 3rd replica of

[jira] [Commented] (HDFS-9003) ForkJoin thread pool leaks

[ https://issues.apache.org/jira/browse/HDFS-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726492#comment-14726492 ] Yi Liu commented on HDFS-9003: -- +1 > ForkJoin thread pool leaks > -- > >

[jira] [Updated] (HDFS-7884) NullPointerException in BlockSender

[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7884: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1. I just pushed the

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7960: -- Attachment: HDFS-7960-branch-2.6.1.txt Attaching the 2.6.1 patch that I

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726648#comment-14726648 ] Tsz Wo Nicholas Sze commented on HDFS-8383: --- Sound good. Thanks a lot for working on this! >

[jira] [Commented] (HDFS-8899) Erasure Coding: use threadpool for EC recovery tasks

[ https://issues.apache.org/jira/browse/HDFS-8899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726678#comment-14726678 ] Rakesh R commented on HDFS-8899: Rebased patch in latest HDFS-7285 branch. Kindly review! > Erasure

[jira] [Commented] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726686#comment-14726686 ] Hudson commented on HDFS-8995: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1066 (See

[jira] [Updated] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7926: -- Labels: 2.6.1-candidate (was: ) Adding back 2.6.1-candidate label for tracking

[jira] [Commented] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios

[ https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726502#comment-14726502 ] Chris Trezzo commented on HDFS-8874: After talking with [~mingma], I am going to file another JIRA that

[jira] [Commented] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726602#comment-14726602 ] Hudson commented on HDFS-8995: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2280 (See

[jira] [Created] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

Ming Ma created HDFS-9007: - Summary: Fix HDFS Balancer to honor upgrade domain policy Key: HDFS-9007 URL: https://issues.apache.org/jira/browse/HDFS-9007 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-7871) NameNodeEditLogRoller can keep printing "Swallowing exception" message

[ https://issues.apache.org/jira/browse/HDFS-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7871: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1, the patch applies

[jira] [Commented] (HDFS-8967) Create a BlockManagerLock class to represent the lock used in the BlockManager

[ https://issues.apache.org/jira/browse/HDFS-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726235#comment-14726235 ] Hadoop QA commented on HDFS-8967: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8981) Adding revision to data node jmx getVersion() method

[ https://issues.apache.org/jira/browse/HDFS-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726252#comment-14726252 ] Hadoop QA commented on HDFS-8981: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726300#comment-14726300 ] Jing Zhao commented on HDFS-8999: - bq. if we are going to trust the client, do we even need IBRs? Yeah, I

[jira] [Updated] (HDFS-7885) Datanode should not trust the generation stamp provided by client

[ https://issues.apache.org/jira/browse/HDFS-7885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7885: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1, the patch applies

[jira] [Commented] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726562#comment-14726562 ] Hudson commented on HDFS-8995: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #339 (See

[jira] [Commented] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726683#comment-14726683 ] Hudson commented on HDFS-8995: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #331 (See

[jira] [Updated] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8833: Attachment: HDFS-8833-HDFS-7285.04.patch Thanks Rakesh for the comment! Actually we are all in sync w.r.t

Re: [jira] [Commented] (HDFS-8989) Allow rate-limiting the DirectoryScanner via time-slicing

Remove me from this list. Thanks, ~Kumar Sent from my iPhone > On Sep 1, 2015, at 4:45 PM, Andrew Wang (JIRA) wrote: > > >[ > https://issues.apache.org/jira/browse/HDFS-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726434#comment-14726434

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726445#comment-14726445 ] Konstantin Shvachko commented on HDFS-8999: --- The current logic as I remember it when it was

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726465#comment-14726465 ] Colin Patrick McCabe commented on HDFS-8940: Thanks for the explanation, [~mingma]. It's

[jira] [Updated] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8763: Attachment: HDFS-8763.02.patch bq. We occasionally see the same issue, but not frequent enough to be a

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726597#comment-14726597 ] Ming Ma commented on HDFS-8940: --- Thanks [~cmccabe]! bq. It seems like the ZK-based design is only useful for

[jira] [Updated] (HDFS-7742) favoring decommissioning node for replication can cause a block to stay underreplicated for long periods

[ https://issues.apache.org/jira/browse/HDFS-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7742: -- Target Version/s: 2.7.0, 3.0.0 (was: 3.0.0, 2.7.0) Fix Version/s: 2.6.1

[jira] [Updated] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8941: --- Component/s: hdfs-client > DistributedFileSystem listCorruptFileBlocks API should resolve relative path >

[jira] [Commented] (HDFS-8923) Add -source flag to balancer usage message

[ https://issues.apache.org/jira/browse/HDFS-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726645#comment-14726645 ] Tsz Wo Nicholas Sze commented on HDFS-8923: --- BTW, thanks for working on this. It is a good

[jira] [Updated] (HDFS-8959) Provide an iterator-based API for listing all the snapshottable directories

[ https://issues.apache.org/jira/browse/HDFS-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8959: --- Component/s: hdfs-client > Provide an iterator-based API for listing all the snapshottable directories >

[jira] [Commented] (HDFS-8890) Allow admin to specify which blockpools the balancer should run on

[ https://issues.apache.org/jira/browse/HDFS-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726644#comment-14726644 ] Tsz Wo Nicholas Sze commented on HDFS-8890: --- We should also update

[jira] [Created] (HDFS-9005) Provide support for upgrade domain script

Ming Ma created HDFS-9005: - Summary: Provide support for upgrade domain script Key: HDFS-9005 URL: https://issues.apache.org/jira/browse/HDFS-9005 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726674#comment-14726674 ] jiangyu commented on HDFS-8763: --- Reading HDFS-8999, I think currently, slow down needReplications maybe the

[jira] [Updated] (HDFS-8890) Allow admin to specify which blockpools the balancer should run on

[ https://issues.apache.org/jira/browse/HDFS-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8890: --- Attachment: HDFS-8890-trunk-v3.patch [~mingma] V3 attached. # Fixed whitespace. # Ran TestBalancer

[jira] [Updated] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7929: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1, after making changes to

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726497#comment-14726497 ] Jing Zhao commented on HDFS-8287: - Thanks for working on this, Kai! I agree with Zhe's comments. Besides of

[jira] [Commented] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726541#comment-14726541 ] Hudson commented on HDFS-8995: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8383 (See

[jira] [Commented] (HDFS-8890) Allow admin to specify which blockpools the balancer should run on

[ https://issues.apache.org/jira/browse/HDFS-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726593#comment-14726593 ] Ming Ma commented on HDFS-8890: --- +1 pending jenkins run. Thanks [~ctrezzo]! Chris and I discussed if the

[jira] [Commented] (HDFS-8923) Add -source flag to balancer usage message

[ https://issues.apache.org/jira/browse/HDFS-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726640#comment-14726640 ] Tsz Wo Nicholas Sze commented on HDFS-8923: --- We should also update

[jira] [Commented] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726653#comment-14726653 ] jiangyu commented on HDFS-8763: --- Hi [~fernhtls] I don't think it is good idea to change the parameter for

[jira] [Created] (HDFS-9004) Add upgrade domain to DatanodeInfo

Ming Ma created HDFS-9004: - Summary: Add upgrade domain to DatanodeInfo Key: HDFS-9004 URL: https://issues.apache.org/jira/browse/HDFS-9004 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-8899) Erasure Coding: use threadpool for EC recovery tasks

[ https://issues.apache.org/jira/browse/HDFS-8899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8899: --- Attachment: HDFS-8899-HDFS-7285-01.patch > Erasure Coding: use threadpool for EC recovery tasks >

[jira] [Updated] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8999: Description: This comes out of a discussion in HDFS-8763. Pasting [~jingzhao]'s comment from the

[jira] [Updated] (HDFS-7930) commitBlockSynchronization() does not remove locations

[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7930: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1. I just pushed the

[jira] [Commented] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726485#comment-14726485 ] Yi Liu commented on HDFS-8995: -- +1, thanks Kihwal. Will commit it shortly. > Flaw in registration bookeeping

[jira] [Updated] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8995: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.2 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-9003) ForkJoin thread pool leaks

[ https://issues.apache.org/jira/browse/HDFS-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9003: - Assignee: Kihwal Lee > ForkJoin thread pool leaks > -- > > Key: HDFS-9003

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7960: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1, after fixing merge

[jira] [Updated] (HDFS-8937) Fix the exception when set replication to Erasure Coding files

[ https://issues.apache.org/jira/browse/HDFS-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-8937: -- Attachment: HDFS-8937-HDFS-7285.01.patch [~jingzhao] Thank you very much for your advise. New patch has been

[jira] [Created] (HDFS-9006) Provide BlockPlacementPolicy that supports upgrade domain

Ming Ma created HDFS-9006: - Summary: Provide BlockPlacementPolicy that supports upgrade domain Key: HDFS-9006 URL: https://issues.apache.org/jira/browse/HDFS-9006 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7999: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1, after fixing some

[jira] [Updated] (HDFS-9002) Move o.a.h.hdfs.net/*Peer classes to client module

[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9002: Status: Patch Available (was: Open) > Move o.a.h.hdfs.net/*Peer classes to client module >

[jira] [Updated] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios

[ https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8874: --- Attachment: HDFS-8874-trunk-v2.patch [~mingma] V2 attached. There was some refactoring needed for

[jira] [Created] (HDFS-9001) DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster

Daniel Templeton created HDFS-9001: -- Summary: DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster Key: HDFS-9001 URL: https://issues.apache.org/jira/browse/HDFS-9001

[jira] [Created] (HDFS-9002) Move o.a.h.hdfs.net/*Peer to client module

Mingliang Liu created HDFS-9002: --- Summary: Move o.a.h.hdfs.net/*Peer to client module Key: HDFS-9002 URL: https://issues.apache.org/jira/browse/HDFS-9002 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9002) Move o.a.h.hdfs.net/*Peer classes to client module

[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726249#comment-14726249 ] Mingliang Liu commented on HDFS-9002: - The v0 patch moves the {{Peer}} sub-classes to the client

[jira] [Updated] (HDFS-9003) ForkJoin thread pool leaks

[ https://issues.apache.org/jira/browse/HDFS-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9003: - Attachment: HDFS-9003.patch > ForkJoin thread pool leaks > -- > >

[jira] [Updated] (HDFS-8981) Adding revision to data node jmx getVersion() method

[ https://issues.apache.org/jira/browse/HDFS-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-8981: -- Attachment: HDFS-8981.v2.patch > Adding revision to data node jmx getVersion() method >

[jira] [Commented] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726308#comment-14726308 ] Konstantin Shvachko commented on HDFS-8763: --- A different jira for a different topic makes sense.

[jira] [Created] (HDFS-9003) ForkJoin thread pool leaks

Kihwal Lee created HDFS-9003: Summary: ForkJoin thread pool leaks Key: HDFS-9003 URL: https://issues.apache.org/jira/browse/HDFS-9003 Project: Hadoop HDFS Issue Type: Bug Affects Versions:

[jira] [Comment Edited] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726332#comment-14726332 ] Vinod Kumar Vavilapalli edited comment on HDFS-7830 at 9/1/15 10:41 PM:

[jira] [Updated] (HDFS-7843) A truncated file is corrupted after rollback from a rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7843: -- Labels: 2.6.1 (was: ) Adding back 2.6.1-candidate label for tracking purposes.

[jira] [Commented] (HDFS-8937) Fix the exception when set replication to Erasure Coding files

[ https://issues.apache.org/jira/browse/HDFS-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726169#comment-14726169 ] Jing Zhao commented on HDFS-8937: - Thanks for working on this, [~demongaorui]! Here are the comments for

[jira] [Updated] (HDFS-9002) Move o.a.h.hdfs.net/*Peer classes to client module

[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9002: Summary: Move o.a.h.hdfs.net/*Peer classes to client module (was: Move o.a.h.hdfs.net/*Peer to

[jira] [Updated] (HDFS-9002) Move o.a.h.hdfs.net/*Peer to client module

[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9002: Attachment: HDFS-9002.000.patch > Move o.a.h.hdfs.net/*Peer to client module >

[jira] [Updated] (HDFS-8981) Adding revision to data node jmx getVersion() method

[ https://issues.apache.org/jira/browse/HDFS-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-8981: -- Attachment: (was: HDFS-8981.v2.patch) > Adding revision to data node jmx getVersion() method >

[jira] [Updated] (HDFS-9002) Move o.a.h.hdfs.net/*Peer classes to client module

[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9002: Description: This jira tracks the effort of moving the following two parts to

[jira] [Updated] (HDFS-9003) ForkJoin thread pool leaks

[ https://issues.apache.org/jira/browse/HDFS-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9003: - Status: Patch Available (was: Open) > ForkJoin thread pool leaks > -- > >

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726153#comment-14726153 ] Daryn Sharp commented on HDFS-8999: --- I'd be interested in your thoughts on: if we are going to trust the

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726293#comment-14726293 ] Bob Hansen commented on HDFS-8696: -- With the patched hdfs, we're still seeing slowdowns. For the 1-byte

[jira] [Updated] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7830: -- Target Version/s: 2.7.0, 3.0.0 (was: 3.0.0, 2.7.0) Fix Version/s: 2.6.1

[jira] [Updated] (HDFS-7610) Fix removal of dynamically added DN volumes

[ https://issues.apache.org/jira/browse/HDFS-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7610: -- Target Version/s: 2.7.0, 3.0.0 (was: 3.0.0, 2.7.0) Fix Version/s: 2.6.1

[jira] [Updated] (HDFS-8984) Move replication queues related methods in FSNamesystem to BlockManager

[ https://issues.apache.org/jira/browse/HDFS-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8984: - Attachment: HDFS-8984.002.patch > Move replication queues related methods in FSNamesystem to BlockManager

[jira] [Commented] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14726196#comment-14726196 ] Daryn Sharp commented on HDFS-8763: --- We occasionally see the same issue, but not frequent enough to be a

[jira] [Commented] (HDFS-8977) NNBench result wrong when number of reducers greater than 1

[ https://issues.apache.org/jira/browse/HDFS-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724968#comment-14724968 ] Hadoop QA commented on HDFS-8977: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

  1   2   >