[jira] Updated: (HDFS-589) Change block write protocol to support pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-589: --- Attachment: opWriteProtocol.patch This patch 1. changes the block write header to be blockId blockGS

[jira] Commented: (HDFS-603) Most replica related classes cannot be accessed

[ https://issues.apache.org/jira/browse/HDFS-603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12752932#action_12752932 ] Hairong Kuang commented on HDFS-603: Tthe two changes to ReplicasMap are necessary. For

[jira] Commented: (HDFS-605) There's not need to run fault-inject tests by 'run-test-hdfs-with-mr' target

[ https://issues.apache.org/jira/browse/HDFS-605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12752936#action_12752936 ] Hadoop QA commented on HDFS-605: +1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-235) Add support for byte-ranges to hftp

[ https://issues.apache.org/jira/browse/HDFS-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12752938#action_12752938 ] Hudson commented on HDFS-235: - Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #5 (See

[jira] Commented: (HDFS-288) Redundant computation in hashCode() implemenation

[ https://issues.apache.org/jira/browse/HDFS-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12752940#action_12752940 ] Hudson commented on HDFS-288: - Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #5 (See

[jira] Commented: (HDFS-578) Support for using server default values for blockSize and replication when creating a file

[ https://issues.apache.org/jira/browse/HDFS-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12752942#action_12752942 ] Hudson commented on HDFS-578: - Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #5 (See

[jira] Commented: (HDFS-412) Hadoop JMX usage makes Nagios monitoring impossible

[ https://issues.apache.org/jira/browse/HDFS-412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12752945#action_12752945 ] Hudson commented on HDFS-412: - Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #5 (See

[jira] Commented: (HDFS-550) DataNode restarts may introduce corrupt/duplicated/lost replicas when handling detached replicas

[ https://issues.apache.org/jira/browse/HDFS-550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753134#action_12753134 ] dhruba borthakur commented on HDFS-550: --- So the recovery adds duplicate replicas of

[jira] Commented: (HDFS-602) Atempt to make a directory under an existing file on DistributedFileSystem should throw an FileAlreadyExistsException instead of FileNotFoundException

[ https://issues.apache.org/jira/browse/HDFS-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753170#action_12753170 ] Boris Shkolnik commented on HDFS-602: - No test included because it is covered by

[jira] Commented: (HDFS-602) Atempt to make a directory under an existing file on DistributedFileSystem should throw an FileAlreadyExistsException instead of FileNotFoundException

[ https://issues.apache.org/jira/browse/HDFS-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753171#action_12753171 ] Jitendra Nath Pandey commented on HDFS-602: --- +1 look good. Atempt to make a

[jira] Commented: (HDFS-603) Most replica related classes cannot be accessed

[ https://issues.apache.org/jira/browse/HDFS-603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753177#action_12753177 ] Konstantin Boudnik commented on HDFS-603: - I will a sort of uneasiness when an input

[jira] Commented: (HDFS-603) Most replica related classes cannot be accessed

[ https://issues.apache.org/jira/browse/HDFS-603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753182#action_12753182 ] Tsz Wo (Nicholas), SZE commented on HDFS-603: - Tthe two changes to ReplicasMap

[jira] Updated: (HDFS-606) ConcurrentModificationException in invalidateCorruptReplicas()

[ https://issues.apache.org/jira/browse/HDFS-606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-606: - Status: Open (was: Patch Available) ConcurrentModificationException in

[jira] Updated: (HDFS-606) ConcurrentModificationException in invalidateCorruptReplicas()

[ https://issues.apache.org/jira/browse/HDFS-606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-606: - Status: Patch Available (was: Open) Resubmitting because none of the three tests fail on

[jira] Commented: (HDFS-550) DataNode restarts may introduce corrupt/duplicated/lost replicas when handling detached replicas

[ https://issues.apache.org/jira/browse/HDFS-550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753203#action_12753203 ] Hairong Kuang commented on HDFS-550: This is harmless because they will get deleted in

[jira] Commented: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753204#action_12753204 ] dhruba borthakur commented on HDFS-599: --- One issue I see with adding an extra port is

[jira] Commented: (HDFS-603) Most replica related classes cannot be accessed

[ https://issues.apache.org/jira/browse/HDFS-603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753205#action_12753205 ] Hairong Kuang commented on HDFS-603: +1. The patch looks good. Sorry for the confusion.

[jira] Commented: (HDFS-202) Add a bulk FIleSystem.getFileBlockLocations

[ https://issues.apache.org/jira/browse/HDFS-202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753215#action_12753215 ] Doug Cutting commented on HDFS-202: --- Is the optimization for sending only partial block

[jira] Commented: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753217#action_12753217 ] dhruba borthakur commented on HDFS-599: --- It is about an increment in number of gates

[jira] Commented: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753229#action_12753229 ] Doug Cutting commented on HDFS-599: --- A different port may be a good way to implement this.

[jira] Commented: (HDFS-607) HDFS should support SNMP

[ https://issues.apache.org/jira/browse/HDFS-607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753230#action_12753230 ] Allen Wittenauer commented on HDFS-607: --- For example, disk space usage could be trended

[jira] Created: (HDFS-607) HDFS should support SNMP

HDFS should support SNMP Key: HDFS-607 URL: https://issues.apache.org/jira/browse/HDFS-607 Project: Hadoop HDFS Issue Type: New Feature Reporter: Allen Wittenauer HDFS should provide key statistics

[jira] Commented: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753231#action_12753231 ] dhruba borthakur commented on HDFS-599: --- A different port may be a good way to

[jira] Commented: (HDFS-550) DataNode restarts may introduce corrupt/duplicated/lost replicas when handling detached replicas

[ https://issues.apache.org/jira/browse/HDFS-550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753233#action_12753233 ] dhruba borthakur commented on HDFS-550: --- The recovery code (at datanode restart time)

[jira] Commented: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753235#action_12753235 ] Philip Zeyliger commented on HDFS-599: -- In my experience, using different ports for QoS

[jira] Commented: (HDFS-550) DataNode restarts may introduce corrupt/duplicated/lost replicas when handling detached replicas

[ https://issues.apache.org/jira/browse/HDFS-550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753237#action_12753237 ] Hairong Kuang commented on HDFS-550: The recovery code (at datanode restart time) first

[jira] Updated: (HDFS-531) Renaming of configuration keys

[ https://issues.apache.org/jira/browse/HDFS-531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-531: -- Attachment: unchanged_keys.txt unchanged_keys.txt file contains the keys that are

[jira] Commented: (HDFS-606) ConcurrentModificationException in invalidateCorruptReplicas()

[ https://issues.apache.org/jira/browse/HDFS-606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753251#action_12753251 ] Hadoop QA commented on HDFS-606: -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-235) Add support for byte-ranges to hftp

[ https://issues.apache.org/jira/browse/HDFS-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753268#action_12753268 ] Tsz Wo (Nicholas), SZE commented on HDFS-235: - The committed patch has quite a

[jira] Updated: (HDFS-604) Block report processing for append

[ https://issues.apache.org/jira/browse/HDFS-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-604: - Attachment: BlockReportNN.patch Sorry wrong version of the patch. Block report

[jira] Commented: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753312#action_12753312 ] Allen Wittenauer commented on HDFS-599: --- Hong, you can still implement queue based

[jira] Updated: (HDFS-608) BlockReceiver:receivePacket(): packet's header parsing logic is complicated. Refactoring will help w/ testing efforts

[ https://issues.apache.org/jira/browse/HDFS-608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-608: Attachment: HDFS-608.patch The patch provides the fix for the first step of the refactoring

[jira] Updated: (HDFS-585) Datanode should serve up to visible length of a replica for read requests

[ https://issues.apache.org/jira/browse/HDFS-585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-585: Attachment: h585_20090909b.patch h585_20090909b.patch: increased the waiting time to

[jira] Commented: (HDFS-503) Implement erasure coding as a layer on HDFS

[ https://issues.apache.org/jira/browse/HDFS-503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753349#action_12753349 ] Raghu Angadi commented on HDFS-503: --- This seems pretty useful. since this is done outside

[jira] Assigned: (HDFS-608) BlockReceiver:receivePacket(): packet's header parsing logic is complicated. Refactoring will help w/ testing efforts

[ https://issues.apache.org/jira/browse/HDFS-608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik reassigned HDFS-608: --- Assignee: Konstantin Boudnik BlockReceiver:receivePacket(): packet's header parsing

[jira] Commented: (HDFS-608) BlockReceiver:receivePacket(): packet's header parsing logic is complicated. Refactoring will help w/ testing efforts

[ https://issues.apache.org/jira/browse/HDFS-608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753357#action_12753357 ] Konstantin Boudnik commented on HDFS-608: - After conversing with Konstantin and Raghu

[jira] Updated: (HDFS-601) TestBlockReport should obtain data directories from MiniHDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-601: Status: Open (was: Patch Available) Need to re-apply the patch TestBlockReport should

[jira] Updated: (HDFS-601) TestBlockReport should obtain data directories from MiniHDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-601: Status: Patch Available (was: Open) The patch is already attached (for the trunk)

[jira] Commented: (HDFS-606) ConcurrentModificationException in invalidateCorruptReplicas()

[ https://issues.apache.org/jira/browse/HDFS-606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753374#action_12753374 ] Jakob Homan commented on HDFS-606: -- +1. Looks good. ConcurrentModificationException in

[jira] Commented: (HDFS-601) TestBlockReport should obtain data directories from MiniHDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753410#action_12753410 ] Hadoop QA commented on HDFS-601: -1 overall. Here are the results of testing the latest

[jira] Created: (HDFS-610) Add support for FileContext

Add support for FileContext --- Key: HDFS-610 URL: https://issues.apache.org/jira/browse/HDFS-610 Project: Hadoop HDFS Issue Type: New Feature Components: hdfs client, name-node Affects Versions: 0.21.0