[jira] [Created] (HDFS-2128) Support for pluggable Trash policies

Support for pluggable Trash policies Key: HDFS-2128 URL: https://issues.apache.org/jira/browse/HDFS-2128 Project: Hadoop HDFS Issue Type: Improvement Reporter: dhruba borthakur

[jira] [Created] (HDFS-2006) ability to support storing extended attributes per file

ability to support storing extended attributes per file --- Key: HDFS-2006 URL: https://issues.apache.org/jira/browse/HDFS-2006 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-1392) Improve namenode scalability by prioritizing datanode heartbeats over block reports

[ https://issues.apache.org/jira/browse/HDFS-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1392. Resolution: Duplicate duplicate of HDFS-1541 Improve namenode scalability by prioritizing

[jira] [Created] (HDFS-1783) Ability for HDFS client to write replicas in parallel

Ability for HDFS client to write replicas in parallel - Key: HDFS-1783 URL: https://issues.apache.org/jira/browse/HDFS-1783 Project: Hadoop HDFS Issue Type: Improvement

[jira] Created: (HDFS-1605) Convert DFSInputStream synchronized sections to a ReadWrite lock

Convert DFSInputStream synchronized sections to a ReadWrite lock Key: HDFS-1605 URL: https://issues.apache.org/jira/browse/HDFS-1605 Project: Hadoop HDFS Issue Type:

[jira] Created: (HDFS-1593) Allow a datanode to copy a block to a datanode on a foreign HDFS cluster.

Allow a datanode to copy a block to a datanode on a foreign HDFS cluster. - Key: HDFS-1593 URL: https://issues.apache.org/jira/browse/HDFS-1593 Project: Hadoop HDFS

[jira] Created: (HDFS-1581) Metrics from DFSClient

Metrics from DFSClient -- Key: HDFS-1581 URL: https://issues.apache.org/jira/browse/HDFS-1581 Project: Hadoop HDFS Issue Type: Improvement Components: hdfs client Reporter: dhruba borthakur We

[jira] Created: (HDFS-1567) DFSClient should retry reading from all datanodes in round robin fashion

DFSClient should retry reading from all datanodes in round robin fashion Key: HDFS-1567 URL: https://issues.apache.org/jira/browse/HDFS-1567 Project: Hadoop HDFS Issue

[jira] Created: (HDFS-1540) Make Datanode handle errors to namenode.register call more elegantly

Make Datanode handle errors to namenode.register call more elegantly Key: HDFS-1540 URL: https://issues.apache.org/jira/browse/HDFS-1540 Project: Hadoop HDFS Issue Type:

[jira] Resolved: (HDFS-1162) Reduce the time required for a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1162. Resolution: Won't Fix This has been fixed via various changes to the fsimage/edits file

[jira] Created: (HDFS-1508) Ability to do savenamespace without being in safemode

Ability to do savenamespace without being in safemode - Key: HDFS-1508 URL: https://issues.apache.org/jira/browse/HDFS-1508 Project: Hadoop HDFS Issue Type: Improvement

[jira] Created: (HDFS-1509) Resync discarded directories in fs.name.dir during saveNamespace command

Resync discarded directories in fs.name.dir during saveNamespace command Key: HDFS-1509 URL: https://issues.apache.org/jira/browse/HDFS-1509 Project: Hadoop HDFS Issue

[jira] Created: (HDFS-1501) The logic that makes namenode exit safemode should be pluggable

The logic that makes namenode exit safemode should be pluggable --- Key: HDFS-1501 URL: https://issues.apache.org/jira/browse/HDFS-1501 Project: Hadoop HDFS Issue Type: Improvement

[jira] Created: (HDFS-1438) Expose getCorruptFiles APi via the FileSystem API

Expose getCorruptFiles APi via the FileSystem API - Key: HDFS-1438 URL: https://issues.apache.org/jira/browse/HDFS-1438 Project: Hadoop HDFS Issue Type: Improvement Components: hdfs

[jira] Created: (HDFS-1432) HDFS across data centers: HighTide

HDFS across data centers: HighTide -- Key: HDFS-1432 URL: https://issues.apache.org/jira/browse/HDFS-1432 Project: Hadoop HDFS Issue Type: Improvement Reporter: dhruba borthakur

[jira] Resolved: (HDFS-1147) Reduce NN startup time by reducing the processing time of block reports

[ https://issues.apache.org/jira/browse/HDFS-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1147. Resolution: Duplicate Reduce NN startup time by reducing the processing time of block

[jira] Resolved: (HDFS-1393) When a directory with huge number of files is deleted, the NN becomes unresponsive

[ https://issues.apache.org/jira/browse/HDFS-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1393. Resolution: Duplicate duplicate of HDFS-1143 When a directory with huge number of files

[jira] Created: (HDFS-1393) When a directory with huge number of files is deleted, the NN becomes unresponsive

When a directory with huge number of files is deleted, the NN becomes unresponsive -- Key: HDFS-1393 URL: https://issues.apache.org/jira/browse/HDFS-1393 Project: Hadoop

[jira] Resolved: (HDFS-1384) NameNode should give client the first node in the pipeline from different rack other than that of excludedNodes list in the same rack.

[ https://issues.apache.org/jira/browse/HDFS-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1384. Resolution: Duplicate This bug has been fixed in trunk because the client sends the

[jira] Created: (HDFS-1391) Exiting safemode takes a long time when there are lots of blocks in the HDFS

Exiting safemode takes a long time when there are lots of blocks in the HDFS Key: HDFS-1391 URL: https://issues.apache.org/jira/browse/HDFS-1391 Project: Hadoop HDFS

[jira] Created: (HDFS-1392) Improve namenode scalability by prioritizing datanode heartbeats over block reports

Improve namenode scalability by prioritizing datanode heartbeats over block reports --- Key: HDFS-1392 URL: https://issues.apache.org/jira/browse/HDFS-1392 Project:

[jira] Created: (HDFS-1366) reduce namenode startup time by optimising checkBlockInfo while loading fsimage

reduce namenode startup time by optimising checkBlockInfo while loading fsimage - Key: HDFS-1366 URL: https://issues.apache.org/jira/browse/HDFS-1366 Project: Hadoop

[jira] Created: (HDFS-1274) ability to send replication traffic on a separate port to the Datanode

ability to send replication traffic on a separate port to the Datanode -- Key: HDFS-1274 URL: https://issues.apache.org/jira/browse/HDFS-1274 Project: Hadoop HDFS Issue

[jira] Resolved: (HDFS-81) Impact in NameNode scalability because heartbeat processing acquires the global lock

[ https://issues.apache.org/jira/browse/HDFS-81?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-81. -- Resolution: Won't Fix This problem occurs only in old releases and is not present in trunk.

[jira] Resolved: (HDFS-1254) 0.20: mark dfs.supprt.append to be true by default for the 0.20-append branch

[ https://issues.apache.org/jira/browse/HDFS-1254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1254. Hadoop Flags: [Reviewed] Resolution: Fixed I just committed this. 0.20: mark

[jira] Resolved: (HDFS-1216) Update to JUnit 4 in branch 20 append

[ https://issues.apache.org/jira/browse/HDFS-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1216. Resolution: Fixed I just committed this. Thanks Todd! Update to JUnit 4 in branch 20

[jira] Resolved: (HDFS-142) In 0.20, move blocks being written into a blocksBeingWritten directory

[ https://issues.apache.org/jira/browse/HDFS-142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-142. --- Resolution: Fixed I have committed this. Thanks Sam, Nicolas and Todd. In 0.20, move blocks

[jira] Resolved: (HDFS-1141) completeFile does not check lease ownership

[ https://issues.apache.org/jira/browse/HDFS-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1141. Resolution: Fixed Pulled into hadoop-0.20-append completeFile does not check lease

[jira] Resolved: (HDFS-1207) 0.20-append: stallReplicationWork should be volatile

[ https://issues.apache.org/jira/browse/HDFS-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1207. Fix Version/s: 0.20-append Resolution: Fixed I just committed this. Thanks Todd!

[jira] Resolved: (HDFS-1210) DFSClient should log exception when block recovery fails

[ https://issues.apache.org/jira/browse/HDFS-1210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1210. Fix Version/s: 0.20-append Resolution: Fixed I just committed this. Thanks Todd.

[jira] Resolved: (HDFS-1211) 0.20 append: Block receiver should not log rewind packets at INFO level

[ https://issues.apache.org/jira/browse/HDFS-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1211. Resolution: Fixed I just committed this. Thanks Todd! 0.20 append: Block receiver should

[jira] Resolved: (HDFS-1054) Remove unnecessary sleep after failure in nextBlockOutputStream

[ https://issues.apache.org/jira/browse/HDFS-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-1054. Fix Version/s: 0.21.0 (was: 0.20-append) Resolution: Fixed I

[jira] Created: (HDFS-1200) The namenode could remember the last good location of a missing block

The namenode could remember the last good location of a missing block - Key: HDFS-1200 URL: https://issues.apache.org/jira/browse/HDFS-1200 Project: Hadoop HDFS Issue Type:

[jira] Created: (HDFS-1179) Implement a file change log

Implement a file change log --- Key: HDFS-1179 URL: https://issues.apache.org/jira/browse/HDFS-1179 Project: Hadoop HDFS Issue Type: Improvement Components: name-node Reporter: dhruba borthakur

[jira] Created: (HDFS-1162) Reduce the time required for a checkpoint

Reduce the time required for a checkpoint - Key: HDFS-1162 URL: https://issues.apache.org/jira/browse/HDFS-1162 Project: Hadoop HDFS Issue Type: Improvement Components: name-node

[jira] Created: (HDFS-1129) Allow HDFS DataNodes and NameNode to have different build versions

Allow HDFS DataNodes and NameNode to have different build versions -- Key: HDFS-1129 URL: https://issues.apache.org/jira/browse/HDFS-1129 Project: Hadoop HDFS Issue Type:

[jira] Created: (HDFS-1108) ability to create a file whose newly allocated blocks are automatically persisted immediately

ability to create a file whose newly allocated blocks are automatically persisted immediately - Key: HDFS-1108 URL: https://issues.apache.org/jira/browse/HDFS-1108

[jira] Resolved: (HDFS-983) NameNode transaction log corruption with bad filename

[ https://issues.apache.org/jira/browse/HDFS-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-983. --- Resolution: Duplicate I have not seen this problem after we imported the patch from

[jira] Created: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

Intelligent block placement policy to decrease probability of block loss Key: HDFS-1094 URL: https://issues.apache.org/jira/browse/HDFS-1094 Project: Hadoop HDFS Issue

[jira] Created: (HDFS-1093) Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock

Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lock Key: HDFS-1093 URL:

[jira] Created: (HDFS-1071) savenamespace should write the fsimage to all configured fs.name.dir in parallel

savenamespace should write the fsimage to all configured fs.name.dir in parallel Key: HDFS-1071 URL: https://issues.apache.org/jira/browse/HDFS-1071 Project: Hadoop HDFS

[jira] Created: (HDFS-988) saveNamespace can corrupt edits log

saveNamespace can corrupt edits log --- Key: HDFS-988 URL: https://issues.apache.org/jira/browse/HDFS-988 Project: Hadoop HDFS Issue Type: Bug Components: name-node Reporter: dhruba

[jira] Created: (HDFS-978) Record every new block allocation of a file into the transaction log.

Record every new block allocation of a file into the transaction log. - Key: HDFS-978 URL: https://issues.apache.org/jira/browse/HDFS-978 Project: Hadoop HDFS Issue Type:

[jira] Created: (HDFS-966) NameNode recovers lease even in safemode

NameNode recovers lease even in safemode Key: HDFS-966 URL: https://issues.apache.org/jira/browse/HDFS-966 Project: Hadoop HDFS Issue Type: Bug Components: name-node Reporter:

[jira] Created: (HDFS-947) The namenode should redirect a hftp request to read a file to the datanode that has the maximum number of local replicas

The namenode should redirect a hftp request to read a file to the datanode that has the maximum number of local replicas Key: HDFS-947 URL:

[jira] Created: (HDFS-895) Allow hflush/sync to occur in parallel with new writes to the file

Allow hflush/sync to occur in parallel with new writes to the file -- Key: HDFS-895 URL: https://issues.apache.org/jira/browse/HDFS-895 Project: Hadoop HDFS Issue Type:

[jira] Resolved: (HDFS-769) test-c++-libhdfs constantly fails

[ https://issues.apache.org/jira/browse/HDFS-769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-769. --- Resolution: Duplicate duplicate of HDFS-756 test-c++-libhdfs constantly fails

[jira] Resolved: (HDFS-503) Implement erasure coding as a layer on HDFS

[ https://issues.apache.org/jira/browse/HDFS-503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HDFS-503. --- Resolution: Fixed I will fix the unit-test failure via HDFS-757. The unit tests failed when

[jira] Created: (HDFS-751) TestCrcCorruption succeeds but is not testing anything of value

TestCrcCorruption succeeds but is not testing anything of value --- Key: HDFS-751 URL: https://issues.apache.org/jira/browse/HDFS-751 Project: Hadoop HDFS Issue Type: Bug

[jira] Created: (HDFS-729) fsck option to list only corrupted files

fsck option to list only corrupted files Key: HDFS-729 URL: https://issues.apache.org/jira/browse/HDFS-729 Project: Hadoop HDFS Issue Type: Improvement Reporter: dhruba borthakur

[jira] Created: (HDFS-695) RaidNode should red in configuration from hdfs-site.xml

RaidNode should red in configuration from hdfs-site.xml --- Key: HDFS-695 URL: https://issues.apache.org/jira/browse/HDFS-695 Project: Hadoop HDFS Issue Type: Bug Components:

[jira] Created: (HDFS-684) Use HAR filesystem to merge parity files

Use HAR filesystem to merge parity files - Key: HDFS-684 URL: https://issues.apache.org/jira/browse/HDFS-684 Project: Hadoop HDFS Issue Type: Improvement Components: contrib/raid