[jira] [Updated] (HDFS-3296) Running libhdfs tests in mac fails

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3296: --- Labels: BB2015-05-TBR (was: ) Running libhdfs tests in mac fails

[jira] [Updated] (HDFS-7527) TestDecommission.testIncludeByRegistrationName fails occassionally in trunk

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7527: --- Labels: BB2015-05-TBR (was: ) TestDecommission.testIncludeByRegistrationName fails

[jira] [Updated] (HDFS-7433) Optimize performance of DatanodeManager's node map

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7433: --- Labels: BB2015-05-TBR (was: ) Optimize performance of DatanodeManager's node map

[jira] [Updated] (HDFS-7142) Implement a 2Q eviction strategy for HDFS-6581

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7142: --- Labels: BB2015-05-TBR (was: ) Implement a 2Q eviction strategy for HDFS-6581

[jira] [Updated] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7991: --- Labels: BB2015-05-TBR (was: ) Allow users to skip checkpoint when stopping NameNode

[jira] [Updated] (HDFS-7759) Provide existence-of-a-second-file implementation for pinning blocks on Datanode

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7759: --- Labels: BB2015-05-TBR (was: ) Provide existence-of-a-second-file implementation for pinning

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6481: --- Labels: BB2015-05-TBR (was: ) DatanodeManager#getDatanodeStorageInfos() should check the

[jira] [Updated] (HDFS-8115) Make PermissionStatusFormat public

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8115: --- Labels: BB2015-05-TBR (was: ) Make PermissionStatusFormat public

[jira] [Updated] (HDFS-6054) MiniQJMHACluster should not use static port to avoid binding failure in unit test

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6054: --- Labels: BB2015-05-TBR (was: ) MiniQJMHACluster should not use static port to avoid binding

[jira] [Updated] (HDFS-7998) HDFS Federation : Command mentioned to add a NN to existing federated cluster is wrong

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7998: --- Labels: BB2015-05-TBR (was: ) HDFS Federation : Command mentioned to add a NN to existing

[jira] [Updated] (HDFS-7792) Add links to FaultInjectFramework and SLGUserGuide to site index

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7792: --- Labels: BB2015-05-TBR (was: ) Add links to FaultInjectFramework and SLGUserGuide to site

[jira] [Updated] (HDFS-4383) Document the lease limits

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4383: --- Labels: BB2015-05-TBR (was: ) Document the lease limits -

[jira] [Updated] (HDFS-7529) Consolidate encryption zone related implementation into a single class

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7529: --- Labels: BB2015-05-TBR (was: ) Consolidate encryption zone related implementation into a

[jira] [Updated] (HDFS-4101) ZKFC should implement zookeeper.recovery.retry like HBase to connect to ZooKeeper

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4101: --- Labels: BB2015-05-TBR newbie (was: newbie) ZKFC should implement zookeeper.recovery.retry

[jira] [Updated] (HDFS-7304) TestFileCreation#testOverwriteOpenForWrite hangs

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7304: --- Labels: BB2015-05-TBR (was: ) TestFileCreation#testOverwriteOpenForWrite hangs

[jira] [Updated] (HDFS-7265) Use a throttler for replica write in datanode

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7265: --- Labels: BB2015-05-TBR (was: ) Use a throttler for replica write in datanode

[jira] [Updated] (HDFS-6633) Support reading new data in a being written file until the file is closed

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6633: --- Labels: BB2015-05-TBR (was: ) Support reading new data in a being written file until the

[jira] [Updated] (HDFS-7214) Display the time when NN became active on the webUI

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7214: --- Labels: BB2015-05-TBR (was: ) Display the time when NN became active on the webUI

[jira] [Updated] (HDFS-5952) Create a tool to run data analysis on the PB format fsimage

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5952: --- Labels: BB2015-05-TBR (was: ) Create a tool to run data analysis on the PB format fsimage

[jira] [Updated] (HDFS-7264) Tha last datanode in a pipeline should send a heartbeat when there is no traffic

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7264: --- Labels: BB2015-05-TBR (was: ) Tha last datanode in a pipeline should send a heartbeat when

[jira] [Updated] (HDFS-7174) Support for more efficient large directories

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7174: --- Labels: BB2015-05-TBR (was: ) Support for more efficient large directories

[jira] [Updated] (HDFS-3892) Few static methods of MiniDFSCluster class incorrectly assume that it is a singleton

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3892: --- Labels: BB2015-05-TBR (was: ) Few static methods of MiniDFSCluster class incorrectly assume

[jira] [Updated] (HDFS-3059) ssl-server.xml causes NullPointer

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3059: --- Labels: BB2015-05-TBR (was: ) ssl-server.xml causes NullPointer

[jira] [Updated] (HDFS-4237) Add unit tests for HTTP-based filesystems against secure MiniDFSCluster

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4237: --- Labels: BB2015-05-TBR (was: ) Add unit tests for HTTP-based filesystems against secure

[jira] [Updated] (HDFS-6660) Use int instead of object reference to DatanodeStorageInfo in BlockInfo triplets,

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6660: --- Labels: BB2015-05-TBR performance (was: performance) Use int instead of object reference to

[jira] [Updated] (HDFS-6914) Resolve huge memory consumption Issue with OIV processing PB-based fsimages

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6914: --- Labels: BB2015-05-TBR hdfs (was: hdfs) Resolve huge memory consumption Issue with OIV

[jira] [Updated] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4045: --- Labels: BB2015-05-TBR (was: ) SecondaryNameNode cannot read from QuorumJournal URI

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529866#comment-14529866 ] Zhe Zhang commented on HDFS-7859: - Cool! I just registered. Thanks for organizing it Allen.

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529532#comment-14529532 ] Zhe Zhang commented on HDFS-7348: - Thanks Yi for the update! The patch LGTM. The only

[jira] [Commented] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2015-05-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529737#comment-14529737 ] Tsz Wo Nicholas Sze commented on HDFS-7980: --- The patch could not be applied.

[jira] [Comment Edited] (HDFS-8203) Erasure Coding: Seek and other Ops in DFSStripedInputStream.

2015-05-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529735#comment-14529735 ] Yi Liu edited comment on HDFS-8203 at 5/6/15 1:47 AM: -- Update the

[jira] [Updated] (HDFS-1787) Not enough xcievers error should propagate to client

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1787: --- Labels: BB2015-05-TBR newbie (was: newbie) Not enough xcievers error should propagate to

[jira] [Updated] (HDFS-6515) testPageRounder (org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache)

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6515: --- Labels: BB2015-05-TBR hadoop test (was: hadoop test) testPageRounder

[jira] [Updated] (HDFS-7796) Include X-editable for slick contenteditable fields in the web UI

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7796: --- Labels: BB2015-05-TBR (was: ) Include X-editable for slick contenteditable fields in the web

[jira] [Updated] (HDFS-7726) Parse and check the configuration settings of edit log to prevent runtime errors

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7726: --- Labels: BB2015-05-TBR (was: ) Parse and check the configuration settings of edit log to

[jira] [Updated] (HDFS-6450) Support non-positional hedged reads in HDFS

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6450: --- Labels: BB2015-05-TBR (was: ) Support non-positional hedged reads in HDFS

[jira] [Updated] (HDFS-7973) rename favoriteAndExcludedNodes to excludedNodes for clarity

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7973: --- Labels: BB2015-05-TBR (was: ) rename favoriteAndExcludedNodes to excludedNodes for clarity

[jira] [Updated] (HDFS-7876) DataNodes start to scan blocks earlier

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7876: --- Labels: BB2015-05-TBR (was: ) DataNodes start to scan blocks earlier

[jira] [Updated] (HDFS-7036) HDFS-6776 fix requires to upgrade insecure cluster, which means quite some user pain

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7036: --- Labels: BB2015-05-TBR (was: ) HDFS-6776 fix requires to upgrade insecure cluster, which

[jira] [Updated] (HDFS-7727) Check and verify the auto-fence settings to prevent failures of auto-failover

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7727: --- Labels: BB2015-05-TBR (was: ) Check and verify the auto-fence settings to prevent failures

[jira] [Updated] (HDFS-4638) TransferFsImage should take Configuration as parameter

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4638: --- Labels: BB2015-05-TBR (was: ) TransferFsImage should take Configuration as parameter

[jira] [Commented] (HDFS-8327) Compute storage type quotas in INodeFile.computeQuotaDeltaForTruncate()

2015-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529830#comment-14529830 ] Hadoop QA commented on HDFS-8327: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2956: --- Labels: BB2015-05-TBR (was: ) calling fetchdt without a --renewer argument throws NPE

[jira] [Updated] (HDFS-8068) Do not retry rpc calls If the proxy contains unresolved address

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8068: --- Labels: BB2015-05-TBR (was: ) Do not retry rpc calls If the proxy contains unresolved

[jira] [Updated] (HDFS-2203) Add additional fields to the JMX output on NameNode

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2203: --- Labels: BB2015-05-TBR newbie (was: newbie) Add additional fields to the JMX output on

[jira] [Updated] (HDFS-6659) Create a Block List

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6659: --- Labels: BB2015-05-TBR perfomance (was: perfomance) Create a Block List ---

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus no longer a Writable

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6984: --- Labels: BB2015-05-TBR (was: ) In Hadoop 3, make FileStatus no longer a Writable

[jira] [Updated] (HDFS-8131) Implement a space balanced block placement policy

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8131: --- Labels: BB2015-05-TBR BlockPlacementPolicy (was: BlockPlacementPolicy) Implement a space

[jira] [Updated] (HDFS-6291) FSImage may be left unclosed in BootstrapStandby#doRun()

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6291: --- Labels: BB2015-05-TBR (was: ) FSImage may be left unclosed in BootstrapStandby#doRun()

[jira] [Updated] (HDFS-5761) DataNode fails to validate integrity for checksum type NULL when DataNode recovers

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5761: --- Labels: BB2015-05-TBR (was: ) DataNode fails to validate integrity for checksum type NULL

[jira] [Updated] (HDFS-6132) TestBlockToken fails on JDK 7

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6132: --- Labels: BB2015-05-TBR (was: ) TestBlockToken fails on JDK 7 -

[jira] [Updated] (HDFS-8277) Safemode enter fails when Standby NameNode is down

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8277: --- Labels: BB2015-05-TBR (was: ) Safemode enter fails when Standby NameNode is down

[jira] [Updated] (HDFS-6184) Capture NN's thread dump when it fails over

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6184: --- Labels: BB2015-05-TBR (was: ) Capture NN's thread dump when it fails over

[jira] [Updated] (HDFS-5058) QJM should validate startLogSegment() more strictly

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5058: --- Labels: BB2015-05-TBR (was: ) QJM should validate startLogSegment() more strictly

[jira] [Updated] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4253: --- Labels: BB2015-05-TBR (was: ) block replica reads get hot-spots due to

[jira] [Updated] (HDFS-5396) FSImage.getFsImageName should check whether fsimage exists

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5396: --- Labels: BB2015-05-TBR (was: ) FSImage.getFsImageName should check whether fsimage exists

[jira] [Updated] (HDFS-6782) Improve FS editlog logSync

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6782: --- Labels: BB2015-05-TBR (was: ) Improve FS editlog logSync --

[jira] [Updated] (HDFS-6310) PBImageXmlWriter should output information about Delegation Tokens

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6310: --- Labels: BB2015-05-TBR (was: ) PBImageXmlWriter should output information about Delegation

[jira] [Updated] (HDFS-7207) Consider adding a C++ API for libhdfs, libhdfs3, and libwebhdfs

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7207: --- Labels: BB2015-05-TBR (was: ) Consider adding a C++ API for libhdfs, libhdfs3, and

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529858#comment-14529858 ] Zhe Zhang commented on HDFS-7859: - [~aw] Could you explain a bit what this

[jira] [Commented] (HDFS-7672) Erasure Coding: handle write failure for stripping coding blocks

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529519#comment-14529519 ] Zhe Zhang commented on HDFS-7672: - The latest patch LGTM with Nicholas's explanations.

[jira] [Updated] (HDFS-7348) Erasure Coding: DataNode reconstruct striped blocks

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7348: Summary: Erasure Coding: DataNode reconstruct striped blocks (was: Erasure Coding: striped block recovery)

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-05-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529562#comment-14529562 ] Kai Zheng commented on HDFS-7859: - Nicholas, This was already move out of HDFS-7285 you

[jira] [Commented] (HDFS-8019) Erasure Coding: erasure coding chunk buffer allocation and management

2015-05-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529754#comment-14529754 ] Kai Zheng commented on HDFS-8019: - Looks like not much thing to be done for the moment on

[jira] [Updated] (HDFS-4185) Add a metric for number of active leases

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4185: --- Labels: (was: BB2015-05-RFC) Add a metric for number of active leases

[jira] [Updated] (HDFS-6300) Shouldn't allows to run multiple balancer simultaneously

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6300: --- Labels: (was: BB2015-05-RFC) Shouldn't allows to run multiple balancer simultaneously

[jira] [Updated] (HDFS-5270) Use thread pools in the datenode daemons

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5270: --- Labels: BB2015-05-TBR (was: ) Use thread pools in the datenode daemons

[jira] [Updated] (HDFS-6681) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN is flaky and sometimes gets stuck in infinite loops

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6681: --- Labels: BB2015-05-TBR (was: )

[jira] [Updated] (HDFS-6285) tidy an error log inside BlockReceiver

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6285: --- Labels: BB2015-05-TBR (was: ) tidy an error log inside BlockReceiver

[jira] [Updated] (HDFS-1508) Ability to do savenamespace without being in safemode

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1508: --- Labels: BB2015-05-TBR (was: ) Ability to do savenamespace without being in safemode

[jira] [Updated] (HDFS-3529) Use direct buffers for data in write path

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3529: --- Labels: BB2015-05-TBR (was: ) Use direct buffers for data in write path

[jira] [Updated] (HDFS-7400) More reliable namenode health check to detect OS/HW issues

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7400: --- Labels: BB2015-05-TBR (was: ) More reliable namenode health check to detect OS/HW issues

[jira] [Updated] (HDFS-6524) chooseDataNode decides retry times considering with block replica number

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6524: --- Labels: BB2015-05-TBR (was: ) chooseDataNode decides retry times considering with block

[jira] [Updated] (HDFS-7630) TestConnCache hardcode block size without considering native OS

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7630: --- Labels: BB2015-05-TBR (was: ) TestConnCache hardcode block size without considering native

[jira] [Updated] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7314: --- Labels: BB2015-05-TBR (was: ) Aborted DFSClient's impact on long running service like YARN

[jira] [Updated] (HDFS-7692) DataStorage#addStorageLocations(...) should support MultiThread to speedup the upgrade of block pool at multi storage directories.

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7692: --- Labels: BB2015-05-TBR (was: ) DataStorage#addStorageLocations(...) should support

[jira] [Updated] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6698: --- Labels: BB2015-05-TBR (was: ) try to optimize DFSInputStream.getFileLength()

[jira] [Updated] (HDFS-6743) Put IP address into a new column on the new NN webUI

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6743: --- Labels: BB2015-05-TBR (was: ) Put IP address into a new column on the new NN webUI

[jira] [Updated] (HDFS-1605) Convert DFSInputStream synchronized sections to a ReadWrite lock

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1605: --- Labels: BB2015-05-TBR (was: ) Convert DFSInputStream synchronized sections to a ReadWrite

[jira] [Updated] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6766: --- Labels: BB2015-05-TBR (was: ) optimize ack notify mechanism to avoid thundering herd issue

[jira] [Updated] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7553: --- Labels: BB2015-05-TBR (was: ) fix the TestDFSUpgradeWithHA due to BindException

[jira] [Updated] (HDFS-6744) Improve decommissioning nodes and dead nodes access on the new NN webUI

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6744: --- Labels: BB2015-05-TBR (was: ) Improve decommissioning nodes and dead nodes access on the new

[jira] [Updated] (HDFS-5917) Have an ability to refresh deadNodes list periodically

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5917: --- Labels: BB2015-05-TBR (was: ) Have an ability to refresh deadNodes list periodically

[jira] [Updated] (HDFS-5461) fallback to non-ssr(local short circuit reads) while oom detected

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5461: --- Labels: BB2015-05-TBR (was: ) fallback to non-ssr(local short circuit reads) while oom

[jira] [Updated] (HDFS-6108) make the length of the range in sync_file_range() configurable

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6108: --- Labels: BB2015-05-TBR (was: ) make the length of the range in sync_file_range() configurable

[jira] [Updated] (HDFS-7672) Erasure Coding: consolidate streamer coordination logic and handle write failure when writing striped blocks

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7672: Summary: Erasure Coding: consolidate streamer coordination logic and handle write failure when writing

[jira] [Updated] (HDFS-8288) Refactor DFSStripedOutputStream and StripedDataStreamer

2015-05-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8288: -- Resolution: Duplicate Status: Resolved (was: Patch Available) The code was

[jira] [Created] (HDFS-8327) Compute storage type quotas in INodeFile.computeQuotaDeltaForTruncate()

2015-05-05 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8327: Summary: Compute storage type quotas in INodeFile.computeQuotaDeltaForTruncate() Key: HDFS-8327 URL: https://issues.apache.org/jira/browse/HDFS-8327 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7348) Erasure Coding: DataNode reconstruct striped blocks

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529550#comment-14529550 ] Zhe Zhang commented on HDFS-7348: - I committed the patch. Erasure Coding: DataNode

[jira] [Resolved] (HDFS-7348) Erasure Coding: DataNode reconstruct striped blocks

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7348. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Erasure Coding: DataNode

[jira] [Commented] (HDFS-8062) Remove hard-coded values in favor of EC schema

2015-05-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529617#comment-14529617 ] Kai Zheng commented on HDFS-8062: - Nicholas, I was mentioning May 8th because I thought

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality (pread)

2015-05-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529685#comment-14529685 ] Jing Zhao commented on HDFS-7678: - Thanks for updating the patch, Zhe! Here are some

[jira] [Assigned] (HDFS-8329) Erasure coding: Rename Striped block recovery to reconstruction to eliminate confusion.

2015-05-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reassigned HDFS-8329: Assignee: Yi Liu Erasure coding: Rename Striped block recovery to reconstruction to eliminate confusion.

[jira] [Updated] (HDFS-8329) Erasure coding: Rename Striped block recovery to reconstruction to eliminate confusion.

2015-05-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8329: - Description: Both in NN and DN, we use striped block recovery and sometime use reconstruction. The striped block

[jira] [Updated] (HDFS-6348) Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6348: --- Labels: (was: BB2015-05-RFC) Secondary namenode - RMI Thread prevents JVM from exiting

[jira] [Updated] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2484: --- Labels: (was: BB2015-05-RFC) checkLease should throw FileNotFoundException when file does

[jira] [Updated] (HDFS-6596) Improve InputStream when read spans two blocks

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6596: --- Labels: BB2015-05-TBR (was: ) Improve InputStream when read spans two blocks

[jira] [Updated] (HDFS-6540) TestOfflineImageViewer.outputOfLSVisitor fails for certain usernames

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6540: --- Labels: BB2015-05-TBR (was: ) TestOfflineImageViewer.outputOfLSVisitor fails for certain

[jira] [Updated] (HDFS-5278) Reduce memory consumptions of TestDFSClientRetries

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5278: --- Labels: BB2015-05-TBR (was: ) Reduce memory consumptions of TestDFSClientRetries

[jira] [Updated] (HDFS-5654) Add lock context support to FSNamesystemLock

2015-05-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5654: --- Labels: BB2015-05-TBR (was: ) Add lock context support to FSNamesystemLock

<    1   2   3   4   5   >