[jira] [Updated] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Yoder updated HDFS-6379: - Status: Patch Available (was: In Progress) HTTPFS - Implement ACLs support

[jira] [Updated] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Yoder updated HDFS-6379: - Attachment: jira-HDFS-6379.patch HTTPFS - Implement ACLs support ---

[jira] [Commented] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14021718#comment-14021718 ] Hadoop QA commented on HDFS-6379: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6494) In some case, the hedged read will lead to client infinite wait.

2014-06-09 Thread LiuLei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiuLei updated HDFS-6494: - Attachment: hedged-read-bug.patch In some case, the hedged read will lead to client infinite wait.

[jira] [Commented] (HDFS-6494) In some case, the hedged read will lead to client infinite wait.

2014-06-09 Thread LiuLei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14021729#comment-14021729 ] LiuLei commented on HDFS-6494: -- Hi Liang, I upload one patch, I hope that is helpful for you.

[jira] [Updated] (HDFS-5442) Zero loss HDFS data replication for multiple datacenters

2014-06-09 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated HDFS-5442: -- Attachment: Disaster Recovery Solution for Hadoop.pdf Updated the design doc, add some detailed implementation.

[jira] [Commented] (HDFS-6465) Enable the configuration of multiple clusters

2014-06-09 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14021786#comment-14021786 ] Dian Fu commented on HDFS-6465: --- update some design details about configurations:

[jira] [Updated] (HDFS-6382) HDFS File/Directory TTL

2014-06-09 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6382: - Attachment: HDFS-TTL-Design.pdf An initial version of design doc. HDFS File/Directory TTL

[jira] [Created] (HDFS-6503) Fix typo of DFSAdmin restoreFailedStorage

2014-06-09 Thread Zesheng Wu (JIRA)
Zesheng Wu created HDFS-6503: Summary: Fix typo of DFSAdmin restoreFailedStorage Key: HDFS-6503 URL: https://issues.apache.org/jira/browse/HDFS-6503 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-6503) Fix typo of DFSAdmin restoreFailedStorage

2014-06-09 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6503: - Status: Patch Available (was: Open) Fix typo of DFSAdmin restoreFailedStorage

[jira] [Updated] (HDFS-6503) Fix typo of DFSAdmin restoreFailedStorage

2014-06-09 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6503: - Attachment: HDFS-6503.patch Fix typo of DFSAdmin restoreFailedStorage

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6481: - Assignee: Ted Yu DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6481: - Target Version/s: 2.5.0 DatanodeManager#getDatanodeStorageInfos() should check the length of

[jira] [Commented] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025216#comment-14025216 ] Kihwal Lee commented on HDFS-6481: -- We can add sanity checks, but this should not happen

[jira] [Commented] (HDFS-6503) Fix typo of DFSAdmin restoreFailedStorage

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025281#comment-14025281 ] Hadoop QA commented on HDFS-6503: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6503) Fix typo of DFSAdmin restoreFailedStorage

2014-06-09 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025285#comment-14025285 ] Zesheng Wu commented on HDFS-6503: -- Just fix typo, no need to add new tests. Fix typo of

[jira] [Commented] (HDFS-6403) Add metrics for log warnings reported by HADOOP-9618

2014-06-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025326#comment-14025326 ] Yongjun Zhang commented on HDFS-6403: - HI [~tlipcon], as we chatted earlier,

[jira] [Commented] (HDFS-6159) TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success

2014-06-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025373#comment-14025373 ] Arpit Agarwal commented on HDFS-6159: - Hi [~djp], looks unrelated to HDFS-6362 from a

[jira] [Commented] (HDFS-2006) ability to support storing extended attributes per file

2014-06-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025391#comment-14025391 ] Uma Maheswara Rao G commented on HDFS-2006: --- XAttr support for

[jira] [Commented] (HDFS-6503) Fix typo of DFSAdmin restoreFailedStorage

2014-06-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025418#comment-14025418 ] Akira AJISAKA commented on HDFS-6503: - +1 (non-binding). Fix typo of DFSAdmin

[jira] [Commented] (HDFS-6257) TestCacheDirectives#testExceedsCapacity fails occasionally in trunk

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025438#comment-14025438 ] Andrew Wang commented on HDFS-6257: --- Idea look good, the current check definitely seems

[jira] [Commented] (HDFS-2006) ability to support storing extended attributes per file

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025453#comment-14025453 ] Andrew Wang commented on HDFS-2006: --- Hey Uma, we haven't done a vote for previous

[jira] [Commented] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

2014-06-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025455#comment-14025455 ] Daryn Sharp commented on HDFS-2856: --- Chris asked that I take a look, so I'll try to

[jira] [Commented] (HDFS-6460) To ignore stale/decommissioned nodes in NetworkTopology#pseudoSortByDistance

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025472#comment-14025472 ] Andrew Wang commented on HDFS-6460: --- Hey Yongjun, thanks for working on this. Just one

[jira] [Commented] (HDFS-6257) TestCacheDirectives#testExceedsCapacity fails occasionally in trunk

2014-06-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025495#comment-14025495 ] Colin Patrick McCabe commented on HDFS-6257: The current check should always

[jira] [Commented] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-06-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025499#comment-14025499 ] Jing Zhao commented on HDFS-6315: - The patch looks good to me in general. Some comments: #

[jira] [Updated] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Yoder updated HDFS-6379: - Attachment: jira-HDFS-6379.patch HTTPFS - Implement ACLs support ---

[jira] [Updated] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Yoder updated HDFS-6379: - Status: In Progress (was: Patch Available) HTTPFS - Implement ACLs support

[jira] [Updated] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Yoder updated HDFS-6379: - Attachment: (was: jira-HDFS-6379.patch) HTTPFS - Implement ACLs support

[jira] [Updated] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Yoder updated HDFS-6379: - Attachment: (was: jira-HDFS-6379.patch) HTTPFS - Implement ACLs support

[jira] [Commented] (HDFS-6257) TestCacheDirectives#testExceedsCapacity fails occasionally in trunk

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025502#comment-14025502 ] Andrew Wang commented on HDFS-6257: --- Hmm, I guess good enough. +1 thanks colin.

[jira] [Updated] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Yoder updated HDFS-6379: - Attachment: jira-HDFS-6379.patch HTTPFS - Implement ACLs support ---

[jira] [Updated] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Yoder updated HDFS-6379: - Attachment: (was: jira-HDFS-6379.patch) HTTPFS - Implement ACLs support

[jira] [Updated] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Yoder updated HDFS-6379: - Status: Patch Available (was: In Progress) HTTPFS - Implement ACLs support

[jira] [Updated] (HDFS-6257) TestCacheDirectives#testExceedsCapacity fails occasionally

2014-06-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6257: --- Summary: TestCacheDirectives#testExceedsCapacity fails occasionally (was:

[jira] [Updated] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Yoder updated HDFS-6379: - Attachment: jira-HDFS-6379.patch HTTPFS - Implement ACLs support ---

[jira] [Commented] (HDFS-6493) Propose to change dfs.namenode.startup.delay.block.deletion to second instead of millisecond

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025504#comment-14025504 ] Andrew Wang commented on HDFS-6493: --- I think we should keep the default value to

[jira] [Updated] (HDFS-6257) TestCacheDirectives#testExceedsCapacity fails occasionally

2014-06-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6257: --- Resolution: Fixed Fix Version/s: 2.5.0 Status: Resolved (was: Patch

[jira] [Assigned] (HDFS-6399) FSNamesystem ACL operations should check isPermissionEnabled

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-6399: - Assignee: Chris Nauroth (was: Charles Lamb) FSNamesystem ACL operations should check

[jira] [Updated] (HDFS-6330) Move mkdirs() to FSNamesystem

2014-06-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6330: Summary: Move mkdirs() to FSNamesystem (was: Move mkdir() to FSNamesystem) Move mkdirs() to FSNamesystem

[jira] [Updated] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-06-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6315: - Attachment: HDFS-6315.005.patch Decouple recording edit logs from FSDirectory

[jira] [Updated] (HDFS-6478) RemoteException can't be retried properly for non-HA scenario

2014-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6478: -- Attachment: HDFS-6478.patch The patch has the followings: 1. Modify the proxy chain order for NamenodeProtocol

[jira] [Updated] (HDFS-6478) RemoteException can't be retried properly for non-HA scenario

2014-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6478: -- Status: Patch Available (was: Open) RemoteException can't be retried properly for non-HA scenario

[jira] [Updated] (HDFS-6399) Add note about setfacl in HDFS permissions guide

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6399: -- Summary: Add note about setfacl in HDFS permissions guide (was: FSNamesystem ACL operations should

[jira] [Updated] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-06-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6315: - Attachment: (was: HDFS-6315.005.patch) Decouple recording edit logs from FSDirectory

[jira] [Updated] (HDFS-6399) Add note about setfacl in HDFS permissions guide

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6399: -- Resolution: Fixed Fix Version/s: 2.5.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-6399) FSNamesystem ACL operations should check isPermissionEnabled

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025509#comment-14025509 ] Andrew Wang commented on HDFS-6399: --- +1 thanks chris, will commit shortly. FSNamesystem

[jira] [Commented] (HDFS-6257) TestCacheDirectives#testExceedsCapacity fails occasionally

2014-06-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025541#comment-14025541 ] Hudson commented on HDFS-6257: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5668 (See

[jira] [Commented] (HDFS-6399) Add note about setfacl in HDFS permissions guide

2014-06-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025540#comment-14025540 ] Chris Nauroth commented on HDFS-6399: - Andrew, thank you for reviewing and committing.

[jira] [Commented] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-06-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025516#comment-14025516 ] Haohui Mai commented on HDFS-6315: -- Thanks Jing for the review. I've uploaded the v5 patch

[jira] [Commented] (HDFS-6399) Add note about setfacl in HDFS permissions guide

2014-06-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1402#comment-1402 ] Hudson commented on HDFS-6399: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5669 (See

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025559#comment-14025559 ] Arpit Agarwal commented on HDFS-6482: - {{DFS_DATANODE_NUMBLOCKS_DEFAULT}} is currently

[jira] [Updated] (HDFS-6460) To ignore stale/decommissioned nodes in NetworkTopology#pseudoSortByDistance

2014-06-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6460: Attachment: HDFS-6460.002.patch Hi Andrew, Thanks a lot for the review and the good catch. I'm

[jira] [Updated] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-06-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6315: - Attachment: HDFS-6315.005.patch Decouple recording edit logs from FSDirectory

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025585#comment-14025585 ] Colin Patrick McCabe commented on HDFS-6382: For the MR strategy, it seems like

[jira] [Commented] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025608#comment-14025608 ] Hadoop QA commented on HDFS-6379: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025693#comment-14025693 ] Colin Patrick McCabe commented on HDFS-6482: bq. DFS_DATANODE_NUMBLOCKS_DEFAULT

[jira] [Commented] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-06-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025713#comment-14025713 ] Daryn Sharp commented on HDFS-6315: --- Catching up from summit, will look at this soon.

[jira] [Commented] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-06-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025740#comment-14025740 ] Jing Zhao commented on HDFS-6315: - bq. It's sadly conflicting with the single path

[jira] [Commented] (HDFS-6330) Move mkdirs() to FSNamesystem

2014-06-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025730#comment-14025730 ] Jing Zhao commented on HDFS-6330: - The patch looks good to me. Some minors: # Let's use

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025761#comment-14025761 ] Kihwal Lee commented on HDFS-6482: -- BlockIDs are sequential nowadays. With the proposed

[jira] [Commented] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025773#comment-14025773 ] Hadoop QA commented on HDFS-6315: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-06-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025783#comment-14025783 ] Daryn Sharp commented on HDFS-6315: --- Maybe it's ok, but I'll apply the patch and comment

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-09 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025786#comment-14025786 ] James Thomas commented on HDFS-6482: Thanks for the review, Arpit, and thanks for the

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-09 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025802#comment-14025802 ] James Thomas commented on HDFS-6482: Kihwal, we were considering using some sort of

[jira] [Commented] (HDFS-6315) Decouple recording edit logs from FSDirectory

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025803#comment-14025803 ] Hadoop QA commented on HDFS-6315: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-2006) ability to support storing extended attributes per file

2014-06-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025823#comment-14025823 ] Chris Nauroth commented on HDFS-2006: - I agree with Andrew on the plan for merging to

[jira] [Commented] (HDFS-6478) RemoteException can't be retried properly for non-HA scenario

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025843#comment-14025843 ] Hadoop QA commented on HDFS-6478: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6395) Assorted improvements to xattr limit checking

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025855#comment-14025855 ] Andrew Wang commented on HDFS-6395: --- I should have realized this earlier, considering I

[jira] [Commented] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025943#comment-14025943 ] Alejandro Abdelnur commented on HDFS-6379: -- [~michaelbyoder], nice work. Would you

[jira] [Commented] (HDFS-6460) To ignore stale/decommissioned nodes in NetworkTopology#pseudoSortByDistance

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025944#comment-14025944 ] Hadoop QA commented on HDFS-6460: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6379) HTTPFS - Implement ACLs support

2014-06-09 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025956#comment-14025956 ] Mike Yoder commented on HDFS-6379: -- Looks like there's another me out there! I'm

[jira] [Created] (HDFS-6504) NFS: invalid Keytab/principal entry should shutdown nfs server

2014-06-09 Thread Yesha Vora (JIRA)
Yesha Vora created HDFS-6504: Summary: NFS: invalid Keytab/principal entry should shutdown nfs server Key: HDFS-6504 URL: https://issues.apache.org/jira/browse/HDFS-6504 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6460) To ignore stale/decommissioned nodes in NetworkTopology#pseudoSortByDistance

2014-06-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025964#comment-14025964 ] Yongjun Zhang commented on HDFS-6460: - The failed test is irrelevant, and it was

[jira] [Commented] (HDFS-6460) To ignore stale/decommissioned nodes in NetworkTopology#pseudoSortByDistance

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025970#comment-14025970 ] Andrew Wang commented on HDFS-6460: --- +1 will commit shortly, thanks Yongjun To ignore

[jira] [Commented] (HDFS-6439) NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not

2014-06-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025972#comment-14025972 ] Brandon Li commented on HDFS-6439: -- [~atm], are you still working on this? If you are

[jira] [Commented] (HDFS-6439) NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025977#comment-14025977 ] Hadoop QA commented on HDFS-6439: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6460) Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6460: -- Summary: Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance (was: To ignore

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025980#comment-14025980 ] Colin Patrick McCabe commented on HDFS-6482: bq. Suppose we had a cluster of 16

[jira] [Commented] (HDFS-6460) Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025981#comment-14025981 ] Andrew Wang commented on HDFS-6460: --- Committed this to trunk. Yongjun, do you mind

[jira] [Commented] (HDFS-6460) Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance

2014-06-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025992#comment-14025992 ] Hudson commented on HDFS-6460: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5671 (See

[jira] [Updated] (HDFS-6470) TestBPOfferService.testBPInitErrorHandling is flaky

2014-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6470: -- Attachment: HDFS-6470.patch It seems the test has the following issues. 1. It asserts the size of

[jira] [Updated] (HDFS-6470) TestBPOfferService.testBPInitErrorHandling is flaky

2014-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6470: -- Status: Patch Available (was: Open) TestBPOfferService.testBPInitErrorHandling is flaky

[jira] [Work started] (HDFS-6493) Propose to change dfs.namenode.startup.delay.block.deletion to second instead of millisecond

2014-06-09 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6493 started by Juan Yu. Propose to change dfs.namenode.startup.delay.block.deletion to second instead of millisecond

[jira] [Updated] (HDFS-6493) Propose to change dfs.namenode.startup.delay.block.deletion to second instead of millisecond

2014-06-09 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6493: -- Attachment: HDFS-6493.001.patch Propose to change dfs.namenode.startup.delay.block.deletion to second

[jira] [Updated] (HDFS-6493) Propose to change dfs.namenode.startup.delay.block.deletion to second instead of millisecond

2014-06-09 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6493: -- Attachment: (was: HDFS-6493.001.patch) Propose to change dfs.namenode.startup.delay.block.deletion to

[jira] [Assigned] (HDFS-6502) incorrect description in distcp2 document

2014-06-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA reassigned HDFS-6502: --- Assignee: Akira AJISAKA incorrect description in distcp2 document

[jira] [Updated] (HDFS-6502) incorrect description in distcp2 document

2014-06-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6502: Attachment: HDFS-6502.patch Thanks [~yzhangal] for the report. Attaching a patch for trunk and

[jira] [Updated] (HDFS-6460) Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance

2014-06-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6460: Attachment: HDFS-6460-branch2.001.patch Ignore stale and decommissioned nodes in

[jira] [Updated] (HDFS-6502) incorrect description in distcp2 document

2014-06-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6502: Labels: newbie (was: ) Target Version/s: 2.5.0 Affects Version/s: (was:

[jira] [Commented] (HDFS-6460) Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance

2014-06-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026024#comment-14026024 ] Yongjun Zhang commented on HDFS-6460: - Many thanks Andrew! Just uploaded a patch for

[jira] [Commented] (HDFS-6439) NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not

2014-06-09 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026027#comment-14026027 ] Aaron T. Myers commented on HDFS-6439: -- Definitely don't let me hold you up if you'd

[jira] [Commented] (HDFS-6395) Assorted improvements to xattr limit checking

2014-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026032#comment-14026032 ] Andrew Wang commented on HDFS-6395: --- Woops, my bad, I forgot that this patch also fixes

[jira] [Commented] (HDFS-6460) Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026039#comment-14026039 ] Hadoop QA commented on HDFS-6460: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-09 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026047#comment-14026047 ] Zesheng Wu commented on HDFS-6382: -- Thanks [~cmccabe] for your feedback. bq. For the MR

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2014-06-09 Thread Guo Ruijing (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026068#comment-14026068 ] Guo Ruijing commented on HDFS-6489: --- Take example, existing behavior: 1. create file

[jira] [Commented] (HDFS-6502) incorrect description in distcp2 document

2014-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026069#comment-14026069 ] Hadoop QA commented on HDFS-6502: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6505) Can not close file due to last block is marked as corrupt

2014-06-09 Thread Gordon Wang (JIRA)
Gordon Wang created HDFS-6505: - Summary: Can not close file due to last block is marked as corrupt Key: HDFS-6505 URL: https://issues.apache.org/jira/browse/HDFS-6505 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-6505) Can not close file due to last block is marked as corrupt

2014-06-09 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026085#comment-14026085 ] Gordon Wang commented on HDFS-6505: --- This issue causes the last block is missing and the

[jira] [Commented] (HDFS-5723) Append failed FINALIZED replica should not be accepted as valid when that block is underconstruction

2014-06-09 Thread stanley shi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026090#comment-14026090 ] stanley shi commented on HDFS-5723: --- Hi Vinay, Seems my steps are an different error but

  1   2   >