[jira] [Commented] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370854#comment-14370854 ] Hudson commented on HDFS-7962: -- FAILURE: Integrated in Hadoop-trunk-Commit #7380 (See [https:

[jira] [Updated] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7962: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-6599) 2.4 addBlock is 10 to 20 times slower compared to 0.23

2015-03-19 Thread Anthony Hsu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370834#comment-14370834 ] Anthony Hsu commented on HDFS-6599: --- We're encountering NameNode slowness on Hadoop 2.3 a

[jira] [Commented] (HDFS-7835) make initial sleeptime in locateFollowingBlock configurable for DFSClient.

2015-03-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370828#comment-14370828 ] Yongjun Zhang commented on HDFS-7835: - Thanks [~zxu]. +1, and I will commit tomorrow.

[jira] [Commented] (HDFS-7835) make initial sleeptime in locateFollowingBlock configurable for DFSClient.

2015-03-19 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370821#comment-14370821 ] zhihai xu commented on HDFS-7835: - All these test failure are not related to my change. Tes

[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-6826: -- Attachment: HDFS-6826.14.patch Fixing Javadoc error. The remaining test case failure is unrelated > Plug

[jira] [Commented] (HDFS-7833) DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.

2015-03-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370814#comment-14370814 ] Lei (Eddy) Xu commented on HDFS-7833: - These failing tests are not related. > DataNode

[jira] [Commented] (HDFS-7833) DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370812#comment-14370812 ] Hadoop QA commented on HDFS-7833: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

2015-03-19 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370803#comment-14370803 ] Masatake Iwasaki commented on HDFS-7054: I filed HDFS-7963 to fix this. > Make DFS

[jira] [Created] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

2015-03-19 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-7963: -- Summary: Fix expected tracing spans in TestTracing along with HDFS-7054 Key: HDFS-7963 URL: https://issues.apache.org/jira/browse/HDFS-7963 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370800#comment-14370800 ] Hadoop QA commented on HDFS-7962: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370794#comment-14370794 ] Hadoop QA commented on HDFS-6826: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370785#comment-14370785 ] Andrew Wang commented on HDFS-7962: --- These are probably my fault since I did the slf4j co

[jira] [Updated] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7961: -- Target Version/s: 2.7.0 Fix Version/s: (was: 2.7.0) (was: 3.0.0) > T

[jira] [Commented] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370761#comment-14370761 ] Andrew Wang commented on HDFS-7960: --- Nice find and fix Colin. This change looks good to m

[jira] [Commented] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370729#comment-14370729 ] Hadoop QA commented on HDFS-7960: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7835) make initial sleeptime in locateFollowingBlock configurable for DFSClient.

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370709#comment-14370709 ] Hadoop QA commented on HDFS-7835: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6841) Use Time.monotonicNow() wherever applicable instead of Time.now()

2015-03-19 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6841: Attachment: HDFS-6841-006.patch Updated the patch as per [~kihwal] 's comments. Still kept the protoc

[jira] [Commented] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370697#comment-14370697 ] Hadoop QA commented on HDFS-7961: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370689#comment-14370689 ] Hadoop QA commented on HDFS-6826: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7961: Attachment: HDFS-7961.001.patch [~cmccabe] Thanks for the reviews. I made the changes. > Trigger ful

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2015-03-19 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370633#comment-14370633 ] Zhanwei Wang commented on HDFS-6994: Hi [~cybertri...@gmail.com] Not yet, but it is on

[jira] [Commented] (HDFS-7957) Truncate should verify quota before making changes

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370626#comment-14370626 ] Hadoop QA commented on HDFS-7957: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2015-03-19 Thread li zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370595#comment-14370595 ] li zhang commented on HDFS-6994: Haohui Mai and Zhanwei Wang, Does libhdfs3 support th

[jira] [Commented] (HDFS-5215) dfs.datanode.du.reserved is not taking effect as it's not considered while getting the available space

2015-03-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370584#comment-14370584 ] Yongjun Zhang commented on HDFS-5215: - Hi [~brahmareddy], I studied the callers of {{D

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Status: Open (was: Patch Available) > The full block report should prune zombie storag

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: (was: HDFS-7960.001.patch) > The full block report should prune zombie

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Status: Patch Available (was: Open) > The full block report should prune zombie storag

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: HDFS-7960.002.patch > The full block report should prune zombie storages ev

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: HDFS-7960.001.patch patch to get jenkins run. will put up a unit test soon

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Status: Patch Available (was: Open) > The full block report should prune zombie storag

[jira] [Commented] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370569#comment-14370569 ] Colin Patrick McCabe commented on HDFS-7961: maybe {{testFullBlockReportAfterHo

[jira] [Updated] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7962: - Summary: Remove duplicated logs in BlockManager (was: Remove duplicated log in BlockManager) > Remove duplicated

[jira] [Commented] (HDFS-7616) Change FSImage to support BlockGroup

2015-03-19 Thread Takuya Fukudome (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370548#comment-14370548 ] Takuya Fukudome commented on HDFS-7616: --- Hi [~zhz], Thank you for your comment. I ha

[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370536#comment-14370536 ] Hadoop QA commented on HDFS-7824: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-6826: -- Attachment: HDFS-6826.13.patch Updating patch to include a default implementation of {{INodeAttributePro

[jira] [Updated] (HDFS-7962) Remove duplicated log in BlockManager

2015-03-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7962: - Attachment: HDFS-7962.001.patch > Remove duplicated log in BlockManager > - > >

[jira] [Updated] (HDFS-7962) Remove duplicated log in BlockManager

2015-03-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7962: - Status: Patch Available (was: Open) > Remove duplicated log in BlockManager >

[jira] [Created] (HDFS-7962) Remove duplicated log in BlockManager

2015-03-19 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7962: Summary: Remove duplicated log in BlockManager Key: HDFS-7962 URL: https://issues.apache.org/jira/browse/HDFS-7962 Project: Hadoop HDFS Issue Type: Improvement R

[jira] [Updated] (HDFS-7833) DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.

2015-03-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7833: Attachment: HDFS-7833.001.patch [~cnauroth] Thanks for reviewing this. I updated the patch to add th

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Description: The full block report should prune zombie storages even if they're not emp

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Summary: The full block report should prune zombie storages even if they're not empty

[jira] [Commented] (HDFS-7256) Encryption Key created in Java Key Store after Namenode start unavailable for EZ Creation

2015-03-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370483#comment-14370483 ] Yi Liu commented on HDFS-7256: -- Hi Xiaoyu, {{hadoop.security.key.provider.path}} is only used

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations

2015-03-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370456#comment-14370456 ] Hudson commented on HDFS-7930: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7378 (See [https:

[jira] [Commented] (HDFS-7835) make initial sleeptime in locateFollowingBlock configurable for DFSClient.

2015-03-19 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370455#comment-14370455 ] zhihai xu commented on HDFS-7835: - Hi [~yzhangal], thanks for the review. I uploaded a new

[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-6826: -- Attachment: HDFS-6826.12.patch Missed a file in my earlier patch.. Uploading fix. > Plugin interface to

[jira] [Updated] (HDFS-7835) make initial sleeptime in locateFollowingBlock configurable for DFSClient.

2015-03-19 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated HDFS-7835: Attachment: HDFS-7835.002.patch > make initial sleeptime in locateFollowingBlock configurable for DFSClient.

[jira] [Updated] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7961: Status: Patch Available (was: Open) > Trigger full block report after hot swapping disk > --

[jira] [Updated] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7961: Attachment: HDFS-7961.000.patch Trigger a full block report after hot swap DataNode volumes. Added a

[jira] [Updated] (HDFS-7930) commitBlockSynchronization() does not remove locations

2015-03-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7930: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-7959) WebHdfs logging is missing on Datanode

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370433#comment-14370433 ] Hadoop QA commented on HDFS-7959: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7954) TestBalancer#testBalancerWithPinnedBlocks failed on Windows

2015-03-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7954: - Summary: TestBalancer#testBalancerWithPinnedBlocks failed on Windows (was: TestBalancer#testBalancerWithPi

[jira] [Commented] (HDFS-7954) TestBalancer#testBalancerWithPinnedBlocks failed on both Linux and Windows

2015-03-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370422#comment-14370422 ] Xiaoyu Yao commented on HDFS-7954: -- I can't repro on Linux either any more. Can you check

[jira] [Updated] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7824: - Attachment: HDFS-7824.03.patch Thanks [~arpitagarwal] for the review. I've updated the patch based on your

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370402#comment-14370402 ] Hadoop QA commented on HDFS-6826: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-19 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-7961: --- Summary: Trigger full block report after hot swapping disk Key: HDFS-7961 URL: https://issues.apache.org/jira/browse/HDFS-7961 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-6826: -- Attachment: HDFS-6826.11.patch Thanks for the review [~jnp] Uploading a fresh patch incorporating your su

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370357#comment-14370357 ] Jing Zhao commented on HDFS-7285: - Thanks for the update, Zhe! The plan sounds good to me.

[jira] [Commented] (HDFS-7835) make initial sleeptime in locateFollowingBlock configurable for DFSClient.

2015-03-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370354#comment-14370354 ] Yongjun Zhang commented on HDFS-7835: - Hi [~zxu], Thanks for the new rev and sorry for

[jira] [Updated] (HDFS-7957) Truncate should verify quota before making changes

2015-03-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7957: Attachment: HDFS-7957.001.patch Update the calculation to fix the failed test. Also add new tests. > Truncat

[jira] [Commented] (HDFS-7960) The full block report should contain a "numStoragesOnDn" field that allows the NameNode to prune old storages

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370336#comment-14370336 ] Colin Patrick McCabe commented on HDFS-7960: Just a note here: the reason why H

[jira] [Updated] (HDFS-7960) The full block report should contain a "numStoragesOnDn" field that allows the NameNode to prune old storages

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Description: The full block report should contain a "numStoragesOnDn" field that a

[jira] [Commented] (HDFS-7833) DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.

2015-03-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370321#comment-14370321 ] Chris Nauroth commented on HDFS-7833: - Hi [~eddyxu]. Thank you for the patch. Overall

[jira] [Updated] (HDFS-7960) NameNode should prune storages that are no longer existed on DataNode

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Assignee: Colin Patrick McCabe (was: Lei (Eddy) Xu) > NameNode should prune storages t

[jira] [Created] (HDFS-7960) NameNode should prune storages that are no longer existed on DataNode

2015-03-19 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-7960: --- Summary: NameNode should prune storages that are no longer existed on DataNode Key: HDFS-7960 URL: https://issues.apache.org/jira/browse/HDFS-7960 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370307#comment-14370307 ] Zhe Zhang commented on HDFS-7285: - I had another offline discussion with [~andrew.wang] aro

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370296#comment-14370296 ] Hadoop QA commented on HDFS-7878: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7256) Encryption Key created in Java Key Store after Namenode start unavailable for EZ Creation

2015-03-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7256: - Assignee: Yi Liu > Encryption Key created in Java Key Store after Namenode start unavailable for > EZ Crea

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations

2015-03-19 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370282#comment-14370282 ] Konstantin Shvachko commented on HDFS-7930: --- I liked your changes in the earlier

[jira] [Commented] (HDFS-7256) Encryption Key created in Java Key Store after Namenode start unavailable for EZ Creation

2015-03-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370241#comment-14370241 ] Xiaoyu Yao commented on HDFS-7256: -- bq. If you don't want specify -provider every time, pl

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

2015-03-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370225#comment-14370225 ] Zhe Zhang commented on HDFS-7613: - This JIRA actually has a wider scope than HDFS-7891. Bes

[jira] [Updated] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-03-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7758: Attachment: HDFS-7758.003.patch Update the patch to resolve conflicts with trunk. Also ran {{TestDat

[jira] [Commented] (HDFS-7833) DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370210#comment-14370210 ] Hadoop QA commented on HDFS-7833: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7891) A block placement policy with best fault tolerance

2015-03-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370205#comment-14370205 ] Zhe Zhang commented on HDFS-7891: - Great analysis [~walter.k.su]! It seems the 003 patch

[jira] [Commented] (HDFS-7942) NFS: support regexp grouping in nfs.exports.allowed.hosts

2015-03-19 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370198#comment-14370198 ] Brandon Li commented on HDFS-7942: -- "+, -" is not expected to be used frequently in hostna

[jira] [Commented] (HDFS-7942) NFS: support regexp grouping in nfs.exports.allowed.hosts

2015-03-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370157#comment-14370157 ] Haohui Mai commented on HDFS-7942: -- {code} } else if (host.contains("*") || host.cont

[jira] [Commented] (HDFS-7597) Clients seeking over webhdfs may crash the NN

2015-03-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370136#comment-14370136 ] Haohui Mai commented on HDFS-7597: -- [~daryn], can you please change the title and the desc

[jira] [Commented] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370128#comment-14370128 ] Haohui Mai commented on HDFS-7748: -- bq. Shall we keep the same values here in the new prot

[jira] [Commented] (HDFS-7942) NFS: support regexp grouping in nfs.exports.allowed.hosts

2015-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370101#comment-14370101 ] Hadoop QA commented on HDFS-7942: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5215) dfs.datanode.du.reserved is not taking effect as it's not considered while getting the available space

2015-03-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370074#comment-14370074 ] Yongjun Zhang commented on HDFS-5215: - HI [~brahmareddy], I noticed that I did not pi

[jira] [Updated] (HDFS-7959) WebHdfs logging is missing on Datanode

2015-03-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7959: - Target Version/s: 2.8.0 > WebHdfs logging is missing on Datanode > -- >

[jira] [Updated] (HDFS-7959) WebHdfs logging is missing on Datanode

2015-03-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7959: - Assignee: Kihwal Lee Status: Patch Available (was: Open) > WebHdfs logging is missing on Datanode >

[jira] [Updated] (HDFS-7959) WebHdfs logging is missing on Datanode

2015-03-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7959: - Attachment: HDFS-7959.patch First shot at adding the logging. The patch comes with a sample log4j config.

[jira] [Updated] (HDFS-7942) NFS: support regexp grouping in nfs.exports.allowed.hosts

2015-03-19 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7942: - Status: Patch Available (was: Open) > NFS: support regexp grouping in nfs.exports.allowed.hosts >

[jira] [Updated] (HDFS-7942) NFS: support regexp grouping in nfs.exports.allowed.hosts

2015-03-19 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7942: - Attachment: HDFS-7942.001.patch > NFS: support regexp grouping in nfs.exports.allowed.hosts > -

[jira] [Commented] (HDFS-7942) NFS: support regexp grouping in nfs.exports.allowed.hosts

2015-03-19 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370024#comment-14370024 ] Brandon Li commented on HDFS-7942: -- Uploaded a patch to support grouping in nfs.exports.al

[jira] [Updated] (HDFS-7942) NFS: support regexp grouping in nfs.exports.allowed.hosts

2015-03-19 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7942: - Summary: NFS: support regexp grouping in nfs.exports.allowed.hosts (was: NFS: regex value of nfs.exports.a

[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-19 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1437#comment-1437 ] Arpit Agarwal commented on HDFS-7824: - The patch looks great to me. Just nitpicks, +1 o

[jira] [Updated] (HDFS-7833) DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.

2015-03-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7833: Target Version/s: 3.0.0, 2.7.0 (was: 2.7.0) Status: Patch Available (was: Open) > Dat

[jira] [Updated] (HDFS-7833) DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.

2015-03-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7833: Attachment: HDFS-7833.000.patch Upload a patch based on the above discussion. > DataNode reconfigur

[jira] [Created] (HDFS-7959) WebHdfs logging is missing on Datanode

2015-03-19 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-7959: Summary: WebHdfs logging is missing on Datanode Key: HDFS-7959 URL: https://issues.apache.org/jira/browse/HDFS-7959 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2015-03-19 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HDFS-7878: --- Attachment: HDFS-7878.04.patch Removed open, removed field from serialization. I think inherita

[jira] [Commented] (HDFS-7453) Namenode does not recognize block is missing on a datanode

2015-03-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369864#comment-14369864 ] Chris Nauroth commented on HDFS-7453: - HDFS-7208 does look like a plausible explanation

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-19 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369861#comment-14369861 ] Jitendra Nath Pandey commented on HDFS-6826: [~asuresh], Thanks for the prop

[jira] [Commented] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369852#comment-14369852 ] Chris Nauroth commented on HDFS-7748: - Oops, I meant to say that the indentation needs

[jira] [Commented] (HDFS-7815) Loop on 'blocks does not belong to any file'

2015-03-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369836#comment-14369836 ] Chris Nauroth commented on HDFS-7815: - Hi, [~frha]. You can add this line to your log4

[jira] [Commented] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369817#comment-14369817 ] Chris Nauroth commented on HDFS-7748: - Hi Anu. This patch looks mostly good to me. He

[jira] [Commented] (HDFS-5640) Add snapshot methods to FileContext.

2015-03-19 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369812#comment-14369812 ] Rakesh R commented on HDFS-5640: Test case failure is unrelated to this patch. > Add snaps

[jira] [Commented] (HDFS-7616) Change FSImage to support BlockGroup

2015-03-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369798#comment-14369798 ] Zhe Zhang commented on HDFS-7616: - Thanks for working on this [~tfukudom]. The unit test

[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-19 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369785#comment-14369785 ] Arpit Agarwal commented on HDFS-7824: - Hi [~xyao], could you please rebase the patch fo

  1   2   3   >