[jira] [Updated] (HDFS-5392) Unify the initialization of the hsftp and swebhdfs clients

2013-10-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5392: - Issue Type: Sub-task (was: Bug) Parent: HDFS-5305 > Unify the initialization of the hsftp and swe

[jira] [Updated] (HDFS-5392) Unify the initialization of the hsftp and swebhdfs clients

2013-10-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5392: - Attachment: HDFS-5392.000.patch > Unify the initialization of the hsftp and swebhdfs clients > ---

[jira] [Created] (HDFS-5392) Unify the initialization of the hsftp and swebhdfs clients

2013-10-18 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5392: Summary: Unify the initialization of the hsftp and swebhdfs clients Key: HDFS-5392 URL: https://issues.apache.org/jira/browse/HDFS-5392 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v5.1.patch The jenkins result seems to be mismatch with local env and seems weird. R

[jira] [Updated] (HDFS-3987) Support webhdfs via HTTPS

2013-10-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-3987: - Summary: Support webhdfs via HTTPS (was: add support for encrypted webhdfs) > Support webhdfs via HTTPS >

[jira] [Updated] (HDFS-3987) Support webhdfs over HTTPS

2013-10-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-3987: - Summary: Support webhdfs over HTTPS (was: Support webhdfs via HTTPS) > Support webhdfs over HTTPS > -

[jira] [Assigned] (HDFS-3987) add support for encrypted webhdfs

2013-10-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reassigned HDFS-3987: Assignee: Haohui Mai > add support for encrypted webhdfs > - > >

[jira] [Updated] (HDFS-3987) add support for encrypted webhdfs

2013-10-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-3987: - Issue Type: Sub-task (was: New Feature) Parent: HDFS-5305 > add support for encrypted webhdfs > -

[jira] [Updated] (HDFS-3987) add support for encrypted webhdfs

2013-10-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-3987: - Attachment: HDFS-3987.000.patch Considering the fact that this is closely related to the series of jiras l

[jira] [Created] (HDFS-5391) writeBlock should accept a target storage

2013-10-18 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5391: --- Summary: writeBlock should accept a target storage Key: HDFS-5391 URL: https://issues.apache.org/jira/browse/HDFS-5391 Project: Hadoop HDFS Issue Type: Sub-tas

[jira] [Updated] (HDFS-5391) writeBlock should accept a target storage directory

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5391: Summary: writeBlock should accept a target storage directory (was: writeBlock should accept a targe

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799731#comment-13799731 ] Hadoop QA commented on HDFS-4885: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5347) add HDFS NFS user guide

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799723#comment-13799723 ] Hadoop QA commented on HDFS-5347: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4995) Make getContentSummary() less expensive

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799719#comment-13799719 ] Hadoop QA commented on HDFS-4995: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5378) In CacheReport, don't send genstamp and length on the wire

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5378: --- Attachment: HDFS-5378-caching.004.patch thanks for the review. I renamed the datanode

[jira] [Commented] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799692#comment-13799692 ] Tsuyoshi OZAWA commented on HDFS-5167: -- Thanks for catching up, Akira. [~jingzhao], pl

[jira] [Commented] (HDFS-5276) FileSystem.Statistics got performance issue on multi-thread read/write.

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799689#comment-13799689 ] Hudson commented on HDFS-5276: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4632 (See [https:

[jira] [Updated] (HDFS-5276) FileSystem.Statistics got performance issue on multi-thread read/write.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5276: --- Resolution: Fixed Fix Version/s: 2.3.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799676#comment-13799676 ] Hadoop QA commented on HDFS-5167: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799651#comment-13799651 ] Junping Du commented on HDFS-4885: -- Thanks Nicholas for carefully review. All comments her

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v5.patch > Update verifyBlockPlacement() API in BlockPlacementPolicy > -

[jira] [Updated] (HDFS-5347) add HDFS NFS user guide

2013-10-18 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5347: - Attachment: HDFS-5347.003.patch Thank you, Jing. I've uploaded a new patch to address the comments. > add

[jira] [Commented] (HDFS-5378) In CacheReport, don't send genstamp and length on the wire

2013-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799640#comment-13799640 ] Andrew Wang commented on HDFS-5378: --- Looks mostly good, just a few things: * Need to fix

[jira] [Updated] (HDFS-5377) Heartbeats from Datandode should include one storage report per storage directory

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5377: Summary: Heartbeats from Datandode should include one storage report per storage directory (was: He

[jira] [Updated] (HDFS-5377) Heartbeats from Datandode should include one storage report per storage

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5377: Description: Heartbeats must include one storage report per storage directory, so that usage inform

[jira] [Updated] (HDFS-5377) Heartbeats from Datandode should include one storage report per storage

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5377: Summary: Heartbeats from Datandode should include one storage report per storage (was: Storage usag

[jira] [Updated] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-2832: Summary: Enable support for heterogeneous storages in HDFS (was: Heartbeats from Datandode should i

[jira] [Updated] (HDFS-5390) Incremental block reports should be sent per storage directory

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5390: Summary: Incremental block reports should be sent per storage directory (was: Incremental block rep

[jira] [Updated] (HDFS-5390) Incremental block reports should be sent per storage

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5390: Description: Incremental block reports should be sent per storage directory since the NameNode now

[jira] [Created] (HDFS-5390) Incremental block reports should be sent per storage

2013-10-18 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5390: --- Summary: Incremental block reports should be sent per storage Key: HDFS-5390 URL: https://issues.apache.org/jira/browse/HDFS-5390 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-2832) Heartbeats from Datandode should include one storage report per storage

2013-10-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-2832: Summary: Heartbeats from Datandode should include one storage report per storage (was: Enable suppo

[jira] [Commented] (HDFS-4995) Make getContentSummary() less expensive

2013-10-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799628#comment-13799628 ] Kihwal Lee commented on HDFS-4995: -- I've tested this with 100 threads creating, renaming d

[jira] [Commented] (HDFS-5276) FileSystem.Statistics got performance issue on multi-thread read/write.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799625#comment-13799625 ] Colin Patrick McCabe commented on HDFS-5276: I ran mvn eclipse:eclipse locally

[jira] [Updated] (HDFS-4995) Make getContentSummary() less expensive

2013-10-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4995: - Attachment: HDFS-4995.trunk.patch The new patch moves the lock yield code to the context object. This is b

[jira] [Updated] (HDFS-5320) Add datanode caching metrics

2013-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5320: -- Attachment: hdfs-5320-2.patch Here's a new rebased patch, minus the cache report rename since I think it

[jira] [Assigned] (HDFS-5180) Add time taken to process the command to audit log

2013-10-18 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita reassigned HDFS-5180: Assignee: Shinichi Yamashita > Add time taken to process the command to audit log >

[jira] [Commented] (HDFS-5326) add modifyDirective to cacheAdmin

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799606#comment-13799606 ] Colin Patrick McCabe commented on HDFS-5326: I took a whack at this this mornin

[jira] [Commented] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799595#comment-13799595 ] Chris Nauroth commented on HDFS-5203: - Thanks for the code review, Colin. > Concurrent

[jira] [Updated] (HDFS-5378) In CacheReport, don't send genstamp and length on the wire

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5378: --- Attachment: HDFS-5378-caching.003.patch rebased > In CacheReport, don't send genstamp

[jira] [Commented] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799584#comment-13799584 ] Colin Patrick McCabe commented on HDFS-5203: +1, thanks Chris > Concurrent cli

[jira] [Resolved] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5203. Resolution: Fixed Fix Version/s: HDFS-4949 > Concurrent clients that add a ca

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799572#comment-13799572 ] Tsz Wo (Nicholas), SZE commented on HDFS-4885: -- - In BlockPlacementStatusDefa

[jira] [Commented] (HDFS-5378) In CacheReport, don't send genstamp and length on the wire

2013-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799565#comment-13799565 ] Andrew Wang commented on HDFS-5378: --- Hey Colin, could you rebase this one? Doesn't apply

[jira] [Updated] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5203: Attachment: HDFS-5203.3.patch Here is patch version 3, which adds tests. There is no difference in

[jira] [Updated] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5167: Attachment: HDFS-5167.8.patch Attaching the revised patch. > Add metrics about the NameNode retry c

[jira] [Commented] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799536#comment-13799536 ] Akira AJISAKA commented on HDFS-5167: - Thanks for taking this issue, [~ozawa]. I built

[jira] [Commented] (HDFS-5389) Remove INode limitations in Namenode

2013-10-18 Thread Lin Xiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799525#comment-13799525 ] Lin Xiao commented on HDFS-5389: One design to remove the space limits while maintain simi

[jira] [Created] (HDFS-5389) Remove INode limitations in Namenode

2013-10-18 Thread Lin Xiao (JIRA)
Lin Xiao created HDFS-5389: -- Summary: Remove INode limitations in Namenode Key: HDFS-5389 URL: https://issues.apache.org/jira/browse/HDFS-5389 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799521#comment-13799521 ] Hadoop QA commented on HDFS-4885: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5347) add HDFS NFS user guide

2013-10-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799509#comment-13799509 ] Jing Zhao commented on HDFS-5347: - The document looks great. Some minors and nits: # "uses"

[jira] [Updated] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5203: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-4949 > Concurrent clients that a

[jira] [Commented] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799497#comment-13799497 ] Colin Patrick McCabe commented on HDFS-5203: It looks good. The only thing mis

[jira] [Commented] (HDFS-5382) Implement the UI of browsing filesystems in HTML 5 page

2013-10-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799496#comment-13799496 ] Jing Zhao commented on HDFS-5382: - bq. Safari, however, still blocks this request, breaking

[jira] [Commented] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799486#comment-13799486 ] Chris Nauroth commented on HDFS-5203: - I also meant to mention that I discovered a bug

[jira] [Updated] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5203: Attachment: HDFS-5203.2.patch bq. We got rid of the batch operations because they were a big headach

[jira] [Commented] (HDFS-2261) AOP unit tests are not getting compiled or run

2013-10-18 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799481#comment-13799481 ] Karthik Kambatla commented on HDFS-2261: Just checking again if we have a decision

[jira] [Commented] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799480#comment-13799480 ] Chris Nauroth commented on HDFS-5388: - Thanks for committing, Colin. > Loading fsimage

[jira] [Updated] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5388: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-4949 > Loading fsimage fails to

[jira] [Resolved] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5388. Resolution: Fixed Fix Version/s: HDFS-4949 > Loading fsimage fails to find ca

[jira] [Commented] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799473#comment-13799473 ] Colin Patrick McCabe commented on HDFS-5388: +1. thanks, Chris > Loading fsim

[jira] [Commented] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799422#comment-13799422 ] Colin Patrick McCabe commented on HDFS-5203: Thanks for tackling this, Chris.

[jira] [Updated] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5203: Attachment: HDFS-5203.1.patch I'm attaching a preliminary patch. I've tested this manually. This i

[jira] [Updated] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4885: - Attachment: HDFS-4885-v4.patch Address above review comments in v4 patch. > Update verifyBlockPlacement()

[jira] [Commented] (HDFS-4376) Fix several race conditions in Balancer and resolve intermittent timeout of TestBalancerWithNodeGroup

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799402#comment-13799402 ] Junping Du commented on HDFS-4376: -- Hi [~sureshms], In our offline meet yesterday, you men

[jira] [Updated] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5388: Attachment: HDFS-5388.1.patch I just noticed the problem this morning after my namenode did a checkp

[jira] [Work started] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5388 started by Chris Nauroth. > Loading fsimage fails to find cache pools during namenode startup. >

[jira] [Created] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

2013-10-18 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5388: --- Summary: Loading fsimage fails to find cache pools during namenode startup. Key: HDFS-5388 URL: https://issues.apache.org/jira/browse/HDFS-5388 Project: Hadoop HDFS

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799381#comment-13799381 ] Junping Du commented on HDFS-4885: -- Sorry. the return value should be changed to BlockPlac

[jira] [Commented] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799377#comment-13799377 ] Hudson commented on HDFS-5365: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4629 (See [https:

[jira] [Resolved] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5365. - Resolution: Fixed Fix Version/s: (was: 2.3.0) 2.2.1 I've merged this

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799358#comment-13799358 ] Junping Du commented on HDFS-4885: -- Thanks Luke and Nicholas for comments! bq. More detail

[jira] [Assigned] (HDFS-5386) Add feature documentation for datanode caching.

2013-10-18 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-5386: - Assignee: Andrew Wang > Add feature documentation for datanode caching. >

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799334#comment-13799334 ] Tsz Wo (Nicholas), SZE commented on HDFS-4885: -- > Nicholas suggested offline t

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-10-18 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799324#comment-13799324 ] Luke Lu commented on HDFS-4885: --- Nicholas suggested offline that we simply pass in the replic

[jira] [Updated] (HDFS-5387) Documentation on FileSystem.createNewFile() is misleading

2013-10-18 Thread Leif Wickland (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leif Wickland updated HDFS-5387: Description: The documentation for FileSystem.createNewFile() indicates that it will return false i

[jira] [Updated] (HDFS-5387) Documentation on FileSystem.createNewFile() is misleading

2013-10-18 Thread Leif Wickland (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leif Wickland updated HDFS-5387: Description: The documentation for FileSystem.createNewFile() indicates that it will return false i

[jira] [Created] (HDFS-5387) Documentation on FileSystem.createNewFile() is misleading

2013-10-18 Thread Leif Wickland (JIRA)
Leif Wickland created HDFS-5387: --- Summary: Documentation on FileSystem.createNewFile() is misleading Key: HDFS-5387 URL: https://issues.apache.org/jira/browse/HDFS-5387 Project: Hadoop HDFS Iss

[jira] [Updated] (HDFS-5387) Documentation on FileSystem.createNewFile() is misleading

2013-10-18 Thread Leif Wickland (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leif Wickland updated HDFS-5387: Attachment: FileSystem.java.patch Here's my suggested change to the document's wording. > Documenta

[jira] [Updated] (HDFS-4511) Cover package org.apache.hadoop.hdfs.tools with unit test

2013-10-18 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated HDFS-4511: -- Resolution: Fixed Fix Version/s: 2.3.0 3.0.0 Status: Resolve

[jira] [Updated] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5365: Target Version/s: 3.0.0, 2.2.1 (was: 3.0.0, 2.3.0) > Fix libhdfs compile error on FreeBSD9 > --

[jira] [Reopened] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened HDFS-5365: - bq. can be this merged to branch-2.1-beta ? branch-2.1-beta is closed. Now that release 2.2.0 is GA,

[jira] [Created] (HDFS-5386) Add feature documentation for datanode caching.

2013-10-18 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5386: --- Summary: Add feature documentation for datanode caching. Key: HDFS-5386 URL: https://issues.apache.org/jira/browse/HDFS-5386 Project: Hadoop HDFS Issue Type: I

[jira] [Commented] (HDFS-5336) DataNode should not output 'StartupProgress' metrics

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799093#comment-13799093 ] Hudson commented on HDFS-5336: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1582 (See [htt

[jira] [Commented] (HDFS-5374) Remove deadcode in DFSOutputStream

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799090#comment-13799090 ] Hudson commented on HDFS-5374: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1582 (See [htt

[jira] [Commented] (HDFS-5375) hdfs.cmd does not expose several snapshot commands.

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799089#comment-13799089 ] Hudson commented on HDFS-5375: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1582 (See [htt

[jira] [Commented] (HDFS-5379) Update links to datanode information in dfshealth.html

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799091#comment-13799091 ] Hudson commented on HDFS-5379: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1582 (See [htt

[jira] [Commented] (HDFS-4511) Cover package org.apache.hadoop.hdfs.tools with unit test

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799092#comment-13799092 ] Hudson commented on HDFS-4511: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1582 (See [htt

[jira] [Commented] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799095#comment-13799095 ] Hudson commented on HDFS-5365: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1582 (See [htt

[jira] [Commented] (HDFS-4311) repair test org.apache.hadoop.fs.http.server.TestHttpFSWithKerberos

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799083#comment-13799083 ] Hadoop QA commented on HDFS-4311: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4311) repair test org.apache.hadoop.fs.http.server.TestHttpFSWithKerberos

2013-10-18 Thread Ivan A. Veselovsky (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan A. Veselovsky updated HDFS-4311: - Attachment: HDFS-4311--N1.patch Test rewritten to use MiniKdc. > repair test org.apache.h

[jira] [Commented] (HDFS-5167) Add metrics about the NameNode retry cache

2013-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799038#comment-13799038 ] Hadoop QA commented on HDFS-5167: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5375) hdfs.cmd does not expose several snapshot commands.

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799030#comment-13799030 ] Hudson commented on HDFS-5375: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1556 (See [https://

[jira] [Commented] (HDFS-5336) DataNode should not output 'StartupProgress' metrics

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799034#comment-13799034 ] Hudson commented on HDFS-5336: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1556 (See [https://

[jira] [Commented] (HDFS-5374) Remove deadcode in DFSOutputStream

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799031#comment-13799031 ] Hudson commented on HDFS-5374: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1556 (See [https://

[jira] [Commented] (HDFS-5365) Fix libhdfs compile error on FreeBSD9

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799036#comment-13799036 ] Hudson commented on HDFS-5365: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1556 (See [https://

[jira] [Commented] (HDFS-4511) Cover package org.apache.hadoop.hdfs.tools with unit test

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799033#comment-13799033 ] Hudson commented on HDFS-4511: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1556 (See [https://

[jira] [Commented] (HDFS-5379) Update links to datanode information in dfshealth.html

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799032#comment-13799032 ] Hudson commented on HDFS-5379: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1556 (See [https://

[jira] [Commented] (HDFS-5239) Allow FSNamesystem lock fairness to be configurable

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799029#comment-13799029 ] Hudson commented on HDFS-5239: -- FAILURE: Integrated in Hadoop-Hdfs-0.23-Build #764 (See [http

[jira] [Commented] (HDFS-5375) hdfs.cmd does not expose several snapshot commands.

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799003#comment-13799003 ] Hudson commented on HDFS-5375: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #366 (See [https://b

[jira] [Commented] (HDFS-5379) Update links to datanode information in dfshealth.html

2013-10-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799005#comment-13799005 ] Hudson commented on HDFS-5379: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #366 (See [https://b

  1   2   >