[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152875#comment-14152875 ] Konstantin Shvachko commented on HDFS-3107: --- Thanks Dhruba and Colin for your rev

[jira] [Commented] (HDFS-7162) Wrong path when deleting through fuse-dfs a file which already exists in trash

2014-09-29 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152832#comment-14152832 ] Chengbing Liu commented on HDFS-7162: - [~cmccabe] Simply adding a slash at the end of {

[jira] [Updated] (HDFS-7162) Wrong path when deleting through fuse-dfs a file which already exists in trash

2014-09-29 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated HDFS-7162: Attachment: HDFS-7162.2.patch Updated patch. Now it handles the following abs_path: - /user/yourname

[jira] [Assigned] (HDFS-7170) DFSOutputStream should query policies from NameNode

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-7170: --- Assignee: Arpit Agarwal > DFSOutputStream should query policies from NameNode > --

[jira] [Comment Edited] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152822#comment-14152822 ] Arpit Agarwal edited comment on HDFS-7159 at 9/30/14 5:40 AM: --

[jira] [Resolved] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7159. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks a lot for revi

[jira] [Created] (HDFS-7170) DFSOutputStream should query policies from NameNode

2014-09-29 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-7170: --- Summary: DFSOutputStream should query policies from NameNode Key: HDFS-7170 URL: https://issues.apache.org/jira/browse/HDFS-7170 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152810#comment-14152810 ] Jing Zhao commented on HDFS-7159: - bq. Would it be okay if we fixed it separately? Sure. +

[jira] [Commented] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152795#comment-14152795 ] Chris Nauroth commented on HDFS-7129: - Thanks for incorporating the feedback, Xiaoyu.

[jira] [Commented] (HDFS-6904) YARN unable to renew delegation token fetched via webhdfs due to incorrect service port

2014-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152784#comment-14152784 ] Hadoop QA commented on HDFS-6904: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7154) Fix returning value of starting reconfiguration task

2014-09-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7154: Attachment: HDFS-7154.001.patch [~cmccabe] Thanks for your reviews. I've changed all error values of

[jira] [Updated] (HDFS-7169) Fix a findbugs warning in ReplaceDatanodeOnFailure

2014-09-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7169: -- Status: Patch Available (was: Open) > Fix a findbugs warning in ReplaceDatanodeOnFailure

[jira] [Updated] (HDFS-7169) Fix a findbugs warning in ReplaceDatanodeOnFailure

2014-09-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7169: -- Attachment: h7169_20140930.patch The findbugs warning is a false positive since we do not

[jira] [Created] (HDFS-7169) Fix a findbugs warning in ReplaceDatanodeOnFailure

2014-09-29 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7169: - Summary: Fix a findbugs warning in ReplaceDatanodeOnFailure Key: HDFS-7169 URL: https://issues.apache.org/jira/browse/HDFS-7169 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6904) YARN unable to renew delegation token fetched via webhdfs due to incorrect service port

2014-09-29 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152742#comment-14152742 ] Jitendra Nath Pandey commented on HDFS-6904: Attached patch addresses [~jingzha

[jira] [Updated] (HDFS-7167) NPE while running Mover if the given path is for a file

2014-09-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7167: -- Hadoop Flags: Reviewed +1 patch looks good. Thanks for fixing it! > NPE while running M

[jira] [Updated] (HDFS-6904) YARN unable to renew delegation token fetched via webhdfs due to incorrect service port

2014-09-29 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-6904: --- Attachment: HDFS-6904.4.patch > YARN unable to renew delegation token fetched via webhd

[jira] [Updated] (HDFS-6904) YARN unable to renew delegation token fetched via webhdfs due to incorrect service port

2014-09-29 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-6904: --- Status: Patch Available (was: Open) > YARN unable to renew delegation token fetched vi

[jira] [Updated] (HDFS-6904) YARN unable to renew delegation token fetched via webhdfs due to incorrect service port

2014-09-29 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-6904: --- Status: Open (was: Patch Available) > YARN unable to renew delegation token fetched vi

[jira] [Updated] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7159: Attachment: HDFS-7159.04.patch > Use block storage policy to set lazy persist preference > --

[jira] [Updated] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7159: Attachment: (was: HDFS-7159.04.patch) > Use block storage policy to set lazy persist preference >

[jira] [Updated] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7159: Attachment: HDFS-7159.04.patch Thank you for the review Jing. bq. Nit: the instanciation of lpPolicy

[jira] [Commented] (HDFS-7167) NPE while running Mover if the given path is for a file

2014-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152670#comment-14152670 ] Hadoop QA commented on HDFS-7167: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6779) Add missing version subcommand for hdfs

2014-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6779: - Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-7168) Use excludedNodes consistently in DFSOutputStream

2014-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152659#comment-14152659 ] Hadoop QA commented on HDFS-7168: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6779) Add missing version subcommand for hdfs

2014-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152647#comment-14152647 ] Hudson commented on HDFS-6779: -- FAILURE: Integrated in Hadoop-trunk-Commit #6149 (See [https:

[jira] [Updated] (HDFS-6779) Add missing version subcommand for hdfs

2014-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6779: - Summary: Add missing version subcommand for hdfs (was: hdfs version subcommand is missing) > Add missing

[jira] [Updated] (HDFS-6779) Add missing version subcommand for hdfs

2014-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6779: - Priority: Minor (was: Major) > Add missing version subcommand for hdfs > -

[jira] [Commented] (HDFS-6779) hdfs version subcommand is missing

2014-09-29 Thread Sasaki Toru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152624#comment-14152624 ] Sasaki Toru commented on HDFS-6779: --- Thanks, [~wheat9] and [~aw] ! It looks good to me.

[jira] [Updated] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7129: - Attachment: HDFS-7129.2.patch Update the patch based on the feedback. > Metrics to track usage of memory f

[jira] [Commented] (HDFS-7166) SbNN Web UI shows #Under replicated blocks and #pending deletion blocks

2014-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152583#comment-14152583 ] Haohui Mai commented on HDFS-7166: -- My bad, I though you meant secondary NN. Thanks for th

[jira] [Commented] (HDFS-7166) SbNN Web UI shows #Under replicated blocks and #pending deletion blocks

2014-09-29 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152578#comment-14152578 ] Juan Yu commented on HDFS-7166: --- they are in {{hadoop-hdfs-project/hadoop-hdfs/src/main/weba

[jira] [Commented] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152571#comment-14152571 ] Arpit Agarwal commented on HDFS-7159: - bq. Sound good. What will happen if a user creat

[jira] [Commented] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152567#comment-14152567 ] Jing Zhao commented on HDFS-7159: - Thanks for working on this, Arpit! Some minor/nitty comm

[jira] [Updated] (HDFS-7168) Use excludedNodes consistently in DFSOutputStream

2014-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7168: --- Target Version/s: 2.7.0 Affects Version/s: 2.7.0 Status: Patch Avail

[jira] [Commented] (HDFS-7166) SbNN Web UI shows #Under replicated blocks and #pending deletion blocks

2014-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152561#comment-14152561 ] Haohui Mai commented on HDFS-7166: -- Does the information show up on the new Web UI? Just c

[jira] [Updated] (HDFS-7168) Use excludedNodes consistently in DFSOutputStream

2014-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7168: --- Attachment: HDFS-7168.001.patch > Use excludedNodes consistently in DFSOutputStream > -

[jira] [Commented] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152557#comment-14152557 ] Tsz Wo Nicholas Sze commented on HDFS-7159: --- bq. For now the feature will not be

[jira] [Created] (HDFS-7168) Use excludedNodes consistently in DFSOutputStream

2014-09-29 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7168: -- Summary: Use excludedNodes consistently in DFSOutputStream Key: HDFS-7168 URL: https://issues.apache.org/jira/browse/HDFS-7168 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6779) hdfs version subcommand is missing

2014-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152555#comment-14152555 ] Haohui Mai commented on HDFS-6779: -- [~sasakitoa], based on your patch I made trivial chang

[jira] [Commented] (HDFS-6779) hdfs version subcommand is missing

2014-09-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152554#comment-14152554 ] Allen Wittenauer commented on HDFS-6779: Better. ty. :) +1 > hdfs version subcomma

[jira] [Updated] (HDFS-6779) hdfs version subcommand is missing

2014-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6779: - Attachment: HDFS-6779.003.patch > hdfs version subcommand is missing > -- >

[jira] [Updated] (HDFS-6779) hdfs version subcommand is missing

2014-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6779: - Assignee: Sasaki Toru > hdfs version subcommand is missing > -- > >

[jira] [Commented] (HDFS-6779) hdfs version subcommand is missing

2014-09-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152549#comment-14152549 ] Allen Wittenauer commented on HDFS-6779: The usage and case statement should really

[jira] [Commented] (HDFS-6779) hdfs version subcommand is missing

2014-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152536#comment-14152536 ] Haohui Mai commented on HDFS-6779: -- The test failures are unrelated. +1. I'll commit it sh

[jira] [Commented] (HDFS-7146) NFS ID/Group lookup requires SSSD enumeration on the server

2014-09-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152479#comment-14152479 ] Yongjun Zhang commented on HDFS-7146: - BTW, thanks [~j...@cloudera.com] a lot for testi

[jira] [Updated] (HDFS-7146) NFS ID/Group lookup requires SSSD enumeration on the server

2014-09-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7146: Status: Patch Available (was: Open) Hi [~aw] and [~brandonli], Thanks a lot for the info you guys p

[jira] [Commented] (HDFS-7147) Update archival storage user documentation

2014-09-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152462#comment-14152462 ] Jing Zhao commented on HDFS-7147: - Thanks for updating the documentation, Nicholas! Beside

[jira] [Updated] (HDFS-7146) NFS ID/Group lookup requires SSSD enumeration on the server

2014-09-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7146: Attachment: HDFS-7146.001.patch > NFS ID/Group lookup requires SSSD enumeration on the server > -

[jira] [Commented] (HDFS-6982) nntop: topĀ­-like tool for name node users

2014-09-29 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152457#comment-14152457 ] Maysam Yabandeh commented on HDFS-6982: --- Should we proceed with the current patch the

[jira] [Updated] (HDFS-7167) NPE while running Mover if the given path is for a file

2014-09-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7167: Status: Patch Available (was: Open) > NPE while running Mover if the given path is for a file >

[jira] [Updated] (HDFS-6894) Add XDR parser method for each NFS response

2014-09-29 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6894: - Attachment: HDFS-6894.001.patch Upload the patch again to trigger the build. The patch applies to trunk wit

[jira] [Updated] (HDFS-7167) NPE while running Mover if the given path is for a file

2014-09-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7167: Attachment: HDFS-7167.000.patch Upload a patch to fix. We should always call {{listPaths}} to make sure the

[jira] [Updated] (HDFS-7167) NPE while running Mover if the given path is for a file

2014-09-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7167: Reporter: Prabushankar Chinnasamy (was: Jing Zhao) > NPE while running Mover if the given path is for a file

[jira] [Created] (HDFS-7167) NPE while running Mover if the given path is for a file

2014-09-29 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7167: --- Summary: NPE while running Mover if the given path is for a file Key: HDFS-7167 URL: https://issues.apache.org/jira/browse/HDFS-7167 Project: Hadoop HDFS Issue Type: B

[jira] [Commented] (HDFS-7122) Use of ThreadLocal results in poor block placement

2014-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152374#comment-14152374 ] Hudson commented on HDFS-7122: -- FAILURE: Integrated in Hadoop-trunk-Commit #6147 (See [https:

[jira] [Updated] (HDFS-7122) Use of ThreadLocal results in poor block placement

2014-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7122: -- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch Available) I've co

[jira] [Updated] (HDFS-7122) Use of ThreadLocal results in poor block placement

2014-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7122: -- Summary: Use of ThreadLocal results in poor block placement (was: Very poor distribution of replication

[jira] [Commented] (HDFS-7122) Very poor distribution of replication copies

2014-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152353#comment-14152353 ] Andrew Wang commented on HDFS-7122: --- The javadoc warnings look unrelated. The patchproces

[jira] [Assigned] (HDFS-7165) Separate block metrics for files with replication count 1

2014-09-29 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HDFS-7165: --- Assignee: Zhe Zhang > Separate block metrics for files with replication count 1 >

[jira] [Moved] (HDFS-7166) SbNN Web UI shows #Under replicated blocks and #pending deletion blocks

2014-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang moved HADOOP-11076 to HDFS-7166: Component/s: (was: ha) ha Key: HDFS-7166 (w

[jira] [Commented] (HDFS-7122) Very poor distribution of replication copies

2014-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152333#comment-14152333 ] Hadoop QA commented on HDFS-7122: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7055) Add tracing to DFSInputStream

2014-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152334#comment-14152334 ] Hadoop QA commented on HDFS-7055: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7165) Separate block metrics for files with replication count 1

2014-09-29 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-7165: - Summary: Separate block metrics for files with replication count 1 Key: HDFS-7165 URL: https://issues.apache.org/jira/browse/HDFS-7165 Project: Hadoop HDFS Issue T

[jira] [Commented] (HDFS-7124) Remove EncryptionZoneManager.NULL_EZ

2014-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152319#comment-14152319 ] Hudson commented on HDFS-7124: -- FAILURE: Integrated in Hadoop-trunk-Commit #6145 (See [https:

[jira] [Updated] (HDFS-7124) Remove EncryptionZoneManager.NULL_EZ

2014-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7124: -- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152239#comment-14152239 ] Xiaoyu Yao commented on HDFS-7129: -- Thanks [~cnauroth] for the review. Good catch on 1!

[jira] [Commented] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152230#comment-14152230 ] Xiaoyu Yao commented on HDFS-7129: -- Thanks [~arpitagarwal] for the review. We should not

[jira] [Commented] (HDFS-6919) Enforce a single limit for RAM disk usage and replicas cached via locking

2014-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152218#comment-14152218 ] Colin Patrick McCabe commented on HDFS-6919: I like the idea of using the cache

[jira] [Commented] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152215#comment-14152215 ] Chris Nauroth commented on HDFS-7129: - Nice work, Xiaoyu. Just a couple more comments

[jira] [Commented] (HDFS-7157) Using Time.now() for recording start/end time of reconfiguration tasks

2014-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152213#comment-14152213 ] Hudson commented on HDFS-7157: -- FAILURE: Integrated in Hadoop-trunk-Commit #6144 (See [https:

[jira] [Commented] (HDFS-7104) Fix and clarify INodeInPath getter functions

2014-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152197#comment-14152197 ] Hudson commented on HDFS-7104: -- FAILURE: Integrated in Hadoop-trunk-Commit #6143 (See [https:

[jira] [Updated] (HDFS-7104) Fix and clarify INodeInPath getter functions

2014-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7104: -- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch Available) Committ

[jira] [Commented] (HDFS-6904) YARN unable to renew delegation token fetched via webhdfs due to incorrect service port

2014-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152170#comment-14152170 ] Hadoop QA commented on HDFS-6904: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7154) Fix returning value of starting reconfiguration task

2014-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152169#comment-14152169 ] Colin Patrick McCabe commented on HDFS-7154: Please don't return "-1 " from a p

[jira] [Commented] (HDFS-7104) Fix and clarify INodeInPath getter functions

2014-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152168#comment-14152168 ] Andrew Wang commented on HDFS-7104: --- Alright cool, I'll commit this shortly. Thanks Jing

[jira] [Commented] (HDFS-7011) Implement basic utilities for libhdfs3

2014-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152164#comment-14152164 ] Colin Patrick McCabe commented on HDFS-7011: I don't see anything wrong with us

[jira] [Resolved] (HDFS-7153) Add storagePolicy to NN edit log during file creation

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7153. - Resolution: Fixed Fix Version/s: HDFS-6581 Target Version/s: (was: 2.6.0)

[jira] [Created] (HDFS-7164) Feature documentation for HDFS-6581

2014-09-29 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-7164: --- Summary: Feature documentation for HDFS-6581 Key: HDFS-7164 URL: https://issues.apache.org/jira/browse/HDFS-7164 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7159: Attachment: HDFS-7159.03.patch Also add check for null policy in DFSOutputStream and {{appendFileInte

[jira] [Updated] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7159: Attachment: (was: HDFS-7159.03.patch) > Use block storage policy to set lazy persist preference >

[jira] [Updated] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7159: Attachment: HDFS-7159.03.patch > Use block storage policy to set lazy persist preference > --

[jira] [Commented] (HDFS-7104) Fix and clarify INodeInPath getter functions

2014-09-29 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152095#comment-14152095 ] Zhe Zhang commented on HDFS-7104: - [~jingzhao] Thank you for reviewing! I did a quick che

[jira] [Commented] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152104#comment-14152104 ] Arpit Agarwal commented on HDFS-7159: - Nicholas, updated patch to address your comments

[jira] [Updated] (HDFS-7159) Use block storage policy to set lazy persist preference

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7159: Attachment: HDFS-7159.02.patch > Use block storage policy to set lazy persist preference > --

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152094#comment-14152094 ] Colin Patrick McCabe commented on HDFS-3107: Thanks for waiting. I'm checking

[jira] [Commented] (HDFS-7122) Very poor distribution of replication copies

2014-09-29 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152052#comment-14152052 ] Luke Lu commented on HDFS-7122: --- Created HADOOP-11152 to track the investigation of a better

[jira] [Commented] (HDFS-6904) YARN unable to renew delegation token fetched via webhdfs due to incorrect service port

2014-09-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152048#comment-14152048 ] Jing Zhao commented on HDFS-6904: - The latest patch looks good to me. Some minor comments:

[jira] [Updated] (HDFS-7055) Add tracing to DFSInputStream

2014-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7055: --- Attachment: HDFS-7055.004.patch Rebasing on trunk. > Add tracing to DFSInputStream > -

[jira] [Commented] (HDFS-7104) Fix and clarify INodeInPath getter functions

2014-09-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152030#comment-14152030 ] Jing Zhao commented on HDFS-7104: - Sorry I forgot to +1 for the latest patch.. Here is my +

[jira] [Commented] (HDFS-7157) Using Time.now() for recording start/end time of reconfiguration tasks

2014-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152024#comment-14152024 ] Hudson commented on HDFS-7157: -- FAILURE: Integrated in Hadoop-trunk-Commit #6142 (See [https:

[jira] [Updated] (HDFS-7157) Using Time.now() for recording start/end time of reconfiguration tasks

2014-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7157: --- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-7157) Using Time.now() for recording start/end time of reconfiguration tasks

2014-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152021#comment-14152021 ] Colin Patrick McCabe commented on HDFS-7157: +1. The Jenkins stuff is unrelate

[jira] [Commented] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152017#comment-14152017 ] Arpit Agarwal commented on HDFS-7129: - Hi Xiaoyu, thanks for taking up this task! Nice

[jira] [Commented] (HDFS-6971) Bounded staleness of EDEK caches on the NN

2014-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152013#comment-14152013 ] Andrew Wang commented on HDFS-6971: --- Yea, what we'd need here is {{expireAfterWrite}} as

[jira] [Commented] (HDFS-7162) Wrong path when deleting through fuse-dfs a file which already exists in trash

2014-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152010#comment-14152010 ] Colin Patrick McCabe commented on HDFS-7162: Good find. Rather than doing as t

[jira] [Commented] (HDFS-7104) Fix and clarify INodeInPath getter functions

2014-09-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152006#comment-14152006 ] Andrew Wang commented on HDFS-7104: --- Hey Jing, do you want to take care of the final +1/c

[jira] [Commented] (HDFS-7122) Very poor distribution of replication copies

2014-09-29 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151998#comment-14151998 ] Luke Lu commented on HDFS-7122: --- Looks like a straight-forward revert of the ThreadLocal rand

[jira] [Updated] (HDFS-7122) Very poor distribution of replication copies

2014-09-29 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated HDFS-7122: -- Status: Patch Available (was: Open) > Very poor distribution of replication copies > ---

[jira] [Commented] (HDFS-4165) Faulty sanity check in FsDirectory.unprotectedSetQuota

2014-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151982#comment-14151982 ] Hudson commented on HDFS-4165: -- FAILURE: Integrated in Hadoop-trunk-Commit #6140 (See [https:

  1   2   >