[jira] [Assigned] (HDFS-1148) Convert FSDataset to ReadWriteLock

2015-07-21 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yong Zhang reassigned HDFS-1148: Assignee: Yong Zhang (was: Dave Thompson) > Convert FSDataset to ReadWriteLock > --

[jira] [Assigned] (HDFS-3767) Finer grained locking in DN

2015-07-21 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yong Zhang reassigned HDFS-3767: Assignee: Yong Zhang > Finer grained locking in DN > --- > >

[jira] [Commented] (HDFS-8795) Improve InvalidateBlocks#node2blocks

2015-07-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636380#comment-14636380 ] Vinayakumar B commented on HDFS-8795: - +1 > Improve InvalidateBlocks#node2blocks > ---

[jira] [Updated] (HDFS-7541) Upgrade Domains in HDFS

2015-07-21 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7541: -- Attachment: UpgradeDomains_Design_v3.pdf Thanks [~eddyxu]! These are very good points. Here is the updated design

[jira] [Updated] (HDFS-3570) Balancer shouldn't rely on "DFS Space Used %" as that ignores non-DFS used space

2015-07-21 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-3570: Attachment: HDFS-3570.003.patch Rebased for the latest trunk. (without test) > Balancer shouldn't re

[jira] [Updated] (HDFS-8803) Move DfsClientConf to hdfs-client

2015-07-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8803: - Attachment: (was: HDFS-8803.001.patch) > Move DfsClientConf to hdfs-client > --

[jira] [Updated] (HDFS-8803) Move DfsClientConf to hdfs-client

2015-07-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8803: - Attachment: HDFS-8803.001.patch > Move DfsClientConf to hdfs-client > - > >

[jira] [Updated] (HDFS-8803) Move DfsClientConf to hdfs-client

2015-07-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8803: - Attachment: HDFS-8803.001.patch > Move DfsClientConf to hdfs-client > - > >

[jira] [Commented] (HDFS-8753) Ozone: Unify StorageContainerConfiguration with ozone-default.xml & ozone-site.xml

2015-07-21 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636355#comment-14636355 ] kanaka kumar avvaru commented on HDFS-8753: --- Thanks for firing new build [~anu],

[jira] [Commented] (HDFS-8730) Clean up the import statements in ClientProtocol

2015-07-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636345#comment-14636345 ] Haohui Mai commented on HDFS-8730: -- Sounds good to me. Please go ahead and submit a patch.

[jira] [Commented] (HDFS-8202) Improve end to end stirpping file test to add erasure recovering test

2015-07-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636340#comment-14636340 ] Zhe Zhang commented on HDFS-8202: - Thanks for the work Xinwei! The patch looks good overal

[jira] [Assigned] (HDFS-8802) dfs.checksum.type is not described in hdfs-default.xml

2015-07-21 Thread Gururaj Shetty (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gururaj Shetty reassigned HDFS-8802: Assignee: Gururaj Shetty > dfs.checksum.type is not described in hdfs-default.xml >

[jira] [Commented] (HDFS-8495) Consolidate append() related implementation into a single class

2015-07-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636326#comment-14636326 ] Rakesh R commented on HDFS-8495: Thank you [~vinayrpet] for the reviews. Thank you [~wheat9

[jira] [Commented] (HDFS-3570) Balancer shouldn't rely on "DFS Space Used %" as that ignores non-DFS used space

2015-07-21 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636317#comment-14636317 ] Akira AJISAKA commented on HDFS-3570: - Thanks [~anu] for the comment. bq. I see we are

[jira] [Commented] (HDFS-7877) Support maintenance state for datanodes

2015-07-21 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636255#comment-14636255 ] Joep Rottinghuis commented on HDFS-7877: What do we need to do to get this going (a

[jira] [Commented] (HDFS-8730) Clean up the import statements in ClientProtocol

2015-07-21 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636227#comment-14636227 ] Takanobu Asanuma commented on HDFS-8730: The warnings in {{ClientProtocol}} are "Un

[jira] [Commented] (HDFS-8803) Move DfsClientConf to hdfs-client

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636172#comment-14636172 ] Hadoop QA commented on HDFS-8803: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8797) WebHdfsFileSystem creates too many connections for pread

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636151#comment-14636151 ] Hadoop QA commented on HDFS-8797: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8797) WebHdfsFileSystem creates too many connections for pread

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636130#comment-14636130 ] Hadoop QA commented on HDFS-8797: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8781) Erasure Coding: Correctly handle BlockManager#InvalidateBlocks for striped block

2015-07-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636127#comment-14636127 ] Yi Liu commented on HDFS-8781: -- Thanks Jing! > Erasure Coding: Correctly handle BlockManager#

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636120#comment-14636120 ] Hadoop QA commented on HDFS-6763: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Resolved] (HDFS-8483) Erasure coding: test DataNode reporting bad/corrupted blocks which belongs to a striped block.

2015-07-21 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-8483. Resolution: Fixed I closed the jira. Thanks for all your help, Jing, Walter and Zhe! > Erasu

[jira] [Commented] (HDFS-8483) Erasure coding: test DataNode reporting bad/corrupted blocks which belongs to a striped block.

2015-07-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636093#comment-14636093 ] Walter Su commented on HDFS-8483: - Thanks [~tasanuma0829] for taking care of this issue. Su

[jira] [Commented] (HDFS-8483) Erasure coding: test DataNode reporting bad/corrupted blocks which belongs to a striped block.

2015-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636091#comment-14636091 ] Jing Zhao commented on HDFS-8483: - Yeah, sure. Please feel free to close the jira. Thanks f

[jira] [Commented] (HDFS-8483) Erasure coding: test DataNode reporting bad/corrupted blocks which belongs to a striped block.

2015-07-21 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636088#comment-14636088 ] Takanobu Asanuma commented on HDFS-8483: OK, no problem at all. Thanks for your wor

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2015-07-21 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636081#comment-14636081 ] Masatake Iwasaki commented on HDFS-8344: Thanks for the update, [~raviprak]. I'm c

[jira] [Updated] (HDFS-8804) Erasure Coding: use DirectBufferPool in DFSStripedInputStream for buffer allocation

2015-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8804: Attachment: HDFS-8804.000.patch Upload the initial patch. > Erasure Coding: use DirectBufferPool in DFSStrip

[jira] [Created] (HDFS-8804) Erasure Coding: use DirectBufferPool in DFSStripedInputStream for buffer allocation

2015-07-21 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-8804: --- Summary: Erasure Coding: use DirectBufferPool in DFSStripedInputStream for buffer allocation Key: HDFS-8804 URL: https://issues.apache.org/jira/browse/HDFS-8804 Project: Hadoop

[jira] [Commented] (HDFS-8495) Consolidate append() related implementation into a single class

2015-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636069#comment-14636069 ] Hudson commented on HDFS-8495: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8198 (See [https:

[jira] [Updated] (HDFS-8495) Consolidate append() related implementation into a single class

2015-07-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8495: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-8495) Consolidate append() related implementation into a single class

2015-07-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636059#comment-14636059 ] Haohui Mai commented on HDFS-8495: -- +1. I'll commit it shortly. > Consolidate append() re

[jira] [Updated] (HDFS-8803) Move DfsClientConf to hdfs-client

2015-07-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8803: - Status: Patch Available (was: Open) The v0 patch contains the following changes: * Move the configuration

[jira] [Updated] (HDFS-8803) Move DfsClientConf to hdfs-client

2015-07-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8803: - Attachment: HDFS-8803.000.patch > Move DfsClientConf to hdfs-client > - > >

[jira] [Created] (HDFS-8803) Move DfsClientConf to hdfs-client

2015-07-21 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8803: Summary: Move DfsClientConf to hdfs-client Key: HDFS-8803 URL: https://issues.apache.org/jira/browse/HDFS-8803 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-8781) Erasure Coding: Correctly handle BlockManager#InvalidateBlocks for striped block

2015-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8781: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved (wa

[jira] [Commented] (HDFS-8781) Erasure Coding: Correctly handle BlockManager#InvalidateBlocks for striped block

2015-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636037#comment-14636037 ] Jing Zhao commented on HDFS-8781: - Thanks for updating the patch, Yi! The new patch looks g

[jira] [Updated] (HDFS-8797) WebHdfsFileSystem creates too many connections for pread

2015-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8797: Attachment: HDFS-8797.002.patch Update the patch to add the check suggested by Nicholas. Also added a unit te

[jira] [Commented] (HDFS-7368) Support HDFS specific 'shell' on command 'hdfs dfs' invocation

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635995#comment-14635995 ] Hadoop QA commented on HDFS-7368: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635986#comment-14635986 ] Hadoop QA commented on HDFS-6763: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Resolved] (HDFS-7728) Avoid updating quota usage while loading edits

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-7728. Resolution: Fixed > Avoid updating quota usage while loading edits >

[jira] [Updated] (HDFS-7728) Avoid updating quota usage while loading edits

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7728: --- Labels: (was: BB2015-05-RFC) > Avoid updating quota usage while loading edits > -

[jira] [Reopened] (HDFS-7728) Avoid updating quota usage while loading edits

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reopened HDFS-7728: > Avoid updating quota usage while loading edits > --

[jira] [Resolved] (HDFS-7745) HDFS should have its own daemon command and not rely on the one in common

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-7745. Resolution: Fixed > HDFS should have its own daemon command and not rely on the one in commo

[jira] [Reopened] (HDFS-7745) HDFS should have its own daemon command and not rely on the one in common

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reopened HDFS-7745: > HDFS should have its own daemon command and not rely on the one in common > --

[jira] [Commented] (HDFS-8797) WebHdfsFileSystem creates too many connections for pread

2015-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635979#comment-14635979 ] Tsz Wo Nicholas Sze commented on HDFS-8797: --- Just a minor comment: in the new rea

[jira] [Updated] (HDFS-8760) Erasure Coding: reuse BlockReader when reading the same block in pread

2015-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8760: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved (wa

[jira] [Commented] (HDFS-8760) Erasure Coding: reuse BlockReader when reading the same block in pread

2015-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635972#comment-14635972 ] Jing Zhao commented on HDFS-8760: - Yeah, looks like the Jenkins had some issue. I will comm

[jira] [Commented] (HDFS-3296) Running libhdfs tests in mac fails

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635962#comment-14635962 ] Hadoop QA commented on HDFS-3296: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8797) WebHdfsFileSystem creates too many connections for pread

2015-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8797: Attachment: HDFS-8797.001.patch Thanks for the review, Yi and Nicholas! Update the patch to address comments.

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-07-21 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635908#comment-14635908 ] Nathan Roberts commented on HDFS-8791: -- bq. I'm having trouble understanding these ker

[jira] [Commented] (HDFS-8721) Add a metric for number of encryption zones

2015-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635845#comment-14635845 ] Hudson commented on HDFS-8721: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8196 (See [https:

[jira] [Commented] (HDFS-8773) Few FSNamesystem metrics are not documented in the Metrics page

2015-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635844#comment-14635844 ] Hudson commented on HDFS-8773: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8196 (See [https:

[jira] [Commented] (HDFS-8695) OzoneHandler : Add Bucket REST Interface

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635834#comment-14635834 ] Hadoop QA commented on HDFS-8695: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8773) Few FSNamesystem metrics are not documented in the Metrics page

2015-07-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8773: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-8721) Add a metric for number of encryption zones

2015-07-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8721: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-8790) Add Filesystem level stress tests

2015-07-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635805#comment-14635805 ] James Clampffer commented on HDFS-8790: --- Thanks for the suggestions. Is the goal of

[jira] [Commented] (HDFS-8801) Convert BlockInfoUnderConstruction as a feature

2015-07-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635795#comment-14635795 ] Zhe Zhang commented on HDFS-8801: - Thanks for the comment Nicholas. It seems we should firs

[jira] [Commented] (HDFS-3570) Balancer shouldn't rely on "DFS Space Used %" as that ignores non-DFS used space

2015-07-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635788#comment-14635788 ] Anu Engineer commented on HDFS-3570: Hi [~ajisakaa] Thanks for the patch. I think it is

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-07-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635759#comment-14635759 ] Zhe Zhang commented on HDFS-8499: - Thanks Nicholas for the comments. Addressing the {{BIUCC

[jira] [Commented] (HDFS-3296) Running libhdfs tests in mac fails

2015-07-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635691#comment-14635691 ] Chris Nauroth commented on HDFS-3296: - We define {{}} by appending to the existing {{L

[jira] [Commented] (HDFS-8801) Convert BlockInfoUnderConstruction as a feature

2015-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635682#comment-14635682 ] Tsz Wo Nicholas Sze commented on HDFS-8801: --- INodeFile has many different feature

[jira] [Commented] (HDFS-3296) Running libhdfs tests in mac fails

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635673#comment-14635673 ] Allen Wittenauer commented on HDFS-3296: Is there any reason to not just set DYLD_L

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635670#comment-14635670 ] Tsz Wo Nicholas Sze commented on HDFS-8499: --- > ... if the long term solution look

[jira] [Commented] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635668#comment-14635668 ] Hadoop QA commented on HDFS-6682: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8785) TestDistributedFileSystem is failing in trunk

2015-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635656#comment-14635656 ] Colin Patrick McCabe commented on HDFS-8785: I agree that the test timeout is t

[jira] [Updated] (HDFS-3296) Running libhdfs tests in mac fails

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3296: --- Labels: (was: BB2015-05-TBR) > Running libhdfs tests in mac fails > -

[jira] [Commented] (HDFS-7368) Support HDFS specific 'shell' on command 'hdfs dfs' invocation

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635649#comment-14635649 ] Allen Wittenauer commented on HDFS-7368: -1 We should be trying to get rid of 'hdf

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635639#comment-14635639 ] Tsz Wo Nicholas Sze commented on HDFS-8499: --- > ... could you share some thoughts

[jira] [Commented] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635628#comment-14635628 ] Allen Wittenauer commented on HDFS-6682: I'd still really like to have this... >

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635615#comment-14635615 ] Colin Patrick McCabe commented on HDFS-8791: bq. I think ext2 and ext3 will see

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635614#comment-14635614 ] Tsz Wo Nicholas Sze commented on HDFS-8499: --- {code} >BlockInfoContiguous and

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2015-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635608#comment-14635608 ] Hudson commented on HDFS-8344: -- FAILURE: Integrated in Hadoop-trunk-Commit #8195 (See [https:

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635605#comment-14635605 ] Tsz Wo Nicholas Sze commented on HDFS-8499: --- > .. Along the history, an invariant

[jira] [Commented] (HDFS-8800) hdfs --daemon stop namenode corrupts logs

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635600#comment-14635600 ] Hadoop QA commented on HDFS-8800: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8797) WebHdfsFileSystem creates too many connections for pread

2015-07-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635586#comment-14635586 ] Tsz Wo Nicholas Sze commented on HDFS-8797: --- Need to fix fileLength in openInputS

[jira] [Reopened] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2015-07-21 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash reopened HDFS-8344: Very well [~wheat9]. I have reverted the changes. Could you please review version 5 of the patch (HDFS-8

[jira] [Commented] (HDFS-8735) Inotify : All events classes should implement toString() API.

2015-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635557#comment-14635557 ] Colin Patrick McCabe commented on HDFS-8735: I think this is a good improvement

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635550#comment-14635550 ] Colin Patrick McCabe commented on HDFS-8078: I think this would be a lot easier

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-07-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635456#comment-14635456 ] Zhe Zhang commented on HDFS-8499: - I just created HDFS-8801 to track the long term solution

[jira] [Commented] (HDFS-3570) Balancer shouldn't rely on "DFS Space Used %" as that ignores non-DFS used space

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635450#comment-14635450 ] Hadoop QA commented on HDFS-3570: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8769) Erasure Coding: unit test for SequentialBlockGroupIdGenerator

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635446#comment-14635446 ] Hadoop QA commented on HDFS-8769: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-7400) More reliable namenode health check to detect OS/HW issues

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7400: --- Status: Open (was: Patch Available) > More reliable namenode health check to detect OS/HW issu

[jira] [Commented] (HDFS-7400) More reliable namenode health check to detect OS/HW issues

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635445#comment-14635445 ] Allen Wittenauer commented on HDFS-7400: With node health now sitting in common, th

[jira] [Updated] (HDFS-8802) dfs.checksum.type is not described in hdfs-default.xml

2015-07-21 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated HDFS-8802: - Description: It's a good timing to check other configurations about hdfs-default.xml here. > dfs.c

[jira] [Created] (HDFS-8802) dfs.checksum.type is not described in hdfs-default.xml

2015-07-21 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HDFS-8802: Summary: dfs.checksum.type is not described in hdfs-default.xml Key: HDFS-8802 URL: https://issues.apache.org/jira/browse/HDFS-8802 Project: Hadoop HDFS Issu

[jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml

2015-07-21 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635440#comment-14635440 ] Ray Chiang commented on HDFS-8356: -- I've cancelled the patch for now. Yeah, I've fallen b

[jira] [Created] (HDFS-8801) Convert BlockInfoUnderConstruction as a feature

2015-07-21 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-8801: --- Summary: Convert BlockInfoUnderConstruction as a feature Key: HDFS-8801 URL: https://issues.apache.org/jira/browse/HDFS-8801 Project: Hadoop HDFS Issue Type: Improveme

[jira] [Updated] (HDFS-8356) Document missing properties in hdfs-default.xml

2015-07-21 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-8356: - Status: Open (was: Patch Available) > Document missing properties in hdfs-default.xml > --

[jira] [Updated] (HDFS-3570) Balancer shouldn't rely on "DFS Space Used %" as that ignores non-DFS used space

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3570: --- Labels: (was: BB2015-05-TBR) > Balancer shouldn't rely on "DFS Space Used %" as that ignores

[jira] [Commented] (HDFS-8800) hdfs --daemon stop namenode corrupts logs

2015-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635430#comment-14635430 ] Hudson commented on HDFS-8800: -- FAILURE: Integrated in Hadoop-trunk-Commit #8193 (See [https:

[jira] [Updated] (HDFS-8685) S3:Hadoop tools jars should be added in "dfs" class path.

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8685: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) Closing this as won't fi

[jira] [Updated] (HDFS-8664) Allow wildcards in dfs.datanode.data.dir

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8664: --- Hadoop Flags: Incompatible change > Allow wildcards in dfs.datanode.data.dir >

[jira] [Commented] (HDFS-8735) Inotify : All events classes should implement toString() API.

2015-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635422#comment-14635422 ] Hadoop QA commented on HDFS-8735: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml

2015-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635420#comment-14635420 ] Allen Wittenauer commented on HDFS-8356: I'm not sure it's actually helpful to have

[jira] [Commented] (HDFS-7582) Enforce maximum number of ACL entries separately per access and default.

2015-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635411#comment-14635411 ] Hudson commented on HDFS-7582: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2209 (See [htt

[jira] [Commented] (HDFS-7483) Display information per tier on the Namenode UI

2015-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635406#comment-14635406 ] Hudson commented on HDFS-7483: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2209 (See [htt

[jira] [Commented] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

2015-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635410#comment-14635410 ] Hudson commented on HDFS-6945: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2209 (See [htt

[jira] [Commented] (HDFS-8794) Improve CorruptReplicasMap#corruptReplicasMap

2015-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635408#comment-14635408 ] Hudson commented on HDFS-8794: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2209 (See [htt

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2015-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635412#comment-14635412 ] Hudson commented on HDFS-8344: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2209 (See [htt

[jira] [Commented] (HDFS-8657) Update docs for mSNN

2015-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635407#comment-14635407 ] Hudson commented on HDFS-8657: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2209 (See [htt

  1   2   >