[jira] [Updated] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8938: Attachment: HDFS-8938.001.patch The v1 patch checks non-null scheduled {{ReplicationWork}} before add

[jira] [Updated] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8938: - Status: Patch Available (was: Open) > Refactor BlockManager in blockmanagement > -

[jira] [Commented] (HDFS-8924) Add pluggable interface for reading replicas in DFSClient

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707844#comment-14707844 ] Hudson commented on HDFS-8924: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2223 (See [https://

[jira] [Assigned] (HDFS-4167) Add support for restoring/rolling back to a snapshot

2015-08-21 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S reassigned HDFS-4167: - Assignee: Ajith S (was: Jing Zhao) > Add support for restoring/rolling back to a snapshot > -

[jira] [Commented] (HDFS-6939) Support path-based filtering of inotify events

2015-08-21 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707828#comment-14707828 ] Ming Ma commented on HDFS-6939: --- Thanks [~surendrasingh] for working on this. I had some dis

[jira] [Updated] (HDFS-8940) Support for large-scale multi-tenant inotify service

2015-08-21 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-8940: -- Attachment: Large-Scale-Multi-Tenant-Inotify-Service.pdf Here is the draft document that outlines the issues we a

[jira] [Commented] (HDFS-4167) Add support for restoring/rolling back to a snapshot

2015-08-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707824#comment-14707824 ] Jing Zhao commented on HDFS-4167: - Sure, please feel free to assign the jira to yourself.

[jira] [Created] (HDFS-8940) Support for large-scale multi-tenant inotify service

2015-08-21 Thread Ming Ma (JIRA)
Ming Ma created HDFS-8940: - Summary: Support for large-scale multi-tenant inotify service Key: HDFS-8940 URL: https://issues.apache.org/jira/browse/HDFS-8940 Project: Hadoop HDFS Issue Type: Improvem

[jira] [Commented] (HDFS-4167) Add support for restoring/rolling back to a snapshot

2015-08-21 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707815#comment-14707815 ] Ajith S commented on HDFS-4167: --- Hi [~jingzhao] Can i please work on this patch in case you

[jira] [Commented] (HDFS-8924) Add pluggable interface for reading replicas in DFSClient

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707810#comment-14707810 ] Hudson commented on HDFS-8924: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #285 (See [htt

[jira] [Commented] (HDFS-8924) Add pluggable interface for reading replicas in DFSClient

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707809#comment-14707809 ] Hudson commented on HDFS-8924: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1026 (See [https://

[jira] [Commented] (HDFS-8924) Add pluggable interface for reading replicas in DFSClient

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707774#comment-14707774 ] Hudson commented on HDFS-8924: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2241 (See [htt

[jira] [Assigned] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

2015-08-21 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reassigned HDFS-8939: - Assignee: Jakob Homan > Test(S)WebHdfsFileContextMainOperations failing on branch-2 >

[jira] [Updated] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

2015-08-21 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8939: -- Status: Patch Available (was: Open) > Test(S)WebHdfsFileContextMainOperations failing on branch-2 >

[jira] [Updated] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

2015-08-21 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8939: -- Attachment: HDFS-8939-branch-2.001.patch Match getDefaultPort behavior on trunk. > Test(S)WebHdfsFileCon

[jira] [Created] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

2015-08-21 Thread Jakob Homan (JIRA)
Jakob Homan created HDFS-8939: - Summary: Test(S)WebHdfsFileContextMainOperations failing on branch-2 Key: HDFS-8939 URL: https://issues.apache.org/jira/browse/HDFS-8939 Project: Hadoop HDFS Issu

[jira] [Commented] (HDFS-8924) Add pluggable interface for reading replicas in DFSClient

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707765#comment-14707765 ] Hudson commented on HDFS-8924: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #296 (See [htt

[jira] [Updated] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8938: Attachment: HDFS-8938.000.patch The v0 version patch: * Moves the inner classes {{BlockToMarkCorr

[jira] [Commented] (HDFS-8924) Add pluggable interface for reading replicas in DFSClient

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707722#comment-14707722 ] Hudson commented on HDFS-8924: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #292 (See

[jira] [Created] (HDFS-8938) Refactor BlockManager in blockmanagement

2015-08-21 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-8938: --- Summary: Refactor BlockManager in blockmanagement Key: HDFS-8938 URL: https://issues.apache.org/jira/browse/HDFS-8938 Project: Hadoop HDFS Issue Type: Task

[jira] [Updated] (HDFS-8846) Create edit log files with old layout version for upgrade testing

2015-08-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8846: Attachment: HDFS-8846.03.patch Thanks Colin for the suggestion! Updating the patch with more comprehensive c

[jira] [Commented] (HDFS-8924) Add pluggable interface for reading replicas in DFSClient

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707690#comment-14707690 ] Hudson commented on HDFS-8924: -- FAILURE: Integrated in Hadoop-trunk-Commit #8336 (See [https:

[jira] [Updated] (HDFS-8924) Add pluggable interface for reading replicas in DFSClient

2015-08-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8924: Resolution: Fixed Fix Version/s: 2.8.0 3.0.0 Status: Resolved (w

[jira] [Commented] (HDFS-8924) Add pluggable interface for reading replicas in DFSClient

2015-08-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707663#comment-14707663 ] Lei (Eddy) Xu commented on HDFS-8924: - +1. Will commit shortly. > Add pluggable interf

[jira] [Commented] (HDFS-8809) HDFS fsck reports under construction blocks as "CORRUPT"

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707601#comment-14707601 ] Hudson commented on HDFS-8809: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2221 (See [https://

[jira] [Commented] (HDFS-8884) Fail-fast check in BlockPlacementPolicyDefault#chooseTarget

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707608#comment-14707608 ] Hudson commented on HDFS-8884: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2221 (See [https://

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build diff copy list in distcp

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707603#comment-14707603 ] Hudson commented on HDFS-8828: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2221 (See [https://

[jira] [Commented] (HDFS-8863) The remaining space check in BlockPlacementPolicyDefault is flawed

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707606#comment-14707606 ] Hudson commented on HDFS-8863: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2221 (See [https://

[jira] [Commented] (HDFS-8922) Link the native_mini_dfs test library with libdl, since IBM Java requires it

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707602#comment-14707602 ] Hudson commented on HDFS-8922: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2221 (See [https://

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707604#comment-14707604 ] Hudson commented on HDFS-8891: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2221 (See [https://

[jira] [Commented] (HDFS-8924) Add pluggable interface for reading replicas in DFSClient

2015-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707596#comment-14707596 ] Hadoop QA commented on HDFS-8924: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8863) The remaining space check in BlockPlacementPolicyDefault is flawed

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707590#comment-14707590 ] Hudson commented on HDFS-8863: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #283 (See [htt

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707588#comment-14707588 ] Hudson commented on HDFS-8891: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #283 (See [htt

[jira] [Commented] (HDFS-8922) Link the native_mini_dfs test library with libdl, since IBM Java requires it

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707586#comment-14707586 ] Hudson commented on HDFS-8922: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #283 (See [htt

[jira] [Commented] (HDFS-8884) Fail-fast check in BlockPlacementPolicyDefault#chooseTarget

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707592#comment-14707592 ] Hudson commented on HDFS-8884: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #283 (See [htt

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build diff copy list in distcp

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707587#comment-14707587 ] Hudson commented on HDFS-8828: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #283 (See [htt

[jira] [Commented] (HDFS-8809) HDFS fsck reports under construction blocks as "CORRUPT"

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707585#comment-14707585 ] Hudson commented on HDFS-8809: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #283 (See [htt

[jira] [Commented] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

2015-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707565#comment-14707565 ] Hadoop QA commented on HDFS-8388: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8934) Move ShortCircuitShm to hdfs-client

2015-08-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8934: - Fix Version/s: (was: 2.8.0) > Move ShortCircuitShm to hdfs-client > ---

[jira] [Commented] (HDFS-8934) Move ShortCircuitShm to hdfs-client

2015-08-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707549#comment-14707549 ] Haohui Mai commented on HDFS-8934: -- Thanks for the work, Mingliang! It looks good to me ov

[jira] [Commented] (HDFS-8922) Link the native_mini_dfs test library with libdl, since IBM Java requires it

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707539#comment-14707539 ] Hudson commented on HDFS-8922: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2240 (See [htt

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707541#comment-14707541 ] Hudson commented on HDFS-8891: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2240 (See [htt

[jira] [Commented] (HDFS-8863) The remaining space check in BlockPlacementPolicyDefault is flawed

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707543#comment-14707543 ] Hudson commented on HDFS-8863: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2240 (See [htt

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build diff copy list in distcp

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707540#comment-14707540 ] Hudson commented on HDFS-8828: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2240 (See [htt

[jira] [Commented] (HDFS-8809) HDFS fsck reports under construction blocks as "CORRUPT"

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707538#comment-14707538 ] Hudson commented on HDFS-8809: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2240 (See [htt

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

2015-08-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8838: Attachment: HDFS-8838-HDFS-7285-20150821.patch Upload a rebased patch for Nicholas. > Tolerate datan

[jira] [Commented] (HDFS-7116) Add a metric to expose the bandwidth of balancer

2015-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707525#comment-14707525 ] Hadoop QA commented on HDFS-7116: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

2015-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707520#comment-14707520 ] Hadoop QA commented on HDFS-8829: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8930) Block report lease may leak if the 2nd full block report comes when NN is still in safemode

2015-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707519#comment-14707519 ] Hadoop QA commented on HDFS-8930: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8934) Move ShortCircuitShm to hdfs-client

2015-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707466#comment-14707466 ] Hadoop QA commented on HDFS-8934: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

2015-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707460#comment-14707460 ] Hadoop QA commented on HDFS-8853: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build diff copy list in distcp

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707441#comment-14707441 ] Hudson commented on HDFS-8828: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #294 (See [htt

[jira] [Commented] (HDFS-8809) HDFS fsck reports under construction blocks as "CORRUPT"

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707439#comment-14707439 ] Hudson commented on HDFS-8809: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #294 (See [htt

[jira] [Commented] (HDFS-8922) Link the native_mini_dfs test library with libdl, since IBM Java requires it

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707440#comment-14707440 ] Hudson commented on HDFS-8922: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #294 (See [htt

[jira] [Commented] (HDFS-8863) The remaining space check in BlockPlacementPolicyDefault is flawed

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707444#comment-14707444 ] Hudson commented on HDFS-8863: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #294 (See [htt

[jira] [Commented] (HDFS-8884) Fail-fast check in BlockPlacementPolicyDefault#chooseTarget

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707446#comment-14707446 ] Hudson commented on HDFS-8884: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #294 (See [htt

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707442#comment-14707442 ] Hudson commented on HDFS-8891: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #294 (See [htt

[jira] [Updated] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8900: -- Hadoop Flags: Incompatible change Release Note: The config key "dfs.namenode.fs-limits.max-xattr-size"

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707418#comment-14707418 ] Andrew Wang commented on HDFS-8900: --- Latest rev LGTM, +1 pending. I'm okay with this in b

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707359#comment-14707359 ] Hadoop QA commented on HDFS-8900: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8884) Fail-fast check in BlockPlacementPolicyDefault#chooseTarget

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707352#comment-14707352 ] Hudson commented on HDFS-8884: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1024 (See [https://

[jira] [Commented] (HDFS-8863) The remaining space check in BlockPlacementPolicyDefault is flawed

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707350#comment-14707350 ] Hudson commented on HDFS-8863: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1024 (See [https://

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build diff copy list in distcp

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707347#comment-14707347 ] Hudson commented on HDFS-8828: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1024 (See [https://

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707348#comment-14707348 ] Hudson commented on HDFS-8891: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1024 (See [https://

[jira] [Commented] (HDFS-8922) Link the native_mini_dfs test library with libdl, since IBM Java requires it

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707346#comment-14707346 ] Hudson commented on HDFS-8922: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1024 (See [https://

[jira] [Commented] (HDFS-8809) HDFS fsck reports under construction blocks as "CORRUPT"

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707345#comment-14707345 ] Hudson commented on HDFS-8809: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1024 (See [https://

[jira] [Commented] (HDFS-8932) NPE thrown in NameNode when try to get "TotalSyncCount" metric before editLogStream initialization

2015-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707340#comment-14707340 ] Hadoop QA commented on HDFS-8932: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build diff copy list in distcp

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707317#comment-14707317 ] Hudson commented on HDFS-8828: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #291 (See

[jira] [Commented] (HDFS-8922) Link the native_mini_dfs test library with libdl, since IBM Java requires it

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707316#comment-14707316 ] Hudson commented on HDFS-8922: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #291 (See

[jira] [Commented] (HDFS-8809) HDFS fsck reports under construction blocks as "CORRUPT"

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707315#comment-14707315 ] Hudson commented on HDFS-8809: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #291 (See

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707318#comment-14707318 ] Hudson commented on HDFS-8891: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #291 (See

[jira] [Commented] (HDFS-8863) The remaining space check in BlockPlacementPolicyDefault is flawed

2015-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707320#comment-14707320 ] Hudson commented on HDFS-8863: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #291 (See

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707281#comment-14707281 ] Hadoop QA commented on HDFS-8865: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-6939) Support path-based filtering of inotify events

2015-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707259#comment-14707259 ] Hadoop QA commented on HDFS-6939: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-6697) Make NN lease soft and hard limits configurable

2015-08-21 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707225#comment-14707225 ] Ravi Prakash commented on HDFS-6697: And just to clarify [~wheat9]'s concern https://i

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2015-08-21 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707223#comment-14707223 ] Ravi Prakash commented on HDFS-8344: Hi Haohui! Could you please review the patch? >

[jira] [Commented] (HDFS-8932) NPE thrown in NameNode when try to get "TotalSyncCount" metric before editLogStream initialization

2015-08-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707208#comment-14707208 ] Surendra Singh Lilhore commented on HDFS-8932: -- Thanks [~anu] for review.. >

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

2015-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707204#comment-14707204 ] Arpit Agarwal commented on HDFS-8486: - Thanks Chris, pushed to branch-2.6. > DN startu

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

2015-08-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707163#comment-14707163 ] Chris Nauroth commented on HDFS-8486: - +1 for the addendum patch. Thank you, Arpit. >

[jira] [Commented] (HDFS-8846) Create edit log files with old layout version for upgrade testing

2015-08-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707164#comment-14707164 ] Colin Patrick McCabe commented on HDFS-8846: Looks good overall! Can we test r

[jira] [Commented] (HDFS-8932) NPE thrown in NameNode when try to get "TotalSyncCount" metric before editLogStream initialization

2015-08-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707040#comment-14707040 ] Anu Engineer commented on HDFS-8932: +1, thanks for catching this and fixing it quickly

[jira] [Commented] (HDFS-8933) Inotify : Support Event-based filtering

2015-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706846#comment-14706846 ] Allen Wittenauer commented on HDFS-8933: Converting this to an issue since the inot

[jira] [Updated] (HDFS-8933) Inotify : Support Event-based filtering

2015-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8933: --- Fix Version/s: (was: 2.6.0) > Inotify : Support Event-based filtering > ---

[jira] [Updated] (HDFS-8933) Inotify : Support Event-based filtering

2015-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8933: --- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-6634) > Inotify : Suppo

[jira] [Commented] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706823#comment-14706823 ] Yi Liu commented on HDFS-8900: -- (I don't know why the Jenkins is not triggered after submittin

[jira] [Updated] (HDFS-8900) Compact XAttrs to optimize memory footprint.

2015-08-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8900: - Summary: Compact XAttrs to optimize memory footprint. (was: Optimize XAttr memory footprint.) > Compact XAttrs to

[jira] [Comment Edited] (HDFS-8900) Optimize XAttr memory footprint.

2015-08-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706763#comment-14706763 ] Yi Liu edited comment on HDFS-8900 at 8/21/15 2:45 PM: --- Thanks [~andr

[jira] [Updated] (HDFS-8900) Optimize XAttr memory footprint.

2015-08-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8900: - Status: Patch Available (was: Open) > Optimize XAttr memory footprint. > > >

[jira] [Updated] (HDFS-8900) Optimize XAttr memory footprint.

2015-08-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8900: - Attachment: HDFS-8900.002.patch > Optimize XAttr memory footprint. > > >

[jira] [Updated] (HDFS-8900) Optimize XAttr memory footprint.

2015-08-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8900: - Attachment: (was: HDFS-8900.002.patch) > Optimize XAttr memory footprint. > >

[jira] [Comment Edited] (HDFS-8900) Optimize XAttr memory footprint.

2015-08-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706763#comment-14706763 ] Yi Liu edited comment on HDFS-8900 at 8/21/15 2:08 PM: --- Thanks [~andr

[jira] [Updated] (HDFS-8900) Optimize XAttr memory footprint.

2015-08-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8900: - Status: Open (was: Patch Available) > Optimize XAttr memory footprint. > > >

[jira] [Updated] (HDFS-8900) Optimize XAttr memory footprint.

2015-08-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8900: - Attachment: HDFS-8900.002.patch > Optimize XAttr memory footprint. > > >

[jira] [Commented] (HDFS-8900) Optimize XAttr memory footprint.

2015-08-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706763#comment-14706763 ] Yi Liu commented on HDFS-8900: -- Thanks [~andrew.wang], I update the patch for your comments.

[jira] [Updated] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

2015-08-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8388: - Attachment: HDFS-8388-005.patch Attached updated patch, Please review... > Time an

[jira] [Commented] (HDFS-8373) Ec files can't be deleted into Trash because of that Trash isn't EC zone.

2015-08-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706551#comment-14706551 ] Brahma Reddy Battula commented on HDFS-8373: I saw HDFS-8833 is in discussion a

[jira] [Created] (HDFS-8937) Fix the exception when set replication to Erasure Coding files

2015-08-21 Thread GAO Rui (JIRA)
GAO Rui created HDFS-8937: - Summary: Fix the exception when set replication to Erasure Coding files Key: HDFS-8937 URL: https://issues.apache.org/jira/browse/HDFS-8937 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-8935) Erasure Coding: createErasureCodingZone api should accept the policyname as argument instead of ErasureCodingPolicy

2015-08-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706547#comment-14706547 ] Vinayakumar B commented on HDFS-8935: - I think this should be implemented only after de

[jira] [Updated] (HDFS-8936) Simplify Erasure Coding Zone DiskSpace quota exceeded exception error message

2015-08-21 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-8936: -- Attachment: None EC(Replication) space quota.log EC space quota.log > Simplify Erasure Coding Zon

[jira] [Commented] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

2015-08-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706542#comment-14706542 ] Vinayakumar B commented on HDFS-8853: - Thanks for the update [~andreina]. Few more nit

  1   2   >