[jira] [Updated] (HDFS-8964) Provide max TxId when validating in-progress edit log files

2015-08-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8964: Attachment: HDFS-8964.02.patch Updating the patch with a test (which turns out to be the hardest part). Basi

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-08-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720990#comment-14720990 ] Walter Su commented on HDFS-7285: - The merge result in HDFS-7285-20150827 LGTM. except that

[jira] [Commented] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720982#comment-14720982 ] Hadoop QA commented on HDFS-8983: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720967#comment-14720967 ] Jitendra Nath Pandey commented on HDFS-8983: Thanks for addressing my comments

[jira] [Commented] (HDFS-8978) Erasure coding: fix 2 failed tests of DFSStripedOutputStream

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720954#comment-14720954 ] Hadoop QA commented on HDFS-8978: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8925) Move BlockReaderLocal to hdfs-client

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720929#comment-14720929 ] Hudson commented on HDFS-8925: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2249 (See [https://

[jira] [Updated] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8983: Attachment: HDFS-8983.04.patch Thanks [~jnp]! Addressed in .04 patch. Also updated {{FsDirectory#nor

[jira] [Commented] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720913#comment-14720913 ] Hadoop QA commented on HDFS-8983: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8965) Harden edit log reading code against out of memory errors

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720907#comment-14720907 ] Hadoop QA commented on HDFS-8965: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8946) Improve choosing datanode storage for block placement

2015-08-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720899#comment-14720899 ] Yi Liu commented on HDFS-8946: -- The test failure is not related, they run successfully in my l

[jira] [Commented] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720881#comment-14720881 ] Jitendra Nath Pandey commented on HDFS-8983: {code} + checkProtectedDesce

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720875#comment-14720875 ] Hudson commented on HDFS-8950: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2268 (See [htt

[jira] [Commented] (HDFS-8925) Move BlockReaderLocal to hdfs-client

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720876#comment-14720876 ] Hudson commented on HDFS-8925: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2268 (See [htt

[jira] [Assigned] (HDFS-8955) Support 'hedged' write in DFSClient

2015-08-28 Thread bijaya (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bijaya reassigned HDFS-8955: Assignee: (was: bijaya) > Support 'hedged' write in DFSClient > --- > >

[jira] [Commented] (HDFS-8632) Erasure Coding: Add InterfaceAudience annotation to the erasure coding classes

2015-08-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720873#comment-14720873 ] Walter Su commented on HDFS-8632: - Thanks [~rakeshr]. And sorry for late review. Semantics

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720866#comment-14720866 ] Hudson commented on HDFS-8950: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #319 (See

[jira] [Commented] (HDFS-8925) Move BlockReaderLocal to hdfs-client

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720867#comment-14720867 ] Hudson commented on HDFS-8925: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #319 (See

[jira] [Updated] (HDFS-8501) Erasure Coding: BlockInfoStriped.removeStorage(..) move storage with same blockIndex to front slot

2015-08-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8501: Summary: Erasure Coding: BlockInfoStriped.removeStorage(..) move storage with same blockIndex to front slot

[jira] [Updated] (HDFS-8779) WebUI can't display randomly generated block ID

2015-08-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8779: Assignee: Haohui Mai (was: Walter Su) > WebUI can't display randomly generated block ID > --

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720847#comment-14720847 ] Hudson commented on HDFS-8950: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2248 (See [https://

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720849#comment-14720849 ] Hudson commented on HDFS-8938: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2248 (See [https://

[jira] [Updated] (HDFS-8779) WebUI can't display randomly generated block ID

2015-08-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8779: Attachment: test-006-patch.PNG Thanks [~wheat9] for keep exploring 3rd-party library. I've tested with 3 bro

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720843#comment-14720843 ] Hudson commented on HDFS-8938: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #310 (See [htt

[jira] [Commented] (HDFS-8925) Move BlockReaderLocal to hdfs-client

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720842#comment-14720842 ] Hudson commented on HDFS-8925: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #310 (See [htt

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720840#comment-14720840 ] Hudson commented on HDFS-8950: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #310 (See [htt

[jira] [Commented] (HDFS-8779) WebUI can't display randomly generated block ID

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720834#comment-14720834 ] Hadoop QA commented on HDFS-8779: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8925) Move BlockReaderLocal to hdfs-client

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720828#comment-14720828 ] Hudson commented on HDFS-8925: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #325 (See [htt

[jira] [Commented] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720812#comment-14720812 ] Mingliang Liu commented on HDFS-8990: - Thanks [~wheat9]! The wrong constant typo was b

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Attachment: HDFS-8990.001.patch > Move RemoteBlockReader to hdfs-client module >

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720796#comment-14720796 ] Hudson commented on HDFS-8938: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2267 (See [htt

[jira] [Commented] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720793#comment-14720793 ] Haohui Mai commented on HDFS-8990: -- {code} public int available() throws IOException {

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Attachment: HDFS-8990.000.patch The v0 patch moves the {{RemoteBlockReader}} and {{RemoteBlockReader2

[jira] [Commented] (HDFS-8925) Move BlockReaderLocal to hdfs-client

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720769#comment-14720769 ] Hudson commented on HDFS-8925: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1052 (See [https://

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720768#comment-14720768 ] Hudson commented on HDFS-8950: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1052 (See [https://

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720770#comment-14720770 ] Hudson commented on HDFS-8938: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1052 (See [https://

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720750#comment-14720750 ] Hudson commented on HDFS-8938: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #318 (See

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720727#comment-14720727 ] Hudson commented on HDFS-8950: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #324 (See [htt

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720728#comment-14720728 ] Hudson commented on HDFS-8938: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #324 (See [htt

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Description: This jira tracks the effort of moving the {{RemoteBlockReader}} class into the {{hdfs-c

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Description: This jira tracks the effort of moving the {{RemoteBlockReader}} class into the {{hdfs-c

[jira] [Commented] (HDFS-8965) Harden edit log reading code against out of memory errors

2015-08-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720699#comment-14720699 ] Colin Patrick McCabe commented on HDFS-8965: bq. Do we also already have tests

[jira] [Updated] (HDFS-8965) Harden edit log reading code against out of memory errors

2015-08-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8965: --- Attachment: HDFS-8965.005.patch > Harden edit log reading code against out of memory er

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Description: This jira tracks the effort of moving the {{RemoteBlockReader}} class into the {{hdfs-cl

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Fix Version/s: (was: 2.8.0) > Move RemoteBlockReader to hdfs-client module >

[jira] [Updated] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8990: Hadoop Flags: (was: Reviewed) > Move RemoteBlockReader to hdfs-client module >

[jira] [Created] (HDFS-8990) Move RemoteBlockReader to hdfs-client module

2015-08-28 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-8990: --- Summary: Move RemoteBlockReader to hdfs-client module Key: HDFS-8990 URL: https://issues.apache.org/jira/browse/HDFS-8990 Project: Hadoop HDFS Issue Type: Sub-

[jira] [Updated] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8983: Attachment: HDFS-8983.03.patch > NameNode support for protected directories > ---

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720646#comment-14720646 ] Hadoop QA commented on HDFS-8855: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8967) Create a BlockManagerLock class to represent the lock used in the BlockManager

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720640#comment-14720640 ] Haohui Mai commented on HDFS-8967: -- Ran the test locally and they passed. [~daryn] can you

[jira] [Commented] (HDFS-8925) Move BlockReaderLocal to hdfs-client

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720637#comment-14720637 ] Hudson commented on HDFS-8925: -- FAILURE: Integrated in Hadoop-trunk-Commit #8368 (See [https:

[jira] [Commented] (HDFS-8983) NameNode support for protected directories

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720631#comment-14720631 ] Hadoop QA commented on HDFS-8983: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720628#comment-14720628 ] Hudson commented on HDFS-8865: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #309 (See [htt

[jira] [Updated] (HDFS-8925) Move BlockReaderLocal to hdfs-client

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8925: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720620#comment-14720620 ] Hudson commented on HDFS-8865: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2247 (See [https://

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720615#comment-14720615 ] Hudson commented on HDFS-8950: -- FAILURE: Integrated in Hadoop-trunk-Commit #8367 (See [https:

[jira] [Updated] (HDFS-8925) Move BlockReaderLocal to hdfs-client

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8925: - Summary: Move BlockReaderLocal to hdfs-client (was: Move BlockReader to hdfs-client) > Move BlockReaderLo

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720595#comment-14720595 ] Hudson commented on HDFS-8938: -- FAILURE: Integrated in Hadoop-trunk-Commit #8366 (See [https:

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2015-08-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8950: --- Resolution: Fixed Status: Resolved (was: Patch Available) > NameNode refresh d

[jira] [Updated] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8938: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) I've comm

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720591#comment-14720591 ] Hadoop QA commented on HDFS-8938: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720580#comment-14720580 ] Hudson commented on HDFS-8865: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2266 (See [htt

[jira] [Commented] (HDFS-8925) Move BlockReader to hdfs-client

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720582#comment-14720582 ] Haohui Mai commented on HDFS-8925: -- +1. The checkstyle warnings can be addressed in HDFS-8

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2015-08-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8950: --- Summary: NameNode refresh doesn't remove DataNodes that are no longer in the allowed li

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720576#comment-14720576 ] Colin Patrick McCabe commented on HDFS-8950: +1. Thanks, [~templedf]. > NameN

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720575#comment-14720575 ] Haohui Mai commented on HDFS-8938: -- +1 on the v8 patch. Ran failed tests locally and all p

[jira] [Commented] (HDFS-8779) WebUI can't display randomly generated block ID

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720569#comment-14720569 ] Haohui Mai commented on HDFS-8779: -- The v06 patch is based on the idea of the v4 patch exc

[jira] [Commented] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720568#comment-14720568 ] Hadoop QA commented on HDFS-8938: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8779) WebUI can't display randomly generated block ID

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8779: - Attachment: HDFS-8779.006.patch > WebUI can't display randomly generated block ID > ---

[jira] [Commented] (HDFS-8779) WebUI can't display randomly generated block ID

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720564#comment-14720564 ] Hadoop QA commented on HDFS-8779: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8779) WebUI can't display randomly generated block ID

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8779: - Attachment: HDFS-8779.005.patch > WebUI can't display randomly generated block ID > ---

[jira] [Created] (HDFS-8989) Allow rate-limiting the DirectoryScanner via time-slicing

2015-08-28 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-8989: -- Summary: Allow rate-limiting the DirectoryScanner via time-slicing Key: HDFS-8989 URL: https://issues.apache.org/jira/browse/HDFS-8989 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720495#comment-14720495 ] Hudson commented on HDFS-8865: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #322 (See [htt

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-28 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720493#comment-14720493 ] Bob Hansen commented on HDFS-8855: -- [~xiaobingo] Sterling. Is this something that you ca

[jira] [Commented] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720482#comment-14720482 ] Hadoop QA commented on HDFS-8155: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-328) "fs -setrep" should have better error message

2015-08-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720455#comment-14720455 ] Daniel Templeton commented on HDFS-328: --- The failed tests are unrelated to this patch.

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720452#comment-14720452 ] Hudson commented on HDFS-8865: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #317 (See

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720448#comment-14720448 ] Hudson commented on HDFS-8865: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1050 (See [https://

[jira] [Commented] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

2015-08-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720424#comment-14720424 ] Daniel Templeton commented on HDFS-2070: TestBPOfferService is unrelated to this pa

[jira] [Updated] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8855: Attachment: HDFS-8855.3.patch [~bobthansen] Thanks for review. Although that's called by bootstrap on

[jira] [Commented] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720417#comment-14720417 ] Hadoop QA commented on HDFS-2070: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8779) WebUI can't display randomly generated block ID

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720399#comment-14720399 ] Haohui Mai commented on HDFS-8779: -- I'll upload a patch to demonstrate the idea later toda

[jira] [Commented] (HDFS-8779) WebUI can't display randomly generated block ID

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720375#comment-14720375 ] Haohui Mai commented on HDFS-8779: -- -1 on the 03 patch. For 04 patch the javascript needs

[jira] [Commented] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720370#comment-14720370 ] Kihwal Lee commented on HDFS-8879: -- Cherry-picked the fix to branch-2.7. > Quota by stora

[jira] [Updated] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8879: - Fix Version/s: (was: 2.8.0) 2.7.2 3.0.0 > Quota by storage type u

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720368#comment-14720368 ] Hudson commented on HDFS-8865: -- FAILURE: Integrated in Hadoop-trunk-Commit #8364 (See [https:

[jira] [Commented] (HDFS-8779) WebUI can't display randomly generated block ID

2015-08-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720366#comment-14720366 ] Andrew Wang commented on HDFS-8779: --- I'm +1 on the 03 patch, seems like the cleanest and

[jira] [Resolved] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-8865. -- Resolution: Fixed Fix Version/s: 2.8.0 3.0.0 > Improve quota initialization per

[jira] [Updated] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8865: - Hadoop Flags: Reviewed > Improve quota initialization performance > ---

[jira] [Updated] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8865: - Status: In Progress (was: Patch Available) > Improve quota initialization performance > --

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720363#comment-14720363 ] Kihwal Lee commented on HDFS-8865: -- Thanks [~xyao] and [~daryn] for reviews. I've committe

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720344#comment-14720344 ] Daryn Sharp commented on HDFS-8865: --- +1 This has made a huge difference, and all the pos

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720296#comment-14720296 ] Hadoop QA commented on HDFS-8950: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8938) Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager

2015-08-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8938: - Status: Patch Available (was: Reopened) > Extract BlockToMarkCorrupt and ReplicationWork as standalone cla

[jira] [Updated] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-28 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8155: -- Status: Open (was: Patch Available) > Support OAuth2 in WebHDFS > - > >

[jira] [Updated] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-28 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8155: -- Attachment: HDFS-8155.006.patch Fixed ChrisN's final coment. Yeah, Jenkins is being weird for me. I ran

[jira] [Updated] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-28 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8155: -- Status: Patch Available (was: Open) > Support OAuth2 in WebHDFS > - > >

[jira] [Commented] (HDFS-8892) ShortCircuitCache.CacheCleaner can add Slot.isInvalid() check too

2015-08-28 Thread Ravikumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720116#comment-14720116 ] Ravikumar commented on HDFS-8892: - Please feel free to contribute the patch [~kanaka]. I am

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-28 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720070#comment-14720070 ] Bob Hansen commented on HDFS-8855: -- Xiaobing - is there a race condition in initializing t

[jira] [Commented] (HDFS-8155) Support OAuth2 in WebHDFS

2015-08-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720043#comment-14720043 ] Chris Nauroth commented on HDFS-8155: - {code} client.setConnectTimeout(URLConnect

[jira] [Updated] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

2015-08-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-2070: --- Status: Patch Available (was: In Progress) Ready for review. This should be a quick and easy

  1   2   >