[jira] [Updated] (HDFS-7501) TransactionsSinceLastCheckpoint can be negative on SBNs

2014-12-16 Thread Gautam Gopalakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan updated HDFS-7501: Attachment: HDFS-7501.patch > TransactionsSinceLastCheckpoint can be negative on SBNs

[jira] [Updated] (HDFS-7501) TransactionsSinceLastCheckpoint can be negative on SBNs

2014-12-16 Thread Gautam Gopalakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan updated HDFS-7501: Status: Patch Available (was: Open) > TransactionsSinceLastCheckpoint can be negativ

[jira] [Created] (HDFS-7539) Namenode can't leave safemode because of Datanodes' IPC socket timeout

2014-12-16 Thread hoelog (JIRA)
hoelog created HDFS-7539: Summary: Namenode can't leave safemode because of Datanodes' IPC socket timeout Key: HDFS-7539 URL: https://issues.apache.org/jira/browse/HDFS-7539 Project: Hadoop HDFS Iss

[jira] [Commented] (HDFS-7456) De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode

2014-12-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249472#comment-14249472 ] Vinayakumar B commented on HDFS-7456: - Hi [~cnauroth], do you have any feedback on the

[jira] [Commented] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

2014-12-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249317#comment-14249317 ] Colin Patrick McCabe commented on HDFS-7430: bq. getSubdirEntries, we can direc

[jira] [Commented] (HDFS-7530) Allow renaming an Encryption Zone root

2014-12-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249247#comment-14249247 ] Andrew Wang commented on HDFS-7530: --- Hey Charles, patch looks basically good, just a few

[jira] [Commented] (HDFS-7528) Consolidate symlink-related implementation into a single class

2014-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249246#comment-14249246 ] Hadoop QA commented on HDFS-7528: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7531) Improve the concurrent access on FsVolumeList

2014-12-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249243#comment-14249243 ] Colin Patrick McCabe commented on HDFS-7531: +1. Thanks, Eddy. > Improve the

[jira] [Commented] (HDFS-7536) Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs

2014-12-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249212#comment-14249212 ] Yi Liu commented on HDFS-7536: -- Thanks Haohui for review and commit. > Remove unused CryptoCo

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2014-12-16 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249213#comment-14249213 ] Lei (Eddy) Xu commented on HDFS-6440: - [~jesse_yates] Thanks for your awesome updates.

[jira] [Updated] (HDFS-6440) Support more than 2 NameNodes

2014-12-16 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesse Yates updated HDFS-6440: -- Attachment: hdfs-6440-trunk-v1.patch updated version of the patch as per excellent review comments (thank

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2014-12-16 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249207#comment-14249207 ] Jesse Yates commented on HDFS-6440: --- I'll post the updated patch somewhere, if you like.

[jira] [Commented] (HDFS-7531) Improve the concurrent access on FsVolumeList

2014-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249195#comment-14249195 ] Hadoop QA commented on HDFS-7531: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7530) Allow renaming an Encryption Zone root

2014-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249183#comment-14249183 ] Hadoop QA commented on HDFS-7530: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7521) Refactor DN state management

2014-12-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249167#comment-14249167 ] Ming Ma commented on HDFS-7521: --- Thanks [~wheat9], [~yzhangal] for the comments. * Regarding

[jira] [Created] (HDFS-7538) removedDst should be checked against null in the finally block of FSDirRenameOp#unprotectedRenameTo()

2014-12-16 Thread Ted Yu (JIRA)
Ted Yu created HDFS-7538: Summary: removedDst should be checked against null in the finally block of FSDirRenameOp#unprotectedRenameTo() Key: HDFS-7538 URL: https://issues.apache.org/jira/browse/HDFS-7538 Pro

[jira] [Commented] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

2014-12-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249132#comment-14249132 ] Colin Patrick McCabe commented on HDFS-7430: bq. getVolumeStats and VolumeScann

[jira] [Updated] (HDFS-7537) dfs.namenode.replication.min > 1 && missing replicas && NN restart is confusing

2014-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7537: --- Description: If minimum replication is set to 2 or higher and some of those replicas are missin

[jira] [Created] (HDFS-7537) dfs.namenode.replication.min > 1 && missing replicas && NN restart is confusing

2014-12-16 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-7537: -- Summary: dfs.namenode.replication.min > 1 && missing replicas && NN restart is confusing Key: HDFS-7537 URL: https://issues.apache.org/jira/browse/HDFS-7537 Proje

[jira] [Commented] (HDFS-7056) Snapshot support for truncate

2014-12-16 Thread Byron Wong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249054#comment-14249054 ] Byron Wong commented on HDFS-7056: -- I've been doing some extensive testing on the patches,

[jira] [Commented] (HDFS-7521) Refactor DN state management

2014-12-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249034#comment-14249034 ] Yongjun Zhang commented on HDFS-7521: - Hi [~mingma], Thanks for working on this issue.

[jira] [Commented] (HDFS-7527) TestDecommission.testIncludeByRegistrationName fails occassionally in trunk

2014-12-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249014#comment-14249014 ] Haohui Mai commented on HDFS-7527: -- It loos like the test is flaky, [~cmccabe], do you hav

[jira] [Updated] (HDFS-7531) Improve the concurrent access on FsVolumeList

2014-12-16 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7531: Attachment: HDFS-7531.001.patch Thanks for the reviews, [~cmccabe] and [~wheat9] ! I updated the pat

[jira] [Commented] (HDFS-7527) TestDecommission.testIncludeByRegistrationName fails occassionally in trunk

2014-12-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249005#comment-14249005 ] Haohui Mai commented on HDFS-7527: -- +1 > TestDecommission.testIncludeByRegistrationName f

[jira] [Commented] (HDFS-7521) Refactor DN state management

2014-12-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249001#comment-14249001 ] Haohui Mai commented on HDFS-7521: -- The diagram looks good. My impression of the patch abo

[jira] [Commented] (HDFS-7536) Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248988#comment-14248988 ] Hudson commented on HDFS-7536: -- FAILURE: Integrated in Hadoop-trunk-Commit #6731 (See [https:

[jira] [Commented] (HDFS-7531) Improve the concurrent access on FsVolumeList

2014-12-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248982#comment-14248982 ] Haohui Mai commented on HDFS-7531: -- Looks good to me. Just a minor nit: {code} -List

[jira] [Comment Edited] (HDFS-7536) Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs

2014-12-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248972#comment-14248972 ] Haohui Mai edited comment on HDFS-7536 at 12/16/14 9:29 PM: I'v

[jira] [Updated] (HDFS-7536) Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs

2014-12-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7536: - Assignee: Yi Liu (was: Haohui Mai) > Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs >

[jira] [Updated] (HDFS-7536) Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs

2014-12-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7536: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (HDFS-7536) Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs

2014-12-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7536: - Issue Type: Bug (was: Improvement) > Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs >

[jira] [Moved] (HDFS-7536) Remove unused CryptoCodec in org.apache.hadoop.fs.Hdfs

2014-12-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai moved HADOOP-11413 to HDFS-7536: --- Component/s: (was: security) security Tar

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2014-12-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248953#comment-14248953 ] Colin Patrick McCabe commented on HDFS-7411: Uh oh. Buildbot has become self-a

[jira] [Updated] (HDFS-7521) Refactor DN state management

2014-12-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7521: -- Attachment: HDFS-7521.patch > Refactor DN state management > > > Key

[jira] [Updated] (HDFS-7521) Refactor DN state management

2014-12-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7521: -- Attachment: (was: HDFS-7521.patch) > Refactor DN state management > > >

[jira] [Commented] (HDFS-7534) how to enable namenode GC logging

2014-12-16 Thread Kuldeep Kulkarni (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248933#comment-14248933 ] Kuldeep Kulkarni commented on HDFS-7534: thanks Allen. it started working after I

[jira] [Assigned] (HDFS-7534) how to enable namenode GC logging

2014-12-16 Thread Kuldeep Kulkarni (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuldeep Kulkarni reassigned HDFS-7534: -- Assignee: Kuldeep Kulkarni > how to enable namenode GC logging > ---

[jira] [Commented] (HDFS-7531) Improve the concurrent access on FsVolumeList

2014-12-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248911#comment-14248911 ] Colin Patrick McCabe commented on HDFS-7531: {{addVolume}}: I would prefer not

[jira] [Updated] (HDFS-7535) Utilize Snapshot diff report for distcp

2014-12-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7535: Component/s: snapshots distcp > Utilize Snapshot diff report for distcp > --

[jira] [Updated] (HDFS-7535) Utilize Snapshot diff report for distcp

2014-12-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7535: Attachment: HDFS-7535.000.patch Upload a very initial patch to demo the functionality. The patch adds new op

[jira] [Commented] (HDFS-7535) Utilize Snapshot diff report for distcp

2014-12-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248896#comment-14248896 ] Jing Zhao commented on HDFS-7535: - A typical scenario using snapshot for distcp can be like

[jira] [Resolved] (HDFS-7534) how to enable namenode GC logging

2014-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-7534. Resolution: Not a Problem Not a bug. This is a user configuration problem (%HADOOP_LOG_DIR% i

[jira] [Updated] (HDFS-7530) Allow renaming an Encryption Zone root

2014-12-16 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7530: --- Status: Patch Available (was: Open) > Allow renaming an Encryption Zone root > ---

[jira] [Updated] (HDFS-7530) Allow renaming an Encryption Zone root

2014-12-16 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7530: --- Attachment: HDFS-7530.001.patch The .001 patch adds code to allow renaming an EZ root as well as a test

[jira] [Updated] (HDFS-7521) Refactor DN state management

2014-12-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7521: -- Attachment: HDFS-7521.patch DNStateMachines.png We will limit this jira to the first aspect, the

[jira] [Commented] (HDFS-7527) TestDecommission.testIncludeByRegistrationName fails occassionally in trunk

2014-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248784#comment-14248784 ] Hadoop QA commented on HDFS-7527: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7534) how to enable namenode GC logging

2014-12-16 Thread Kuldeep Kulkarni (JIRA)
Kuldeep Kulkarni created HDFS-7534: -- Summary: how to enable namenode GC logging Key: HDFS-7534 URL: https://issues.apache.org/jira/browse/HDFS-7534 Project: Hadoop HDFS Issue Type: Task

[jira] [Created] (HDFS-7535) Utilize Snapshot diff report for distcp

2014-12-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7535: --- Summary: Utilize Snapshot diff report for distcp Key: HDFS-7535 URL: https://issues.apache.org/jira/browse/HDFS-7535 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-2825) Add test hook to turn off the writer preferring its local DN

2014-12-16 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248733#comment-14248733 ] Nathan Roberts commented on HDFS-2825: -- [~tlipcon] - It might help. I'm a little conce

[jira] [Commented] (HDFS-7494) Checking of closed in DFSInputStream#pread() should be protected by synchronization

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248721#comment-14248721 ] Hudson commented on HDFS-7494: -- FAILURE: Integrated in Hadoop-trunk-Commit #6730 (See [https:

[jira] [Commented] (HDFS-7531) Improve the concurrent access on FsVolumeList

2014-12-16 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248715#comment-14248715 ] Lei (Eddy) Xu commented on HDFS-7531: - The failed test is not related. I have verified

[jira] [Updated] (HDFS-7494) Checking of closed in DFSInputStream#pread() should be protected by synchronization

2014-12-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7494: --- Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: 2.7.0

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2014-12-16 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248674#comment-14248674 ] Jesse Yates commented on HDFS-6440: --- Would you prefer doing this over a pull request/RB?

[jira] [Commented] (HDFS-7533) Datanode sometimes does not shutdown on receiving upgrade shutdown command

2014-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248650#comment-14248650 ] Kihwal Lee commented on HDFS-7533: -- Here is the stack trace. {panel} Exception in threa

[jira] [Created] (HDFS-7533) Datanode sometimes does not shutdown on receiving upgrade shutdown command

2014-12-16 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-7533: Summary: Datanode sometimes does not shutdown on receiving upgrade shutdown command Key: HDFS-7533 URL: https://issues.apache.org/jira/browse/HDFS-7533 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7494) Checking of closed in DFSInputStream#pread() should be protected by synchronization

2014-12-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248530#comment-14248530 ] Ted Yu commented on HDFS-7494: -- TestOfflineEditsViewer passed with patch. The failure doesn't

[jira] [Commented] (HDFS-6425) Large postponedMisreplicatedBlocks has impact on blockReport latency

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248465#comment-14248465 ] Hudson commented on HDFS-6425: -- FAILURE: Integrated in Hadoop-trunk-Commit #6729 (See [https:

[jira] [Commented] (HDFS-6425) Large postponedMisreplicatedBlocks has impact on blockReport latency

2014-12-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248463#comment-14248463 ] Ming Ma commented on HDFS-6425: --- Thanks [~kihwal] and [~arpitagarwal]. > Large postponedMisr

[jira] [Updated] (HDFS-6425) Large postponedMisreplicatedBlocks has impact on blockReport latency

2014-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6425: - Fix Version/s: 2.7.0 > Large postponedMisreplicatedBlocks has impact on blockReport latency > -

[jira] [Updated] (HDFS-6425) Large postponedMisreplicatedBlocks has impact on blockReport latency

2014-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6425: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) I've comm

[jira] [Commented] (HDFS-6425) Large postponedMisreplicatedBlocks has impact on blockReport latency

2014-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248448#comment-14248448 ] Kihwal Lee commented on HDFS-6425: -- +1 I've written a similar patch for the same issue. Th

[jira] [Commented] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2014-12-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248440#comment-14248440 ] Steve Loughran commented on HDFS-7471: -- I think we may want to hold off 24h to see if

[jira] [Updated] (HDFS-7527) TestDecommission.testIncludeByRegistrationName fails occassionally in trunk

2014-12-16 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated HDFS-7527: Attachment: HDFS-7527.001.patch > TestDecommission.testIncludeByRegistrationName fails occassionally

[jira] [Updated] (HDFS-7527) TestDecommission.testIncludeByRegistrationName fails occassionally in trunk

2014-12-16 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated HDFS-7527: Target Version/s: 2.7.0 Status: Patch Available (was: Open) > TestDecommission.testInc

[jira] [Commented] (HDFS-7527) TestDecommission.testIncludeByRegistrationName fails occassionally in trunk

2014-12-16 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248411#comment-14248411 ] Binglin Chang commented on HDFS-7527: - Read some related code, the test is intended to

[jira] [Assigned] (HDFS-6919) Enforce a single limit for RAM disk usage and replicas cached via locking

2014-12-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-6919: --- Assignee: Arpit Agarwal (was: Colin Patrick McCabe) > Enforce a single limit for RAM disk usa

[jira] [Assigned] (HDFS-7527) TestDecommission.testIncludeByRegistrationName fails occassionally in trunk

2014-12-16 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang reassigned HDFS-7527: --- Assignee: Binglin Chang > TestDecommission.testIncludeByRegistrationName fails occassionally i

[jira] [Commented] (HDFS-7516) Fix findbugs warnings in hadoop-nfs project

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248356#comment-14248356 ] Hudson commented on HDFS-7516: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #44 (See

[jira] [Commented] (HDFS-7506) Consolidate implementation of setting inode attributes into a single class

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248351#comment-14248351 ] Hudson commented on HDFS-7506: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #44 (See

[jira] [Commented] (HDFS-7513) HDFS inotify: add defaultBlockSize to CreateEvent

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248355#comment-14248355 ] Hudson commented on HDFS-7513: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #44 (See

[jira] [Commented] (HDFS-7513) HDFS inotify: add defaultBlockSize to CreateEvent

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248315#comment-14248315 ] Hudson commented on HDFS-7513: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #40 (See [http

[jira] [Commented] (HDFS-7506) Consolidate implementation of setting inode attributes into a single class

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248311#comment-14248311 ] Hudson commented on HDFS-7506: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #40 (See [http

[jira] [Commented] (HDFS-7516) Fix findbugs warnings in hadoop-nfs project

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248316#comment-14248316 ] Hudson commented on HDFS-7516: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #40 (See [http

[jira] [Commented] (HDFS-7516) Fix findbugs warnings in hadoop-nfs project

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248299#comment-14248299 ] Hudson commented on HDFS-7516: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1975 (See [https://

[jira] [Commented] (HDFS-7513) HDFS inotify: add defaultBlockSize to CreateEvent

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248298#comment-14248298 ] Hudson commented on HDFS-7513: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1975 (See [https://

[jira] [Commented] (HDFS-7506) Consolidate implementation of setting inode attributes into a single class

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248294#comment-14248294 ] Hudson commented on HDFS-7506: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1975 (See [https://

[jira] [Commented] (HDFS-7516) Fix findbugs warnings in hadoop-nfs project

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248258#comment-14248258 ] Hudson commented on HDFS-7516: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1994 (See [htt

[jira] [Commented] (HDFS-7513) HDFS inotify: add defaultBlockSize to CreateEvent

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248257#comment-14248257 ] Hudson commented on HDFS-7513: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1994 (See [htt

[jira] [Commented] (HDFS-7506) Consolidate implementation of setting inode attributes into a single class

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248253#comment-14248253 ] Hudson commented on HDFS-7506: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1994 (See [htt

[jira] [Commented] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2014-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248212#comment-14248212 ] Hadoop QA commented on HDFS-7471: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248183#comment-14248183 ] Hadoop QA commented on HDFS-7431: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Resolved] (HDFS-7455) TestReplaceDatanodeOnFailure sometimes fails

2014-12-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HDFS-7455. -- Resolution: Duplicate > TestReplaceDatanodeOnFailure sometimes fails > --

[jira] [Commented] (HDFS-7455) TestReplaceDatanodeOnFailure sometimes fails

2014-12-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248149#comment-14248149 ] Steve Loughran commented on HDFS-7455: -- duplicate of HDFS-6101 > TestReplaceDatanodeO

[jira] [Commented] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248126#comment-14248126 ] Hadoop QA commented on HDFS-7523: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7516) Fix findbugs warnings in hadoop-nfs project

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248123#comment-14248123 ] Hudson commented on HDFS-7516: -- FAILURE: Integrated in Hadoop-Yarn-trunk #777 (See [https://b

[jira] [Commented] (HDFS-7513) HDFS inotify: add defaultBlockSize to CreateEvent

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248122#comment-14248122 ] Hudson commented on HDFS-7513: -- FAILURE: Integrated in Hadoop-Yarn-trunk #777 (See [https://b

[jira] [Commented] (HDFS-7506) Consolidate implementation of setting inode attributes into a single class

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248118#comment-14248118 ] Hudson commented on HDFS-7506: -- FAILURE: Integrated in Hadoop-Yarn-trunk #777 (See [https://b

[jira] [Commented] (HDFS-7506) Consolidate implementation of setting inode attributes into a single class

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248106#comment-14248106 ] Hudson commented on HDFS-7506: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #43 (See [http

[jira] [Commented] (HDFS-7516) Fix findbugs warnings in hadoop-nfs project

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248111#comment-14248111 ] Hudson commented on HDFS-7516: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #43 (See [http

[jira] [Commented] (HDFS-7513) HDFS inotify: add defaultBlockSize to CreateEvent

2014-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248110#comment-14248110 ] Hudson commented on HDFS-7513: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #43 (See [http

[jira] [Commented] (HDFS-7529) Consolidate encryption zone related implementation into a single class

2014-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248075#comment-14248075 ] Hadoop QA commented on HDFS-7529: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2014-12-16 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated HDFS-7471: Attachment: HDFS-7471.001.patch Simple work around to increase expire interval. After investigate the

[jira] [Updated] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2014-12-16 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated HDFS-7471: Target Version/s: 2.7.0 Status: Patch Available (was: Open) > TestDatanodeManager#test

[jira] [Commented] (HDFS-7531) Improve the concurrent access on FsVolumeList

2014-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247939#comment-14247939 ] Hadoop QA commented on HDFS-7531: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-12-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Attachment: HDFS-7431.003.patch Hi Chris, sorry for the late update, I was not available last week. Please review t

[jira] [Commented] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2014-12-16 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247915#comment-14247915 ] Binglin Chang commented on HDFS-7471: - The failure is because the datanode is expired,