[jira] [Updated] (HDFS-10263) Provide symmetric entries in reversed snapshot diff report

2016-04-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10263: - Summary: Provide symmetric entries in reversed snapshot diff report (was: Reversed snapshot diff report c

[jira] [Updated] (HDFS-10263) Provide symmetric entries in reversed snapshot diff report

2016-04-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10263: - Component/s: snapshots namenode > Provide symmetric entries in reversed snapshot diff rep

[jira] [Updated] (HDFS-10263) Reversed snapshot diff report contains incorrect entries

2016-04-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10263: - Issue Type: Improvement (was: Bug) > Reversed snapshot diff report contains incorrect entries > -

[jira] [Assigned] (HDFS-10263) Reversed snapshot diff report contains incorrect entries

2016-04-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-10263: Assignee: Jing Zhao > Reversed snapshot diff report contains incorrect entries > --

[jira] [Commented] (HDFS-10192) Namenode safemode not coming out during failover

2016-04-05 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227823#comment-15227823 ] Brahma Reddy Battula commented on HDFS-10192: - Test failures are unrelated..

[jira] [Commented] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

2016-04-05 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227810#comment-15227810 ] GAO Rui commented on HDFS-7661: --- Hi [~zhz], [~liuml07] and I have discussed about {{two versi

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227812#comment-15227812 ] Hadoop QA commented on HDFS-6489: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10263) Reversed snapshot diff report contains incorrect entries

2016-04-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227805#comment-15227805 ] Jing Zhao commented on HDFS-10263: -- bq. I think using forward snapshot diff as my rev 00

[jira] [Updated] (HDFS-9719) Refactoring ErasureCodingWorker into smaller reusable constructs

2016-04-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9719: Attachment: HDFS-9719-v9.patch Fixed the reported check style. > Refactoring ErasureCodingWorker into smalle

[jira] [Updated] (HDFS-10265) OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag

2016-04-05 Thread Wan Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Chang updated HDFS-10265: - Description: I use OEV tool to convert editlog to xml file, then convert the xml file back to binary edit

[jira] [Updated] (HDFS-10265) OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag

2016-04-05 Thread Wan Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Chang updated HDFS-10265: - Description: I use OEV tool to convert editlog to xml file, then convert the xml file back to binary edit

[jira] [Updated] (HDFS-10265) OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag

2016-04-05 Thread Wan Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Chang updated HDFS-10265: - Status: Patch Available (was: Open) submit patch > OEV tool fails to read edit xml file if OP_UPDATE_BLO

[jira] [Updated] (HDFS-10265) OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag

2016-04-05 Thread Wan Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Chang updated HDFS-10265: - Attachment: HDFS-10265-001.patch > OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK t

[jira] [Commented] (HDFS-10265) OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag

2016-04-05 Thread Wan Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227787#comment-15227787 ] Wan Chang commented on HDFS-10265: -- FSEditLogOp$UpdateBlocksOp.fromXml: {code} void f

[jira] [Updated] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

2016-04-05 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-7661: -- Attachment: Undo-Log-Design-20160406.jpg > [umbrella] support hflush and hsync for erasure coded files >

[jira] [Created] (HDFS-10265) OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag

2016-04-05 Thread Wan Chang (JIRA)
Wan Chang created HDFS-10265: Summary: OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag Key: HDFS-10265 URL: https://issues.apache.org/jira/browse/HDFS-10265 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6520) hdfs fsck -move not working

2016-04-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227779#comment-15227779 ] Xiao Chen commented on HDFS-6520: - Test failure looks unrelated and passed locally. > hdfs

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-04-05 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1522#comment-1522 ] Brahma Reddy Battula commented on HDFS-9530: [~arpitagarwal] are you referring

[jira] [Commented] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227759#comment-15227759 ] Hadoop QA commented on HDFS-9918: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9719) Refactoring ErasureCodingWorker into smaller reusable constructs

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227755#comment-15227755 ] Hadoop QA commented on HDFS-9719: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HDFS-10263) Reversed snapshot diff report contains incorrect entries

2016-04-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227739#comment-15227739 ] Yongjun Zhang edited comment on HDFS-10263 at 4/6/16 5:21 AM: --

[jira] [Commented] (HDFS-10263) Reversed snapshot diff report contains incorrect entries

2016-04-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227739#comment-15227739 ] Yongjun Zhang commented on HDFS-10263: -- Thanks [~jingzhao]! I agree that what you st

[jira] [Commented] (HDFS-10192) Namenode safemode not coming out during failover

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227727#comment-15227727 ] Hadoop QA commented on HDFS-10192: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-6520) hdfs fsck -move not working

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227661#comment-15227661 ] Hadoop QA commented on HDFS-6520: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9583) TestBlockReplacement#testDeletedBlockWhenAddBlockIsInEdit occasionally fails

2016-04-05 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227625#comment-15227625 ] Lin Yiqun commented on HDFS-9583: - Hi, [~jojochuang], this issue has fixed in HDFS-9865, ca

[jira] [Updated] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-04-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6489: -- Status: Patch Available (was: In Progress) > DFS Used space is not correct computed on frequent append o

[jira] [Updated] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-04-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6489: -- Attachment: HDFS-6489.003.patch > DFS Used space is not correct computed on frequent append operations >

[jira] [Updated] (HDFS-10192) Namenode safemode not coming out during failover

2016-04-05 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10192: Attachment: HDFS-10192-03.patch [~jingzhao] thanks for taking a look into this issue

[jira] [Updated] (HDFS-9744) TestDirectoryScanner#testThrottling occasionally time out after 300 seconds

2016-04-05 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9744: Status: Patch Available (was: Open) > TestDirectoryScanner#testThrottling occasionally time out after 300 se

[jira] [Assigned] (HDFS-9744) TestDirectoryScanner#testThrottling occasionally time out after 300 seconds

2016-04-05 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun reassigned HDFS-9744: --- Assignee: Lin Yiqun > TestDirectoryScanner#testThrottling occasionally time out after 300 seconds > --

[jira] [Updated] (HDFS-9744) TestDirectoryScanner#testThrottling occasionally time out after 300 seconds

2016-04-05 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9744: Attachment: HDFS-9744.001.patch > TestDirectoryScanner#testThrottling occasionally time out after 300 seconds

[jira] [Commented] (HDFS-9744) TestDirectoryScanner#testThrottling occasionally time out after 300 seconds

2016-04-05 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227601#comment-15227601 ] Lin Yiqun commented on HDFS-9744: - Thanks [~jojochuang] for finding this. I agree comments

[jira] [Commented] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

2016-04-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227599#comment-15227599 ] Rakesh R commented on HDFS-9918: Thanks a lot [~zhz] for making it clear. I've attached ano

[jira] [Updated] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

2016-04-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9918: --- Attachment: HDFS-9918-009.patch > Erasure Coding: Sort located striped blocks based on decommissioned states >

[jira] [Commented] (HDFS-10235) [NN UI] Last contact for Live Nodes should be relative time

2016-04-05 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227559#comment-15227559 ] Brahma Reddy Battula commented on HDFS-10235: - [~raviprak] thanks a lot for re

[jira] [Updated] (HDFS-9719) Refactoring ErasureCodingWorker into smaller reusable constructs

2016-04-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9719: Attachment: HDFS-9719-v8.patch Rebased with latest trunk, manually merging two recent fixes. > Refactoring E

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2016-04-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227547#comment-15227547 ] Tsz Wo Nicholas Sze commented on HDFS-8791: --- > ... The actual code that does heav

[jira] [Commented] (HDFS-9735) DiskBalancer : Refactor moveBlockAcrossStorage to be used by disk balancer

2016-04-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227539#comment-15227539 ] Anu Engineer commented on HDFS-9735: test failure is not related, and checkstyle is ign

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227509#comment-15227509 ] Konstantin Shvachko commented on HDFS-10264: Add the following to {{FSImageFor

[jira] [Created] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-05 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-10264: -- Summary: Logging improvements in FSImageFormatProtobuf.Saver Key: HDFS-10264 URL: https://issues.apache.org/jira/browse/HDFS-10264 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6520) hdfs fsck -move not working

2016-04-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-6520: Attachment: HDFS-6520.02.patch Thanks [~cmccabe] for the review! Good idea - we should actively detect and p

[jira] [Commented] (HDFS-9735) DiskBalancer : Refactor moveBlockAcrossStorage to be used by disk balancer

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227481#comment-15227481 ] Hadoop QA commented on HDFS-9735: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10263) Reversed snapshot diff report contains incorrect entries

2016-04-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227468#comment-15227468 ] Jing Zhao commented on HDFS-10263: -- Thanks for reporting the issue, Yongjun! Actually I'm

[jira] [Comment Edited] (HDFS-10263) Reversed snapshot diff report contains incorrect entries

2016-04-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227468#comment-15227468 ] Jing Zhao edited comment on HDFS-10263 at 4/6/16 12:54 AM: --- Than

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-04-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227467#comment-15227467 ] Arpit Agarwal commented on HDFS-9530: - I think there was a related fix to HDFS-8072. I

[jira] [Commented] (HDFS-6520) hdfs fsck -move not working

2016-04-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227464#comment-15227464 ] Colin Patrick McCabe commented on HDFS-6520: Thanks, [~xiaochen]. It does look

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-04-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227441#comment-15227441 ] Ravi Prakash commented on HDFS-9530: HDFS-8072 has not fixed this for us. [~arpitagarwa

[jira] [Commented] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

2016-04-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227433#comment-15227433 ] Mingliang Liu commented on HDFS-7661: - Thanks for the detailed explanation, [~zhz]. I g

[jira] [Commented] (HDFS-6520) hdfs fsck -move not working

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227434#comment-15227434 ] Hadoop QA commented on HDFS-6520: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-04-05 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-3702: Attachment: HDFS-3702.011.patch Hey, [~szetszwo] Thanks a lot for your good suggestions. bq. Plea

[jira] [Commented] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

2016-04-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227406#comment-15227406 ] Zhe Zhang commented on HDFS-7661: - Thanks for the discussions [~demongaorui], [~jingzhao],

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-04-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227402#comment-15227402 ] Ravi Prakash commented on HDFS-9530: I took a heap dump of the Datanode process. I see

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-04-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227388#comment-15227388 ] Yongjun Zhang commented on HDFS-9820: - Hi [~jingzhao] and [~yufeigu], Thanks much for

[jira] [Commented] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

2016-04-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227376#comment-15227376 ] Zhe Zhang commented on HDFS-9918: - bq. That's why I don't see the point maintain the order

[jira] [Commented] (HDFS-10263) Reversed snapshot diff report contains incorrect entries

2016-04-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227375#comment-15227375 ] Yongjun Zhang commented on HDFS-10263: -- The following code {code} /** * Recursi

[jira] [Created] (HDFS-10263) Reversed snapshot diff report contains incorrect entries

2016-04-05 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10263: Summary: Reversed snapshot diff report contains incorrect entries Key: HDFS-10263 URL: https://issues.apache.org/jira/browse/HDFS-10263 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10251) Ozone: Shutdown cleanly

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227356#comment-15227356 ] Hadoop QA commented on HDFS-10251: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml

2016-04-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227337#comment-15227337 ] Ray Chiang commented on HDFS-8356: -- [~ajisakaa], for 1. above, I don't see these propertie

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2016-04-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227336#comment-15227336 ] Chris Nauroth commented on HDFS-8791: - [~kihwal], I understand now. I mistook the earl

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2016-04-05 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227305#comment-15227305 ] Kihwal Lee commented on HDFS-8791: -- If the downgrade is only between these two datanode la

[jira] [Updated] (HDFS-9735) DiskBalancer : Refactor moveBlockAcrossStorage to be used by disk balancer

2016-04-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9735: --- Attachment: HDFS-9735-HDFS-1312.002.patch Rebased the patch and addressed all code review comments from

[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227218#comment-15227218 ] Hadoop QA commented on HDFS-10207: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10261) TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports

2016-04-05 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10261: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved (w

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227203#comment-15227203 ] Hadoop QA commented on HDFS-10209: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-6520) hdfs fsck -move not working

2016-04-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227185#comment-15227185 ] Xiao Chen commented on HDFS-6520: - So the root cause is that {{fsck -move}} will throw exce

[jira] [Commented] (HDFS-10261) TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports

2016-04-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227176#comment-15227176 ] Hudson commented on HDFS-10261: --- FAILURE: Integrated in Hadoop-trunk-Commit #9564 (See [htt

[jira] [Updated] (HDFS-6520) hdfs fsck -move not working

2016-04-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-6520: Attachment: HDFS-6520.01.patch > hdfs fsck -move not working > --- > >

[jira] [Updated] (HDFS-6520) hdfs fsck -move not working

2016-04-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-6520: Status: Patch Available (was: In Progress) > hdfs fsck -move not working > --- > >

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227171#comment-15227171 ] Hadoop QA commented on HDFS-9869: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2016-04-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227167#comment-15227167 ] Chris Nauroth commented on HDFS-8791: - We often see that the layout version has to bump

[jira] [Commented] (HDFS-10261) TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports

2016-04-05 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227155#comment-15227155 ] Kihwal Lee commented on HDFS-10261: --- +1 the latest patch looks good. > TestBookKeeperHA

[jira] [Updated] (HDFS-6520) hdfs fsck -move not working

2016-04-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-6520: Attachment: john.test.patch Seems John didn't get a complete test patch when uploading. Fortunately he hands

[jira] [Commented] (HDFS-10261) TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227153#comment-15227153 ] Hadoop QA commented on HDFS-10261: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Assigned] (HDFS-6520) hdfs fsck -move not working

2016-04-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-6520: --- Assignee: Xiao Chen (was: John Zhuge) > hdfs fsck -move not working > --- > >

[jira] [Commented] (HDFS-10262) Change HdfsFileStatus::fileId to an opaque identifier

2016-04-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227148#comment-15227148 ] Chris Douglas commented on HDFS-10262: -- For compatibility with existing 2.x clients,

[jira] [Created] (HDFS-10262) Change HdfsFileStatus::fileId to an opaque identifier

2016-04-05 Thread Chris Douglas (JIRA)
Chris Douglas created HDFS-10262: Summary: Change HdfsFileStatus::fileId to an opaque identifier Key: HDFS-10262 URL: https://issues.apache.org/jira/browse/HDFS-10262 Project: Hadoop HDFS Iss

[jira] [Commented] (HDFS-10192) Namenode safemode not coming out during failover

2016-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227125#comment-15227125 ] Hadoop QA commented on HDFS-10192: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10235) [NN UI] Last contact for Live Nodes should be relative time

2016-04-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227120#comment-15227120 ] Hudson commented on HDFS-10235: --- FAILURE: Integrated in Hadoop-trunk-Commit #9563 (See [htt

[jira] [Updated] (HDFS-10251) Ozone: Shutdown cleanly

2016-04-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10251: Status: Patch Available (was: Open) > Ozone: Shutdown cleanly > --- > >

[jira] [Updated] (HDFS-10235) [NN UI] Last contact for Live Nodes should be relative time

2016-04-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-10235: Affects Version/s: 2.8.0 > [NN UI] Last contact for Live Nodes should be relative time > ---

[jira] [Updated] (HDFS-10235) [NN UI] Last contact for Live Nodes should be relative time

2016-04-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-10235: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Target Version

[jira] [Commented] (HDFS-10235) [NN UI] Last contact for Live Nodes should be relative time

2016-04-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227105#comment-15227105 ] Ravi Prakash commented on HDFS-10235: - Committed to trunk, branch-2 and branch-2.8 >

[jira] [Commented] (HDFS-10235) [NN UI] Last contact for Live Nodes should be relative time

2016-04-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227095#comment-15227095 ] Ravi Prakash commented on HDFS-10235: - Thanks Brahma! LGTM. +1. Committing shortly >

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-04-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227081#comment-15227081 ] Ravi Prakash commented on HDFS-9530: Thanks for reporting Fei Hui. I can confirm that w

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-04-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227079#comment-15227079 ] Xiaobing Zhou commented on HDFS-9427: - I verified the test failures are not related to

[jira] [Updated] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-04-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-9530: --- Affects Version/s: 2.7.1 > huge Non-DFS Used in hadoop 2.6.2 & 2.7.1 >

[jira] [Commented] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

2016-04-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227058#comment-15227058 ] Mingliang Liu commented on HDFS-7661: - Thanks for proposing solutions to this problem.

[jira] [Updated] (HDFS-10250) Ozone: Add key Persistence

2016-04-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10250: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Comment Edited] (HDFS-10261) TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports

2016-04-05 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226994#comment-15226994 ] Kihwal Lee edited comment on HDFS-10261 at 4/5/16 7:59 PM: --- Did

[jira] [Commented] (HDFS-9735) DiskBalancer : Refactor moveBlockAcrossStorage to be used by disk balancer

2016-04-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227025#comment-15227025 ] Anu Engineer commented on HDFS-9735: [~eddyxu] Thanks for your code review comments. b

[jira] [Updated] (HDFS-10261) TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports

2016-04-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10261: --- Attachment: HDFS-10261.002.patch Well that's embarrassing. Good catch, [~kihwal]. Submitting new patch

[jira] [Commented] (HDFS-10261) TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports

2016-04-05 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226994#comment-15226994 ] Kihwal Lee commented on HDFS-10261: --- Did you meant to do this? {code:java} .

[jira] [Updated] (HDFS-9720) DiskBalancer : Add configuration parameters

2016-04-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9720: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) [~edd

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-04-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226925#comment-15226925 ] Xiaobing Zhou commented on HDFS-10209: -- v001 is rebased on trunk. Can anyone let me k

[jira] [Updated] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-04-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10209: - Attachment: HDFS-10209-HDFS-9000.001.patch > Support enable caller context in HDFS namenode audit

[jira] [Commented] (HDFS-3743) QJM: improve formatting behavior for JNs

2016-04-05 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226909#comment-15226909 ] Jian Fang commented on HDFS-3743: - I added a formatNonFileJournalsIfNecessary() method to F

[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226870#comment-15226870 ] Xiaobing Zhou commented on HDFS-10207: -- v003 is rebased on trunk, fixed a couple of t

[jira] [Updated] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10207: - Attachment: HDFS-10207-HDFS-9000.003.patch > Support enable Hadoop IPC backoff without namenode re

[jira] [Updated] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

2016-04-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9869: --- Attachment: HDFS-9869-004.patch [~zhz], It seems patch need to rebase in latest trunk code, I'm attaching prev

[jira] [Assigned] (HDFS-10260) TestFsDatasetImpl#testCleanShutdownOfVolume often fails

2016-04-05 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah reassigned HDFS-10260: - Assignee: Rushabh S Shah > TestFsDatasetImpl#testCleanShutdownOfVolume often fails >

  1   2   >