[jira] [Updated] (HDFS-10924) Add a new instrumented read-write lock

2016-09-30 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-10924: Attachment: HDFS-10924-2.patch Remove some unnecessary classes, add unit tests, and fix the warnings

[jira] [Commented] (HDFS-10924) Add a new instrumented read-write lock

2016-09-30 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535467#comment-15535467 ] Jingcheng Du commented on HDFS-10924: - Hi [~arpitagarwal], I will have a vocation in t

[jira] [Comment Edited] (HDFS-10924) Add a new instrumented read-write lock

2016-09-30 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535467#comment-15535467 ] Jingcheng Du edited comment on HDFS-10924 at 9/30/16 8:59 AM: --

[jira] [Commented] (HDFS-10924) Add a new instrumented read-write lock

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535571#comment-15535571 ] Hadoop QA commented on HDFS-10924: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-10907) Fix Erasure Coding documentation

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535858#comment-15535858 ] Wei-Chiu Chuang commented on HDFS-10907: +1. > Fix Erasure Coding documentation >

[jira] [Commented] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535885#comment-15535885 ] Wei-Chiu Chuang commented on HDFS-10910: +1 > HDFS Erasure Coding doc should stat

[jira] [Commented] (HDFS-10683) Make class Token$PrivateToken private

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15535969#comment-15535969 ] Wei-Chiu Chuang commented on HDFS-10683: Weird. I sawTestFileChecksum has 9 test f

[jira] [Commented] (HDFS-10850) getEZForPath should NOT throw FNF

2016-09-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536034#comment-15536034 ] Kihwal Lee commented on HDFS-10850: --- +1 for the latest patch. > getEZForPath should NOT

[jira] [Issue Comment Deleted] (HDFS-10850) getEZForPath should NOT throw FNF

2016-09-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10850: -- Comment: was deleted (was: +1 for the latest patch.) > getEZForPath should NOT throw FNF >

[jira] [Commented] (HDFS-10850) getEZForPath should NOT throw FNF

2016-09-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536040#comment-15536040 ] Kihwal Lee commented on HDFS-10850: --- +1 for the patch. > getEZForPath should NOT throw

[jira] [Commented] (HDFS-10683) Make class Token$PrivateToken private

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536070#comment-15536070 ] Wei-Chiu Chuang commented on HDFS-10683: The tests failed after HDFS-10460. Maybe

[jira] [Updated] (HDFS-6255) fuse_dfs will not adhere to ACL permissions in some cases

2016-09-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6255: Assignee: (was: Chris Nauroth) I'm not actively working on this, so I'm unassigning. > fuse_dfs

[jira] [Resolved] (HDFS-6277) WebHdfsFileSystem#toUrl does not perform character escaping for rename

2016-09-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-6277. - Resolution: Won't Fix This bug is present in the 1.x line, but not 2.x or 3.x. I'm resolving this

[jira] [Created] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Eric Badger (JIRA)
Eric Badger created HDFS-10934: -- Summary: TestDFSShell.testStat fails intermittently Key: HDFS-10934 URL: https://issues.apache.org/jira/browse/HDFS-10934 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-10850) getEZForPath should NOT throw FNF

2016-09-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10850: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Commented] (HDFS-10850) getEZForPath should NOT throw FNF

2016-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536126#comment-15536126 ] Hudson commented on HDFS-10850: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Created] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10935: -- Summary: TestFileChecksum tests are failing after HDFS-10460 (Mac only?) Key: HDFS-10935 URL: https://issues.apache.org/jira/browse/HDFS-10935 Project: Hadoop HDF

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536182#comment-15536182 ] Wei-Chiu Chuang commented on HDFS-10935: [~drankye] can you please take a look? >

[jira] [Created] (HDFS-10936) allow snapshot command should not print exception trace when folder not found

2016-09-30 Thread Jagadesh Kiran N (JIRA)
Jagadesh Kiran N created HDFS-10936: --- Summary: allow snapshot command should not print exception trace when folder not found Key: HDFS-10936 URL: https://issues.apache.org/jira/browse/HDFS-10936 Pro

[jira] [Commented] (HDFS-10683) Make class Token$PrivateToken private

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536280#comment-15536280 ] Wei-Chiu Chuang commented on HDFS-10683: Triggered a rebuild to see if the failed

[jira] [Updated] (HDFS-10595) libhdfs++: Client Name Protobuf Error

2016-09-30 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-10595: -- Resolution: Fixed Status: Resolved (was: Patch Available) Landed with feba09b > libhdfs++: Cli

[jira] [Updated] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10934: --- Status: Patch Available (was: Open) > TestDFSShell.testStat fails intermittently > --

[jira] [Updated] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10934: --- Attachment: HDFS-10934.001.patch After talking offline with [~daryn], we came to the conclusion that t

[jira] [Commented] (HDFS-5239) Allow FSNamesystem lock fairness to be configurable

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536471#comment-15536471 ] Zhe Zhang commented on HDFS-5239: - [~daryn] While working on HDFS-10896 we are revisiting t

[jira] [Created] (HDFS-10937) libhdfs++: hdfsRead return -1 at eof

2016-09-30 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-10937: - Summary: libhdfs++: hdfsRead return -1 at eof Key: HDFS-10937 URL: https://issues.apache.org/jira/browse/HDFS-10937 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10896: --- Attachment: (was: HDFS-10896.004.patch) > Move lock logging logic from FSNamesystem into FSNamesys

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10896: --- Attachment: HDFS-10896.004.patch > Move lock logging logic from FSNamesystem into FSNamesystemLock > -

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536482#comment-15536482 ] Zhe Zhang commented on HDFS-10896: -- Thanks Erik for the work and [~eddyxu], [~hanishakone

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10896: --- Attachment: HDFS-10896.004.patch After looking at HDFS-5239 it turns out the lack of documentation for

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536501#comment-15536501 ] Zhe Zhang commented on HDFS-10896: -- Thanks Erik for the update. One last nit: {code} FS

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536508#comment-15536508 ] Erik Krogen commented on HDFS-10896: The constructor which accepts a Timer parameter i

[jira] [Updated] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10918: - Attachment: HDFS-10918.05.patch Oops, new test case caught the command renaming.. > Add a tool to get Fil

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536530#comment-15536530 ] Zhe Zhang commented on HDFS-10896: -- Thanks for the clarification. Agreed we should keep i

[jira] [Commented] (HDFS-10925) Cache symlinkString in INodeSymlink

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536537#comment-15536537 ] Daryn Sharp commented on HDFS-10925: Thanks! I'm a bit conflicted to retain both to a

[jira] [Created] (HDFS-10938) Ozone: SCM: Add datanode protocol

2016-09-30 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-10938: --- Summary: Ozone: SCM: Add datanode protocol Key: HDFS-10938 URL: https://issues.apache.org/jira/browse/HDFS-10938 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-10797: - Attachment: HDFS-10797.007.patch Thanks, [~xiaochen]. Removed the count variable and fixed the Jav

[jira] [Updated] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-09-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10912: Description: Add chill mode support : That is to add the ability to force exit or enter chill mode.

[jira] [Updated] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10932: -- Attachment: HDFS-10932-HDFS-7240.002.patch Rebased and fixed naming. > Ozone : fix XceiverClient slow s

[jira] [Updated] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-09-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10912: Description: Add Safe mode support : That is to add the ability to force exit or enter chill mode. A

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536588#comment-15536588 ] Eric Badger commented on HDFS-10921: Looks good to me. [~shahrs87], do you have any co

[jira] [Commented] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536593#comment-15536593 ] Kihwal Lee commented on HDFS-10851: --- Other than the IIP/src optimizations, I see nice cl

[jira] [Updated] (HDFS-10938) Ozone: SCM: Add datanode protocol

2016-09-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10938: Attachment: HDFS-10938-HDFS-7240.001.patch > Ozone: SCM: Add datanode protocol > ---

[jira] [Updated] (HDFS-10938) Ozone: SCM: Add datanode protocol

2016-09-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10938: Status: Patch Available (was: Open) > Ozone: SCM: Add datanode protocol > -

[jira] [Commented] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536610#comment-15536610 ] Kihwal Lee commented on HDFS-10851: --- Committed to trunk, but it does not apply to branch

[jira] [Updated] (HDFS-10936) allow snapshot command should not print exception trace when folder not found

2016-09-30 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-10936: Description: Allow snapshot for a folder which is not present {code}./hdfs dfsadmin -allow

[jira] [Commented] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536629#comment-15536629 ] Hadoop QA commented on HDFS-10934: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-30 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536630#comment-15536630 ] Rushabh S Shah commented on HDFS-10921: --- bq. Rushabh S Shah, do you have any concern

[jira] [Commented] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536640#comment-15536640 ] Hudson commented on HDFS-10851: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-10908) Improve StripedBlockReader#createBlockReader error logging

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536643#comment-15536643 ] Wei-Chiu Chuang commented on HDFS-10908: LGTM. Test case not needed since it's a l

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536649#comment-15536649 ] Hadoop QA commented on HDFS-10896: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536651#comment-15536651 ] Xiaoyu Yao commented on HDFS-10690: --- [~fenghua_hu], we will need to update {{TestEnhance

[jira] [Comment Edited] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536651#comment-15536651 ] Xiaoyu Yao edited comment on HDFS-10690 at 9/30/16 6:34 PM: [~

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536676#comment-15536676 ] Konstantin Shvachko commented on HDFS-10301: I think the solution for the {{ch

[jira] [Commented] (HDFS-7642) NameNode should periodically log DataNode decommissioning progress

2016-09-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536701#comment-15536701 ] Sean Mackrory commented on HDFS-7642: - Hey [~zhz] - I'd like to work on this, if that's

[jira] [Updated] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10851: --- Attachment: HDFS-10851.branch-2.patch Just had to remove a few references to EC policy. > FSDirStatAn

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536780#comment-15536780 ] Hadoop QA commented on HDFS-10797: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536798#comment-15536798 ] Hadoop QA commented on HDFS-10932: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-10939) Reduce performance penalty of encryption zones

2016-09-30 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10939: -- Summary: Reduce performance penalty of encryption zones Key: HDFS-10939 URL: https://issues.apache.org/jira/browse/HDFS-10939 Project: Hadoop HDFS Issue Type: Su

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536805#comment-15536805 ] Sean Mackrory commented on HDFS-10797: -- findbugs output is correct: I'm using synchro

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536810#comment-15536810 ] Hadoop QA commented on HDFS-10918: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-09-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536813#comment-15536813 ] Xiaoyu Yao commented on HDFS-10912: --- Thanks @Anu for reporting the issue and posting the

[jira] [Commented] (HDFS-10938) Ozone: SCM: Add datanode protocol

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536819#comment-15536819 ] Hadoop QA commented on HDFS-10938: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10908) Improve StripedBlockReader#createBlockReader error logging

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10908: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536841#comment-15536841 ] Xiao Chen commented on HDFS-10918: -- Failed tests look unrelated and passed locally. Will

[jira] [Updated] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10910: --- Target Version/s: 3.0.0-alpha2 > HDFS Erasure Coding doc should state its currently supported

[jira] [Updated] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10910: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed the patch to trun

[jira] [Updated] (HDFS-10907) Fix Erasure Coding documentation

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10907: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Sta

[jira] [Commented] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536934#comment-15536934 ] Hudson commented on HDFS-10910: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-10908) Improve StripedBlockReader#createBlockReader error logging

2016-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536939#comment-15536939 ] Hudson commented on HDFS-10908: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-10907) Fix Erasure Coding documentation

2016-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536938#comment-15536938 ] Hudson commented on HDFS-10907: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-7642) NameNode should periodically log DataNode decommissioning progress

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15536954#comment-15536954 ] Zhe Zhang commented on HDFS-7642: - [~mackrorysd] Sure! Thanks for the interest. Unassigning

[jira] [Updated] (HDFS-7642) NameNode should periodically log DataNode decommissioning progress

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7642: Assignee: (was: Zhe Zhang) > NameNode should periodically log DataNode decommissioning progress > ---

[jira] [Assigned] (HDFS-7642) NameNode should periodically log DataNode decommissioning progress

2016-09-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory reassigned HDFS-7642: --- Assignee: Sean Mackrory > NameNode should periodically log DataNode decommissioning progress >

[jira] [Updated] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-10797: - Attachment: HDFS-10797.008.patch Attaching a patch that address the findbugs warnings. > Disk usa

[jira] [Updated] (HDFS-10939) Reduce performance penalty of encryption zones

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10939: --- Attachment: HDFS-10939.patch Full use of IIP in EncryptionZoneManager and FsDirEncryptionZoneOp requir

[jira] [Updated] (HDFS-10939) Reduce performance penalty of encryption zones

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10939: --- Status: Patch Available (was: Open) > Reduce performance penalty of encryption zones > --

[jira] [Created] (HDFS-10940) Reduce performance penalty of block caching when not used

2016-09-30 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10940: -- Summary: Reduce performance penalty of block caching when not used Key: HDFS-10940 URL: https://issues.apache.org/jira/browse/HDFS-10940 Project: Hadoop HDFS Iss

[jira] [Updated] (HDFS-10940) Reduce performance penalty of block caching when not used

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10940: --- Status: Patch Available (was: Open) > Reduce performance penalty of block caching when not used > ---

[jira] [Updated] (HDFS-10940) Reduce performance penalty of block caching when not used

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10940: --- Attachment: HDFS-10940.patch Very simple patch. Pass LocatedBlocks to CacheManager. CM immediately r

[jira] [Commented] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15537011#comment-15537011 ] Mingliang Liu commented on HDFS-10934: -- [~ebadger], it's a nice catch! I think the pa

[jira] [Updated] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10934: - Issue Type: Sub-task (was: Bug) Parent: HDFS-10891 > TestDFSShell.testStat fails intermit

[jira] [Updated] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10934: - Target Version/s: 2.8.0 Component/s: test > TestDFSShell.testStat fails intermittently >

[jira] [Updated] (HDFS-10891) Über-jira: Test Improvement by adding missing test cases for existing code

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10891: - Target Version/s: 2.8.0 (was: 3.0.0-alpha2) > Über-jira: Test Improvement by adding missing test

[jira] [Commented] (HDFS-10939) Reduce performance penalty of encryption zones

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15537029#comment-15537029 ] Hadoop QA commented on HDFS-10939: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15537032#comment-15537032 ] Chen Liang commented on HDFS-10932: --- The failed tests do not seem to be related, local r

[jira] [Commented] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15537044#comment-15537044 ] Anu Engineer commented on HDFS-10932: - [~vagarychen] Thanks for checking. Since the ex

[jira] [Commented] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15537047#comment-15537047 ] Eric Badger commented on HDFS-10934: bq. I then realized that perhaps I should not rel

[jira] [Commented] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15537052#comment-15537052 ] Kihwal Lee commented on HDFS-10851: --- The branch-2 patch looks good. The only difference

[jira] [Commented] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15537065#comment-15537065 ] Chen Liang commented on HDFS-10932: --- Sure! I updated the patch a second time to trigger

[jira] [Updated] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10851: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Updated] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10932: -- Attachment: HDFS-10932-HDFS-7240.002.patch > Ozone : fix XceiverClient slow shutdown > -

[jira] [Commented] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15537070#comment-15537070 ] Anu Engineer commented on HDFS-10932: - scheduled a new build https://builds.apache.or

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15537074#comment-15537074 ] Eric Badger commented on HDFS-10921: Quick update: Adding the @Before method as [~xkro

[jira] [Updated] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10609: --- Attachment: HDFS-10609.branch-2.7.02.patch Most code style warnings are unrelated. The test fa

[jira] [Updated] (HDFS-10619) Cache path in InodesInPath

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10619: --- Attachment: HDFS-10619.1.patch Updated. > Cache path in InodesInPath > -- > >

[jira] [Commented] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15537088#comment-15537088 ] Mingliang Liu commented on HDFS-10934: -- Changing the status2 from {{testDir1}} to {{t

[jira] [Commented] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15537096#comment-15537096 ] Mingliang Liu commented on HDFS-10893: -- V1 patch rebased from {{trunk}} branch. > Re

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Attachment: HDFS-10893.001.patch > Refactor TestDFSShell by setting up MiniDFSCluser once for all

[jira] [Updated] (HDFS-10931) libhdfs++: Fix object lifecycle issues in the BlockReader

2016-09-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10931: --- Attachment: HDFS-10931.HDFS-8707.001.patch New patch. The last patch would cause sporadic fai

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15537116#comment-15537116 ] Hudson commented on HDFS-10896: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

  1   2   >