[jira] [Commented] (HDFS-10629) Federation Router

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537926#comment-15537926 ] Hadoop QA commented on HDFS-10629: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2016-09-30 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10943: Summary: rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed Key: HDFS-10943 URL: https://issues.apache.org/jira/browse/HDFS-10943

[jira] [Updated] (HDFS-10629) Federation Router

2016-09-30 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10629: -- Attachment: HDFS-10629-HDFS-10467-004.patch Updating the patch to include: * Added a retry policy to

[jira] [Commented] (HDFS-10629) Federation Router

2016-09-30 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537824#comment-15537824 ] Jason Kace commented on HDFS-10629: --- FederationNamenodeServiceState#EXPIRED isn't used. Is it needed? *

[jira] [Commented] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537761#comment-15537761 ] Hadoop QA commented on HDFS-10637: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work started] (HDFS-10922) Adding additional unit tests for Trash

2016-09-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10922 started by Weiwei Yang. -- > Adding additional unit tests for Trash > -- >

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537690#comment-15537690 ] Hadoop QA commented on HDFS-10690: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10923) Make InstrumentedLock require ReentrantLock

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537668#comment-15537668 ] Hadoop QA commented on HDFS-10923: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537650#comment-15537650 ] Hadoop QA commented on HDFS-10797: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537643#comment-15537643 ] Hadoop QA commented on HDFS-10893: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-30 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537580#comment-15537580 ] Fenghua Hu commented on HDFS-10690: --- Hi [~xyao], I should had run a clean compilation, sorry for your

[jira] [Updated] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-30 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10690: -- Attachment: HDFS-10690.007.patch > Optimize insertion/removal of replica in ShortCircuitCache.java >

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Status: Patch Available (was: Open) > Modifications to remove the assumption that

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Attachment: HDFS-10637.010.patch Attaching new patch based on [~eddyxu]'s comments. >

[jira] [Commented] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537550#comment-15537550 ] Hadoop QA commented on HDFS-10609: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10931) libhdfs++: Fix object lifecycle issues in the BlockReader

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537542#comment-15537542 ] Hadoop QA commented on HDFS-10931: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10923) Make InstrumentedLock require ReentrantLock

2016-09-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537539#comment-15537539 ] Chris Douglas commented on HDFS-10923: -- +1 lgtm > Make InstrumentedLock require ReentrantLock >

[jira] [Commented] (HDFS-10619) Cache path in InodesInPath

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537538#comment-15537538 ] Hadoop QA commented on HDFS-10619: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-30 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537537#comment-15537537 ] SammiChen commented on HDFS-10910: -- Holiday from Oct. 1 to Oct. 7, please expect no response. Thanks.

[jira] [Commented] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537534#comment-15537534 ] Yiqun Lin commented on HDFS-10910: -- Thanks [~jojochuang] for the commit! > HDFS Erasure Coding doc

[jira] [Updated] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10932: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537475#comment-15537475 ] Anu Engineer commented on HDFS-10932: - +1, I will commit this now. > Ozone : fix XceiverClient slow

[jira] [Commented] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537451#comment-15537451 ] Hadoop QA commented on HDFS-10932: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10940) Reduce performance penalty of block caching when not used

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537450#comment-15537450 ] Hadoop QA commented on HDFS-10940: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10942) Incorrect handling of flushing edit logs to JN

2016-09-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10942: - Description: We use EditsDoubleBuffer to handle edit logs: {code} /** * A double-buffer for

[jira] [Updated] (HDFS-10923) Make InstrumentedLock require ReentrantLock

2016-09-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10923: - Attachment: HDFS-10923.02.patch v02 patch fixes checkstyle issues. > Make InstrumentedLock

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537407#comment-15537407 ] Arpit Agarwal commented on HDFS-10713: -- Thanks for the backport [~zhz]. > Throttle FsNameSystem lock

[jira] [Updated] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-10797: - Attachment: HDFS-10797.009.patch Fixing style issues, and always using getCounts() to retrieve

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537400#comment-15537400 ] Zhe Zhang commented on HDFS-10896: -- I committed to trunk~branch-2.8. But the backport the branch-2.7 is

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10896: - Fix Version/s: 3.0.0-alpha2 2.8.0 > Move lock logging logic from FSNamesystem into

[jira] [Updated] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-09-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10872: --- Attachment: HDFS-10872.000.patch > Add MutableRate metrics for FSNamesystemLock operations >

[jira] [Created] (HDFS-10942) Incorrect handling of flushing edit logs to JN

2016-09-30 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10942: Summary: Incorrect handling of flushing edit logs to JN Key: HDFS-10942 URL: https://issues.apache.org/jira/browse/HDFS-10942 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537395#comment-15537395 ] Zhe Zhang commented on HDFS-10713: -- I backported this change to branch-2.7 since the original read/write

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10713: - Fix Version/s: 2.7.4 > Throttle FsNameSystem lock warnings > --- > >

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-09-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537392#comment-15537392 ] Erik Krogen commented on HDFS-10872: Attaching v000 patch. This makes {{FSNamesystemLock}} into a

[jira] [Commented] (HDFS-10429) DataStreamer interrupted warning always appears when using CLI upload file

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537327#comment-15537327 ] Wei-Chiu Chuang commented on HDFS-10429: Ping: [~jingzhao]'s suggestion sounds good to me.

[jira] [Updated] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-09-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10872: --- Status: Open (was: Patch Available) > Add MutableRate metrics for FSNamesystemLock operations >

[jira] [Updated] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-09-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10872: --- Status: Patch Available (was: In Progress) > Add MutableRate metrics for FSNamesystemLock operations

[jira] [Commented] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537272#comment-15537272 ] Lei (Eddy) Xu commented on HDFS-10637: -- Yes. That's right. Thanks a lot! > Modifications to remove

[jira] [Commented] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537266#comment-15537266 ] Virajith Jalaparti commented on HDFS-10637: --- Hi [~eddyxu], bq. what about setting

[jira] [Commented] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537214#comment-15537214 ] Lei (Eddy) Xu commented on HDFS-10637: -- Hi, [~virajith] Thanks a lot for update the patch. It looks

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537211#comment-15537211 ] Hadoop QA commented on HDFS-10797: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537195#comment-15537195 ] Hadoop QA commented on HDFS-10851: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10941) Improve BlockManager#processMisReplicatesAsync log

2016-09-30 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10941: - Summary: Improve BlockManager#processMisReplicatesAsync log Key: HDFS-10941 URL: https://issues.apache.org/jira/browse/HDFS-10941 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537138#comment-15537138 ] Mingliang Liu commented on HDFS-10934: -- What I proposed is some code snippet liket: {code} diff --git

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Attachment: HDFS-10893-branch-2.001.patch > Refactor TestDFSShell by setting up MiniDFSCluser

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537116#comment-15537116 ] Hudson commented on HDFS-10896: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10522 (See

[jira] [Updated] (HDFS-10931) libhdfs++: Fix object lifecycle issues in the BlockReader

2016-09-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10931: --- Attachment: HDFS-10931.HDFS-8707.001.patch New patch. The last patch would cause sporadic

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Attachment: HDFS-10893.001.patch > Refactor TestDFSShell by setting up MiniDFSCluser once for all

[jira] [Commented] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537096#comment-15537096 ] Mingliang Liu commented on HDFS-10893: -- V1 patch rebased from {{trunk}} branch. > Refactor

[jira] [Updated] (HDFS-10619) Cache path in InodesInPath

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10619: --- Attachment: HDFS-10619.1.patch Updated. > Cache path in InodesInPath > -- >

[jira] [Commented] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537088#comment-15537088 ] Mingliang Liu commented on HDFS-10934: -- Changing the status2 from {{testDir1}} to {{testFile2}} is

[jira] [Updated] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10609: --- Attachment: HDFS-10609.branch-2.7.02.patch Most code style warnings are unrelated. The test

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537074#comment-15537074 ] Eric Badger commented on HDFS-10921: Quick update: Adding the @Before method as [~xkrogen] proposed

[jira] [Commented] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537070#comment-15537070 ] Anu Engineer commented on HDFS-10932: - scheduled a new build

[jira] [Updated] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10932: -- Attachment: HDFS-10932-HDFS-7240.002.patch > Ozone : fix XceiverClient slow shutdown >

[jira] [Updated] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10851: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537065#comment-15537065 ] Chen Liang commented on HDFS-10932: --- Sure! I updated the patch a second time to trigger the Jenkins

[jira] [Commented] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537052#comment-15537052 ] Kihwal Lee commented on HDFS-10851: --- The branch-2 patch looks good. The only difference is the

[jira] [Commented] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537047#comment-15537047 ] Eric Badger commented on HDFS-10934: bq. I then realized that perhaps I should not rely on the

[jira] [Commented] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537044#comment-15537044 ] Anu Engineer commented on HDFS-10932: - [~vagarychen] Thanks for checking. Since the exception says

[jira] [Commented] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537032#comment-15537032 ] Chen Liang commented on HDFS-10932: --- The failed tests do not seem to be related, local runs do not have

[jira] [Commented] (HDFS-10939) Reduce performance penalty of encryption zones

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537029#comment-15537029 ] Hadoop QA commented on HDFS-10939: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10891) Über-jira: Test Improvement by adding missing test cases for existing code

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10891: - Target Version/s: 2.8.0 (was: 3.0.0-alpha2) > Über-jira: Test Improvement by adding missing test

[jira] [Updated] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10934: - Target Version/s: 2.8.0 Component/s: test > TestDFSShell.testStat fails intermittently >

[jira] [Updated] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10934: - Issue Type: Sub-task (was: Bug) Parent: HDFS-10891 > TestDFSShell.testStat fails

[jira] [Commented] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-09-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537011#comment-15537011 ] Mingliang Liu commented on HDFS-10934: -- [~ebadger], it's a nice catch! I think the patch will fix

[jira] [Updated] (HDFS-10940) Reduce performance penalty of block caching when not used

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10940: --- Attachment: HDFS-10940.patch Very simple patch. Pass LocatedBlocks to CacheManager. CM immediately

[jira] [Updated] (HDFS-10940) Reduce performance penalty of block caching when not used

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10940: --- Status: Patch Available (was: Open) > Reduce performance penalty of block caching when not used >

[jira] [Created] (HDFS-10940) Reduce performance penalty of block caching when not used

2016-09-30 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10940: -- Summary: Reduce performance penalty of block caching when not used Key: HDFS-10940 URL: https://issues.apache.org/jira/browse/HDFS-10940 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10939) Reduce performance penalty of encryption zones

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10939: --- Status: Patch Available (was: Open) > Reduce performance penalty of encryption zones >

[jira] [Updated] (HDFS-10939) Reduce performance penalty of encryption zones

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10939: --- Attachment: HDFS-10939.patch Full use of IIP in EncryptionZoneManager and FsDirEncryptionZoneOp

[jira] [Updated] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-10797: - Attachment: HDFS-10797.008.patch Attaching a patch that address the findbugs warnings. > Disk

[jira] [Assigned] (HDFS-7642) NameNode should periodically log DataNode decommissioning progress

2016-09-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory reassigned HDFS-7642: --- Assignee: Sean Mackrory > NameNode should periodically log DataNode decommissioning progress

[jira] [Updated] (HDFS-7642) NameNode should periodically log DataNode decommissioning progress

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7642: Assignee: (was: Zhe Zhang) > NameNode should periodically log DataNode decommissioning progress >

[jira] [Commented] (HDFS-7642) NameNode should periodically log DataNode decommissioning progress

2016-09-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536954#comment-15536954 ] Zhe Zhang commented on HDFS-7642: - [~mackrorysd] Sure! Thanks for the interest. Unassigning myself now. >

[jira] [Commented] (HDFS-10907) Fix Erasure Coding documentation

2016-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536938#comment-15536938 ] Hudson commented on HDFS-10907: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10521 (See

[jira] [Commented] (HDFS-10908) Improve StripedBlockReader#createBlockReader error logging

2016-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536939#comment-15536939 ] Hudson commented on HDFS-10908: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10521 (See

[jira] [Commented] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536934#comment-15536934 ] Hudson commented on HDFS-10910: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10521 (See

[jira] [Updated] (HDFS-10907) Fix Erasure Coding documentation

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10907: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10910: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed the patch to

[jira] [Updated] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10910: --- Target Version/s: 3.0.0-alpha2 > HDFS Erasure Coding doc should state its currently supported

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536841#comment-15536841 ] Xiao Chen commented on HDFS-10918: -- Failed tests look unrelated and passed locally. Will wait for some

[jira] [Updated] (HDFS-10908) Improve StripedBlockReader#createBlockReader error logging

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10908: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-10938) Ozone: SCM: Add datanode protocol

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536819#comment-15536819 ] Hadoop QA commented on HDFS-10938: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-09-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536813#comment-15536813 ] Xiaoyu Yao commented on HDFS-10912: --- Thanks @Anu for reporting the issue and posting the patch. It looks

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536810#comment-15536810 ] Hadoop QA commented on HDFS-10918: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10939) Reduce performance penalty of encryption zones

2016-09-30 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10939: -- Summary: Reduce performance penalty of encryption zones Key: HDFS-10939 URL: https://issues.apache.org/jira/browse/HDFS-10939 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536805#comment-15536805 ] Sean Mackrory commented on HDFS-10797: -- findbugs output is correct: I'm using synchronization to

[jira] [Commented] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536798#comment-15536798 ] Hadoop QA commented on HDFS-10932: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536780#comment-15536780 ] Hadoop QA commented on HDFS-10797: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10851: --- Attachment: HDFS-10851.branch-2.patch Just had to remove a few references to EC policy. >

[jira] [Commented] (HDFS-7642) NameNode should periodically log DataNode decommissioning progress

2016-09-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536701#comment-15536701 ] Sean Mackrory commented on HDFS-7642: - Hey [~zhz] - I'd like to work on this, if that's alright with

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536676#comment-15536676 ] Konstantin Shvachko commented on HDFS-10301: I think the solution for the {{checkLease()}}

[jira] [Comment Edited] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536651#comment-15536651 ] Xiaoyu Yao edited comment on HDFS-10690 at 9/30/16 6:34 PM: [~fenghua_hu], we

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536651#comment-15536651 ] Xiaoyu Yao commented on HDFS-10690: --- [~fenghua_hu], we will need to update

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536649#comment-15536649 ] Hadoop QA commented on HDFS-10896: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10908) Improve StripedBlockReader#createBlockReader error logging

2016-09-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536643#comment-15536643 ] Wei-Chiu Chuang commented on HDFS-10908: LGTM. Test case not needed since it's a log message only

[jira] [Commented] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536640#comment-15536640 ] Hudson commented on HDFS-10851: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10519 (See

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-09-30 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536630#comment-15536630 ] Rushabh S Shah commented on HDFS-10921: --- bq. Rushabh S Shah, do you have any concerns with Erik

  1   2   >