[jira] [Updated] (HDFS-10963) Reduce log level when network topology cannot find enough datanodes.

2016-10-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10963: - Status: Patch Available (was: Open) > Reduce log level when network topology cannot find enough datanodes

[jira] [Created] (HDFS-10963) Reduce log level when network topology cannot find enough datanodes.

2016-10-04 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-10963: Summary: Reduce log level when network topology cannot find enough datanodes. Key: HDFS-10963 URL: https://issues.apache.org/jira/browse/HDFS-10963 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10963) Reduce log level when network topology cannot find enough datanodes.

2016-10-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10963: - Attachment: HDFS-10963.01.patch > Reduce log level when network topology cannot find enough datanodes. > -

[jira] [Commented] (HDFS-10962) TestRequestHedgingProxyProvider is flaky

2016-10-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547741#comment-15547741 ] Xiao Chen commented on HDFS-10962: -- Thanks Andrew for the fix. It makes sense, but since

[jira] [Updated] (HDFS-10962) TestRequestHedgingProxyProvider is flaky

2016-10-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10962: --- Attachment: HDFS-10962.001.patch I was unable to repro this locally after running it 100 times with lo

[jira] [Updated] (HDFS-10962) TestRequestHedgingProxyProvider is flaky

2016-10-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10962: --- Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 2.8.0) Status: Patch Available (was: Open)

[jira] [Created] (HDFS-10962) TestRequestHedgingProxyProvider is flaky

2016-10-04 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-10962: -- Summary: TestRequestHedgingProxyProvider is flaky Key: HDFS-10962 URL: https://issues.apache.org/jira/browse/HDFS-10962 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547529#comment-15547529 ] Arpit Agarwal commented on HDFS-10301: -- Konst, please hold off committing for a day o

[jira] [Comment Edited] (HDFS-10745) Directly resolve paths into INodesInPath

2016-10-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547080#comment-15547080 ] Zhe Zhang edited comment on HDFS-10745 at 10/5/16 3:57 AM: --- Than

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-10-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547455#comment-15547455 ] Brahma Reddy Battula commented on HDFS-10896: - Hi [~zhz] Seems you are not up

[jira] [Commented] (HDFS-10925) Cache symlinkString in INodeSymlink

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547376#comment-15547376 ] Hadoop QA commented on HDFS-10925: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547368#comment-15547368 ] Hadoop QA commented on HDFS-10745: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547365#comment-15547365 ] Konstantin Shvachko commented on HDFS-10301: The patch looks good. Tests pass

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-10-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547335#comment-15547335 ] Konstantin Shvachko commented on HDFS-10745: Sorry, just noticed one more thin

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547309#comment-15547309 ] Hadoop QA commented on HDFS-10922: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-10-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547303#comment-15547303 ] Yiqun Lin commented on HDFS-6532: - Thanks [~xiaochen] for continous work on this. Some comm

[jira] [Updated] (HDFS-10925) Cache symlinkString in INodeSymlink

2016-10-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10925: - Attachment: HDFS-10925.003.patch Thanks [~kihwal] for the comment. I'm sorry for the misunderstand for tha

[jira] [Commented] (HDFS-10819) BlockManager fails to store a good block for a datanode storage after it reported a corrupt block — block replication stuck

2016-10-04 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547214#comment-15547214 ] Manoj Govindassamy commented on HDFS-10819: --- [~andrew.wang], {quote} Also curio

[jira] [Created] (HDFS-10961) Flaky test TestSnapshotFileLength.testSnapshotfileLength

2016-10-04 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10961: Summary: Flaky test TestSnapshotFileLength.testSnapshotfileLength Key: HDFS-10961 URL: https://issues.apache.org/jira/browse/HDFS-10961 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8028) TestNNHandlesBlockReportPerStorage/TestNNHandlesCombinedBlockReport Failed after patched HDFS-7704

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547183#comment-15547183 ] Hadoop QA commented on HDFS-8028: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547167#comment-15547167 ] Hadoop QA commented on HDFS-10826: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-10-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547166#comment-15547166 ] Xiao Chen commented on HDFS-10797: -- Thanks Sean for the new revs! I think the synchronize

[jira] [Commented] (HDFS-10953) Remove single-rpc block reports.

2016-10-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547125#comment-15547125 ] Konstantin Shvachko commented on HDFS-10953: Hey [~shahrs87], thanks for volun

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-10-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10896: - Resolution: Fixed Status: Resolved (was: Patch Available) > Move lock logging logic from FSNamesy

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-10-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10896: - Hadoop Flags: Reviewed Thanks Erik! +1 on the branch-2.7 patch. I just verified reported test failures an

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-10-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10896: - Fix Version/s: 2.7.4 > Move lock logging logic from FSNamesystem into FSNamesystemLock > -

[jira] [Updated] (HDFS-10745) Directly resolve paths into INodesInPath

2016-10-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10745: - Attachment: HDFS-10745-branch-2.7.05.patch Thanks [~shv] for taking a look! Attaching v5 patch to add {{ch

[jira] [Comment Edited] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-10-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546919#comment-15546919 ] Xiao Chen edited comment on HDFS-6532 at 10/4/16 11:29 PM: --- Looke

[jira] [Commented] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

2016-10-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547037#comment-15547037 ] Wei-Chiu Chuang commented on HDFS-10826: The patch looks good to me too. > The re

[jira] [Commented] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547035#comment-15547035 ] Hadoop QA commented on HDFS-10960: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

2016-10-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546996#comment-15546996 ] Jing Zhao commented on HDFS-10826: -- The latest patch looks good to me. To do further code

[jira] [Updated] (HDFS-10922) Adding additional unit tests for Trash

2016-10-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10922: --- Attachment: HDFS-10922.05.patch > Adding additional unit tests for Trash > ---

[jira] [Commented] (HDFS-8028) TestNNHandlesBlockReportPerStorage/TestNNHandlesCombinedBlockReport Failed after patched HDFS-7704

2016-10-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546938#comment-15546938 ] Wei-Chiu Chuang commented on HDFS-8028: --- I think the patch makes sense to me. However

[jira] [Updated] (HDFS-8028) TestNNHandlesBlockReportPerStorage/TestNNHandlesCombinedBlockReport Failed after patched HDFS-7704

2016-10-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8028: -- Status: Patch Available (was: Open) Submit the patch to see if it still applies. > TestNNHandle

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-10-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546919#comment-15546919 ] Xiao Chen commented on HDFS-6532: - Looked more into this. For failed cases, we see (copied

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546854#comment-15546854 ] Hadoop QA commented on HDFS-6532: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10925) Cache symlinkString in INodeSymlink

2016-10-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546797#comment-15546797 ] Kihwal Lee commented on HDFS-10925: --- I think what Daryn meant by bq. The latter is the

[jira] [Comment Edited] (HDFS-10955) Pass IIP for FSDirAttr methods

2016-10-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546781#comment-15546781 ] Kihwal Lee edited comment on HDFS-10955 at 10/4/16 9:54 PM: It

[jira] [Commented] (HDFS-10955) Pass IIP for FSDirAttr methods

2016-10-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546781#comment-15546781 ] Kihwal Lee commented on HDFS-10955: --- It won't compile with the patch. It looks like the

[jira] [Updated] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-04 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10960: -- Attachment: HDFS-10960.01.patch Attached v01 patch which addresses the problem as propos

[jira] [Updated] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-04 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10960: -- Status: Patch Available (was: Open) > TestDataNodeHotSwapVolumes#testRemoveVolumeBeingW

[jira] [Commented] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546748#comment-15546748 ] Kihwal Lee commented on HDFS-10939: --- In {{startFileInt()}}, {{unlock()}} is done in {{ge

[jira] [Updated] (HDFS-10629) Federation Router

2016-10-04 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10629: -- Status: In Progress (was: Patch Available) > Federation Router > - > >

[jira] [Updated] (HDFS-10629) Federation Router

2016-10-04 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10629: -- Status: Patch Available (was: In Progress) > Federation Router > - > >

[jira] [Commented] (HDFS-10881) Federation State Store Driver API

2016-10-04 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546681#comment-15546681 ] Inigo Goiri commented on HDFS-10881: As this is just a stub for the following patches,

[jira] [Commented] (HDFS-10881) Federation State Store Driver API

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546669#comment-15546669 ] Hadoop QA commented on HDFS-10881: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-04 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546654#comment-15546654 ] Manoj Govindassamy commented on HDFS-10960: --- Looking at the code, remove volume

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-04 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546645#comment-15546645 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- The test failure seems unrela

[jira] [Created] (HDFS-10960) TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove

2016-10-04 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-10960: - Summary: TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove Key: HDFS-10960 URL: https://issues.apache.org/jira

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546626#comment-15546626 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10956) Remove rename/delete performance penalty when not using snapshots

2016-10-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10956: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Updated] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-10-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-6532: Attachment: HDFS-6532.002.patch TEST-org.apache.hadoop.hdfs.TestCrcCorruption-select_timeout.x

[jira] [Updated] (HDFS-10948) HDFS setOwner no-op should not generate an edit log transaction

2016-10-04 Thread Karthik Palaniappan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Palaniappan updated HDFS-10948: --- Description: The HDFS setOwner RPC takes a path, optional username, and optional group

[jira] [Commented] (HDFS-10956) Remove rename/delete performance penalty when not using snapshots

2016-10-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546553#comment-15546553 ] Hudson commented on HDFS-10956: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-10956) Remove rename/delete performance penalty when not using snapshots

2016-10-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546493#comment-15546493 ] Kihwal Lee commented on HDFS-10956: --- +1 looks straight-forward. > Remove rename/delete

[jira] [Commented] (HDFS-10957) Retire BKJM from trunk

2016-10-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546475#comment-15546475 ] Kihwal Lee commented on HDFS-10957: --- {{hadoop-hdfs-project/pom.xml}} needs to be updated

[jira] [Updated] (HDFS-10629) Federation Router

2016-10-04 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10629: -- Attachment: (was: HDFS-10881-HDFS-10467-006.patch) > Federation Router > - > >

[jira] [Issue Comment Deleted] (HDFS-10629) Federation Router

2016-10-04 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10629: -- Comment: was deleted (was: Updated patch to reflect feedback. A few minor documentation changes and im

[jira] [Updated] (HDFS-10881) Federation State Store Driver API

2016-10-04 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10881: -- Attachment: HDFS-10881-HDFS-10467-006.patch Updating patch to reflect feedback. Minor documentation cha

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-04 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.015.patch > BlockReport retransmissions may lead to storage

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-04 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546390#comment-15546390 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Patch 15 has the changes ment

[jira] [Assigned] (HDFS-4169) Add per-disk latency metrics to DataNode

2016-10-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-4169: Assignee: Xiaoyu Yao > Add per-disk latency metrics to DataNode > --

[jira] [Updated] (HDFS-4169) Add per-disk latency metrics to DataNode

2016-10-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-4169: - Description: Currently, if one of the drives on the DataNode is slow, it's hard to determine what the issue

[jira] [Updated] (HDFS-10629) Federation Router

2016-10-04 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10629: -- Attachment: HDFS-10881-HDFS-10467-006.patch Updated patch to reflect feedback. A few minor documentatio

[jira] [Updated] (HDFS-10959) Adding per disk IO statistics in DataNode.

2016-10-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10959: -- Description: This ticket is opened to support per disk IO statistics in DataNode based on HDFS-10930. Th

[jira] [Created] (HDFS-10959) Adding per disk IO statistics in DataNode.

2016-10-04 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10959: - Summary: Adding per disk IO statistics in DataNode. Key: HDFS-10959 URL: https://issues.apache.org/jira/browse/HDFS-10959 Project: Hadoop HDFS Issue Type: Improvem

[jira] [Created] (HDFS-10958) Add instrumentation hooks around Datanode disk IO

2016-10-04 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10958: - Summary: Add instrumentation hooks around Datanode disk IO Key: HDFS-10958 URL: https://issues.apache.org/jira/browse/HDFS-10958 Project: Hadoop HDFS Issue Type: I

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-10-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Summary: Refactor: Wrap Datanode IO related operations (was: Refactor Datanode IO operations into a sin

[jira] [Updated] (HDFS-10930) Refactor Datanode IO operations into a single class

2016-10-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Attachment: HDFS-10930.01.patch Attach a initial patch that refactors IO related operations into Datano

[jira] [Commented] (HDFS-10957) Retire BKJM from trunk

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546238#comment-15546238 ] Hadoop QA commented on HDFS-10957: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-10429) DataStreamer interrupted warning always appears when using CLI upload file

2016-10-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546235#comment-15546235 ] Wei-Chiu Chuang commented on HDFS-10429: Hello [~aplusplus] Thanks for submitting

[jira] [Commented] (HDFS-10948) HDFS setOwner no-op should not generate an edit log transaction

2016-10-04 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546230#comment-15546230 ] John Zhuge commented on HDFS-10948: --- We typically encourage the 3rdparty client librarie

[jira] [Commented] (HDFS-10956) Remove rename/delete performance penalty when not using snapshots

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546170#comment-15546170 ] Hadoop QA commented on HDFS-10956: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546148#comment-15546148 ] Hadoop QA commented on HDFS-10922: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546144#comment-15546144 ] Hadoop QA commented on HDFS-10609: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546139#comment-15546139 ] Hadoop QA commented on HDFS-10922: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10955) Pass IIP for FSDirAttr methods

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546115#comment-15546115 ] Hadoop QA commented on HDFS-10955: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10429) DataStreamer interrupted warning always appears when using CLI upload file

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546055#comment-15546055 ] Hadoop QA commented on HDFS-10429: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10948) HDFS setOwner no-op should not generate an edit log transaction

2016-10-04 Thread Karthik Palaniappan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546041#comment-15546041 ] Karthik Palaniappan commented on HDFS-10948: [~jzhuge] Thanks for the quick re

[jira] [Updated] (HDFS-10955) Pass IIP for FSDirAttr methods

2016-10-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10955: -- Status: Patch Available (was: Open) > Pass IIP for FSDirAttr methods > -- >

[jira] [Commented] (HDFS-10629) Federation Router

2016-10-04 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546018#comment-15546018 ] Inigo Goiri commented on HDFS-10629: [~jakace], a couple small comments: * I'm not sur

[jira] [Comment Edited] (HDFS-10956) Remove rename/delete performance penalty when not using snapshots

2016-10-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546016#comment-15546016 ] Kihwal Lee edited comment on HDFS-10956 at 10/4/16 5:17 PM: Ac

[jira] [Updated] (HDFS-10683) Make class Token$PrivateToken private

2016-10-04 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10683: -- Status: Patch Available (was: In Progress) Re-submit 002 to trigger test again. > Make class Token$Pri

[jira] [Commented] (HDFS-10956) Remove rename/delete performance penalty when not using snapshots

2016-10-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15546016#comment-15546016 ] Kihwal Lee commented on HDFS-10956: --- Actually I've been thinking about doing this myself

[jira] [Updated] (HDFS-10429) DataStreamer interrupted warning always appears when using CLI upload file

2016-10-04 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated HDFS-10429: Attachment: HDFS-10429.2.patch New patch according to [~jingzhao]'s comments. Log level hasn't been

[jira] [Updated] (HDFS-10957) Retire BKJM from trunk

2016-10-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-10957: - Hadoop Flags: Incompatible change Target Version/s: 3.0.0-alpha2 Status: Patc

[jira] [Updated] (HDFS-10957) Retire BKJM from trunk

2016-10-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-10957: - Attachment: HDFS-10957-01.patch Attaching patch for jenkins > Retire BKJM from trunk > --

[jira] [Commented] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-10-04 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15545903#comment-15545903 ] Rushabh S Shah commented on HDFS-10878: --- Thanks [~kihwal] for reviews and committing

[jira] [Created] (HDFS-10957) Retire BKJM from trunk

2016-10-04 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-10957: Summary: Retire BKJM from trunk Key: HDFS-10957 URL: https://issues.apache.org/jira/browse/HDFS-10957 Project: Hadoop HDFS Issue Type: Task Repor

[jira] [Updated] (HDFS-10956) Remove rename/delete performance penalty when not using snapshots

2016-10-04 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10956: --- Attachment: HDFS-10956.patch Simple breakout patch of other IIP changes. Queries snapshot manager for

[jira] [Updated] (HDFS-10956) Remove rename/delete performance penalty when not using snapshots

2016-10-04 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10956: --- Status: Patch Available (was: Open) > Remove rename/delete performance penalty when not using snapsho

[jira] [Updated] (HDFS-10629) Federation Router

2016-10-04 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10629: --- Status: In Progress (was: Patch Available) > Federation Router > - > >

[jira] [Created] (HDFS-10956) Remove rename/delete performance penalty when not using snapshots

2016-10-04 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10956: -- Summary: Remove rename/delete performance penalty when not using snapshots Key: HDFS-10956 URL: https://issues.apache.org/jira/browse/HDFS-10956 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-10-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10878: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.7.4

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15545881#comment-15545881 ] Hadoop QA commented on HDFS-10789: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-10-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15545869#comment-15545869 ] Hudson commented on HDFS-10878: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-10-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15545827#comment-15545827 ] Kihwal Lee commented on HDFS-10878: --- +1 looks good to me. > TestDFSClientRetries#testId

[jira] [Updated] (HDFS-10922) Adding additional unit tests for Trash

2016-10-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10922: --- Attachment: HDFS-10922.03.patch > Adding additional unit tests for Trash > ---

[jira] [Updated] (HDFS-10922) Adding additional unit tests for Trash

2016-10-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10922: --- Attachment: HDFS-10922.04.patch > Adding additional unit tests for Trash > ---

[jira] [Updated] (HDFS-10922) Adding additional unit tests for Trash

2016-10-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10922: --- Status: Patch Available (was: In Progress) > Adding additional unit tests for Trash > ---

  1   2   >