[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403272#comment-16403272 ] Wei Yan commented on HDFS-13215: {quote}I think the error for {{dfs.namenode.fs-limits.min-block-size}} 

[jira] [Updated] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-13215: --- Attachment: HDFS-13215.007.patch > RBF: Move Router to its own module > -- >

[jira] [Updated] (HDFS-13304) Document: update the new ozone docker file location

2018-03-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-13304: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12884) BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403264#comment-16403264 ] genericqa commented on HDFS-12884: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12884) BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo

2018-03-16 Thread chencan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chencan updated HDFS-12884: --- Status: Patch Available (was: Open) Hi [~shv], I've  submitted the first patch. Please help me see if it's

[jira] [Updated] (HDFS-12884) BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo

2018-03-16 Thread chencan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chencan updated HDFS-12884: --- Attachment: HDFS-12884.001.patch > BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo >

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403209#comment-16403209 ] Íñigo Goiri commented on HDFS-13215: I think the error for {{dfs.namenode.fs-limits.min-block-size}}

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-16 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403177#comment-16403177 ] Konstantin Shvachko commented on HDFS-12977: Great! One last thing. Out of those [checkstyle

[jira] [Updated] (HDFS-11337) [branch-2] Add instrumentation hooks around Datanode disk IO

2018-03-16 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDFS-11337: -- Description: +underlined text+Cloned from HDFS-10958 to verify the branch-2 backport. (was: Cloned

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403169#comment-16403169 ] Íñigo Goiri commented on HDFS-13215: {quote} The three testcases passed in my local env. You miss some

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403153#comment-16403153 ] Wei Yan commented on HDFS-13215: The three testcases passed in my local env. You miss some patches? I'll

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403145#comment-16403145 ] genericqa commented on HDFS-12977: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403144#comment-16403144 ] Íñigo Goiri commented on HDFS-13215: We probably should move the webapps too. We need to check

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403141#comment-16403141 ] Wei Yan commented on HDFS-13215: Good catch, [~elgoiri]. There is another dir:

[jira] [Commented] (HDFS-13296) GenericTestUtils#getTempPath and GenericTestUtils#getRandomizedTestDir generate paths with drive letter in Windows, and fail webhdfs related test cases

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403140#comment-16403140 ] Íñigo Goiri commented on HDFS-13296: We went ahead and tested YARN, HDFS, Commons and tools. HDFS

[jira] [Commented] (HDFS-13304) Document: update the new ozone docker file location

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403130#comment-16403130 ] genericqa commented on HDFS-13304: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403129#comment-16403129 ] Íñigo Goiri commented on HDFS-13215: We also need to add the hdfs-rb-default.xml to the pom.xml to

[jira] [Comment Edited] (HDFS-13295) Namenode doesn't leave safemode if dfs.namenode.safemode.replication.min set < dfs.namenode.replication.min

2018-03-16 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403125#comment-16403125 ] Bharat Viswanadham edited comment on HDFS-13295 at 3/16/18 11:45 PM: -

[jira] [Commented] (HDFS-13295) Namenode doesn't leave safemode if dfs.namenode.safemode.replication.min set < dfs.namenode.replication.min

2018-03-16 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403125#comment-16403125 ] Bharat Viswanadham commented on HDFS-13295: --- Hi [~nfraison.criteo] One question I have from the

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403123#comment-16403123 ] Íñigo Goiri commented on HDFS-13215: This is not very promising with Yetus. I'll run locally,

[jira] [Commented] (HDFS-13296) GenericTestUtils#getTempPath and GenericTestUtils#getRandomizedTestDir generate paths with drive letter in Windows, and fail webhdfs related test cases

2018-03-16 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403121#comment-16403121 ] Chris Douglas commented on HDFS-13296: -- bq. Chris Douglas, Subru Krishnan, any idea on how we can

[jira] [Commented] (HDFS-10419) Building HDFS on top of new storage layer (HDSL)

2018-03-16 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403116#comment-16403116 ] Sanjay Radia commented on HDFS-10419: - In the " [VOTE] Merging branch HDFS-7240 to trunk" thread

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403111#comment-16403111 ] Wei Yan commented on HDFS-13215: Strange Yetus didn't run any HDFS testcases.. > RBF: Move Router to

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403109#comment-16403109 ] genericqa commented on HDFS-11043: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403107#comment-16403107 ] genericqa commented on HDFS-13215: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-16 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403085#comment-16403085 ] Virajith Jalaparti commented on HDFS-13283: --- Thanks for changing the enums to class

[jira] [Updated] (HDFS-13304) Document: update the new ozone docker file location

2018-03-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13304: -- Status: Patch Available (was: Open) > Document: update the new ozone docker file location >

[jira] [Commented] (HDFS-13304) Document: update the new ozone docker file location

2018-03-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403066#comment-16403066 ] Anu Engineer commented on HDFS-13304: - +1. Thanks for updating the document. cc: [~elek] .  I will

[jira] [Created] (HDFS-13305) Minor improvements to xml image output

2018-03-16 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-13305: Summary: Minor improvements to xml image output Key: HDFS-13305 URL: https://issues.apache.org/jira/browse/HDFS-13305 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-13305) Minor improvements to xml image output

2018-03-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13305: - Attachment: (was: HDFS-13305.01.patch) > Minor improvements to xml image output >

[jira] [Updated] (HDFS-13305) Minor improvements to xml image output

2018-03-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13305: - Attachment: HDFS-13305.01.patch > Minor improvements to xml image output >

[jira] [Updated] (HDFS-13304) Document: update the new ozone docker file location

2018-03-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13304: -- Attachment: HDFS-13304-HDFS-7240.001.patch > Document: update the new ozone docker file location >

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402974#comment-16402974 ] genericqa commented on HDFS-13283: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402646#comment-16402646 ] Lukas Majercak commented on HDFS-13283: --- Considering the implementation is minimal, I'd rather keep

[jira] [Created] (HDFS-13304) Document: update the new ozone docker file location

2018-03-16 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-13304: - Summary: Document: update the new ozone docker file location Key: HDFS-13304 URL: https://issues.apache.org/jira/browse/HDFS-13304 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-16 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402622#comment-16402622 ] Plamen Jeliazkov commented on HDFS-12977: - Hi [~vagarychen]! Thanks for taking a look at the

[jira] [Updated] (HDFS-12977) Add stateId to RPC headers.

2018-03-16 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-12977: Attachment: HDFS_12977.trunk.008.patch > Add stateId to RPC headers. >

[jira] [Resolved] (HDFS-12886) Ignore minReplication for block recovery

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HDFS-12886. Resolution: Fixed > Ignore minReplication for block recovery >

[jira] [Commented] (HDFS-12886) Ignore minReplication for block recovery

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402612#comment-16402612 ] Íñigo Goiri commented on HDFS-12886: Thanks [~lukmajercak] for [^HDFS-12886_branch-2.000.patch]. As

[jira] [Commented] (HDFS-12886) Ignore minReplication for block recovery

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402603#comment-16402603 ] Lukas Majercak commented on HDFS-12886: --- Added patch for branch-2 > Ignore minReplication for block

[jira] [Updated] (HDFS-12886) Ignore minReplication for block recovery

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12886: -- Attachment: HDFS-12886_branch-2.000.patch > Ignore minReplication for block recovery >

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-16 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402601#comment-16402601 ] Chao Sun commented on HDFS-11043: - Thanks [~xyao]. I changed the {{CLIENTS_TO_CONSUME_BACKLOG}} to 512 + 1

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402584#comment-16402584 ] Wei Yan commented on HDFS-13215: Thanks, [~elgoiri]. I run all RBF tests locally and they're fine. Not

[jira] [Updated] (HDFS-13302) Ozone: fix classpath of yarn components

2018-03-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-13302: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402580#comment-16402580 ] Íñigo Goiri commented on HDFS-12514: Is there a unit test we can add? Ideally we could reset it but

[jira] [Commented] (HDFS-13302) Ozone: fix classpath of yarn components

2018-03-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402581#comment-16402581 ] Anu Engineer commented on HDFS-13302: - [~elek] Thanks for the contribution. [~bharatviswa] Thanks for

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402576#comment-16402576 ] Íñigo Goiri commented on HDFS-13215: Posted message in HDFS-12615 about freezing commits. Do you know

[jira] [Commented] (HDFS-12615) Router-based HDFS federation phase 2

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402573#comment-16402573 ] Íñigo Goiri commented on HDFS-12615: We are freezing all commits to RBF until we get HDFS-13215 in.

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-16 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Attachment: HDFS-13176-branch-2.03.patch > WebHdfs file path gets truncated when having semicolon

[jira] [Reopened] (HDFS-12886) Ignore minReplication for block recovery

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reopened HDFS-12886: > Ignore minReplication for block recovery > > >

[jira] [Resolved] (HDFS-13303) branch-2 build is broken due to BlockManager for HDFS-12886

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HDFS-13303. Resolution: Fixed > branch-2 build is broken due to BlockManager for HDFS-12886 >

[jira] [Commented] (HDFS-13277) Improve move to account for usage (number of files) to limit trash dir size

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402562#comment-16402562 ] genericqa commented on HDFS-13277: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12886) Ignore minReplication for block recovery

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402563#comment-16402563 ] Íñigo Goiri commented on HDFS-12886: branch-2 and branch-2.9 break the build. We need patches for

[jira] [Assigned] (HDFS-13303) branch-2 build is broken due to BlockManager for HDFS-12886

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-13303: -- Assignee: Íñigo Goiri > branch-2 build is broken due to BlockManager for HDFS-12886 >

[jira] [Commented] (HDFS-13303) branch-2 build is broken due to BlockManager for HDFS-12886

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402561#comment-16402561 ] Íñigo Goiri commented on HDFS-13303: Actually, this JIRA should be just to track the revert (already

[jira] [Updated] (HDFS-13303) branch-2 build is broken due to BlockManager for HDFS-12886

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13303: --- Summary: branch-2 build is broken due to BlockManager for HDFS-12886 (was: branch-2 build is broken

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402555#comment-16402555 ] Xiaoyu Yao commented on HDFS-11043: --- {quote}I didn't do that. Will try it. {quote} IntelliJ has a

[jira] [Commented] (HDFS-13303) branch-2 build is broken due to BlockManager

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402556#comment-16402556 ] Íñigo Goiri commented on HDFS-13303: Thanks [~ywskycn]. Reverting the commits in branch-2 and

[jira] [Commented] (HDFS-13302) Ozone: fix classpath of yarn components

2018-03-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402545#comment-16402545 ] Anu Engineer commented on HDFS-13302: - I will commit this patch shortly. > Ozone: fix classpath of

[jira] [Created] (HDFS-13303) branch-2 build is broken due to BlockManager

2018-03-16 Thread Wei Yan (JIRA)
Wei Yan created HDFS-13303: -- Summary: branch-2 build is broken due to BlockManager Key: HDFS-13303 URL: https://issues.apache.org/jira/browse/HDFS-13303 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-13302) Ozone: fix classpath of yarn components

2018-03-16 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402525#comment-16402525 ] Bharat Viswanadham commented on HDFS-13302: --- +1. LGTM. Thanks, [~elek] for detailed offline

[jira] [Commented] (HDFS-13296) GenericTestUtils#getTempPath and GenericTestUtils#getRandomizedTestDir generate paths with drive letter in Windows, and fail webhdfs related test cases

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402520#comment-16402520 ] Íñigo Goiri commented on HDFS-13296: This patch is able to reduce our failed unit tests in Windows for

[jira] [Commented] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402519#comment-16402519 ] genericqa commented on HDFS-13250: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402518#comment-16402518 ] Wei Yan commented on HDFS-13215: Rebase a new patch [^HDFS-13215.006.patch]. [~elgoiri] [~linyiqun] let's

[jira] [Updated] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-13215: --- Attachment: HDFS-13215.006.patch > RBF: Move Router to its own module > -- >

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-16 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402516#comment-16402516 ] Chao Sun commented on HDFS-11043: - [~xyao]: oh I didn't do that. Will try it. Also: do you have any idea

[jira] [Updated] (HDFS-13298) Ozone: Make ozone/hdsl/cblock modules turned off by default

2018-03-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-13298: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402512#comment-16402512 ] Chen Liang commented on HDFS-12977: --- Thanks [~zero45] for working on this! patch looks pretty good to

[jira] [Commented] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402507#comment-16402507 ] genericqa commented on HDFS-13284: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402508#comment-16402508 ] genericqa commented on HDFS-12514: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402485#comment-16402485 ] genericqa commented on HDFS-12977: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402476#comment-16402476 ] Íñigo Goiri commented on HDFS-13283: I would probably move the implementations of

[jira] [Commented] (HDFS-13302) Ozone: fix classpath of yarn components

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402475#comment-16402475 ] genericqa commented on HDFS-13302: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-13298) Ozone: Make ozone/hdsl/cblock modules turned off by default

2018-03-16 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402449#comment-16402449 ] Bharat Viswanadham edited comment on HDFS-13298 at 3/16/18 8:26 PM:

[jira] [Commented] (HDFS-13298) Ozone: Make ozone/hdsl/cblock modules turned off by default

2018-03-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402456#comment-16402456 ] Anu Engineer commented on HDFS-13298: - [~bharatviswa] Thanks for the review and testing it. I will

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402440#comment-16402440 ] Xiaoyu Yao commented on HDFS-11043: --- [~csun], did you try letting the test run until failed? It passed

[jira] [Commented] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402448#comment-16402448 ] Lukas Majercak commented on HDFS-13283: --- Thanks for the review and suggestion [~virajith]. I removed

[jira] [Commented] (HDFS-13298) Ozone: Make ozone/hdsl/cblock modules turned off by default

2018-03-16 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402449#comment-16402449 ] Bharat Viswanadham commented on HDFS-13298: --- [~elek] Thank You for the patch. LGTM. +1. I

[jira] [Updated] (HDFS-13283) Percentage based Reserved Space Calculation for DataNode

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13283: -- Attachment: HDFS-13283.001.patch > Percentage based Reserved Space Calculation for DataNode >

[jira] [Commented] (HDFS-13055) Aggregate usage statistics from datanodes

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402443#comment-16402443 ] genericqa commented on HDFS-13055: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11043: -- Attachment: HDFS-11043.001.patch > TestWebHdfsTimeouts fails > - > >

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402438#comment-16402438 ] Wei Yan commented on HDFS-13215: let me do a quick rebase. and then we can freeze commit. > RBF: Move

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402432#comment-16402432 ] Íñigo Goiri commented on HDFS-13215: As we committed new stuff, [^HDFS-13215.005.patch] is missing

[jira] [Updated] (HDFS-13302) Ozone: fix classpath of yarn components

2018-03-16 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-13302: Status: Patch Available (was: Open) The easy workaround is implemented with moving the copy to a

[jira] [Updated] (HDFS-13302) Ozone: fix classpath of yarn components

2018-03-16 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-13302: Attachment: HDFS-13302-HDFS-7240.001.patch > Ozone: fix classpath of yarn components >

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402374#comment-16402374 ] genericqa commented on HDFS-13215: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402359#comment-16402359 ] Íñigo Goiri commented on HDFS-11043: Thanks [~xyao] for the findings, I would go for those fixes;

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-16 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402340#comment-16402340 ] Chao Sun commented on HDFS-11043: - [~xyao]: thanks for the findings! I also spent some time testing on my

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2018-03-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402324#comment-16402324 ] Xiaoyu Yao commented on HDFS-11043: --- Thanks [~elgoiri] for the comments and [~csun] for sharing articles

[jira] [Created] (HDFS-13302) Ozone: fix classpath of yarn components

2018-03-16 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-13302: --- Summary: Ozone: fix classpath of yarn components Key: HDFS-13302 URL: https://issues.apache.org/jira/browse/HDFS-13302 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-13277) Improve move to account for usage (number of files) to limit trash dir size

2018-03-16 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402318#comment-16402318 ] Bharat Viswanadham commented on HDFS-13277: --- Rebased patch, as HDFS-13163 got committed. >

[jira] [Updated] (HDFS-12996) DataNode Replica Trash

2018-03-16 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12996: -- Attachment: (was: HDFS-13277-HDFS-12996.01.patch) > DataNode Replica Trash >

[jira] [Updated] (HDFS-13277) Improve move to account for usage (number of files) to limit trash dir size

2018-03-16 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13277: -- Attachment: HDFS-13277-HDFS-12996.01.patch > Improve move to account for usage (number

[jira] [Updated] (HDFS-12996) DataNode Replica Trash

2018-03-16 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12996: -- Attachment: HDFS-13277-HDFS-12996.01.patch > DataNode Replica Trash >

[jira] [Commented] (HDFS-12886) Ignore minReplication for block recovery

2018-03-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402289#comment-16402289 ] Hudson commented on HDFS-12886: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13849 (See

[jira] [Commented] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402277#comment-16402277 ] Íñigo Goiri commented on HDFS-13250: Thanks [~linyiqun] for the comments. If we do what you propose, I

[jira] [Updated] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13250: --- Attachment: HDFS-13250.003.patch > RBF: Router to manage requests across multiple subclusters >

[jira] [Commented] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402261#comment-16402261 ] Lukas Majercak commented on HDFS-12514: --- Reuploaded patch 003 to trigger a build. > Cancelled

[jira] [Updated] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12514: -- Attachment: (was: HDFS-12514.003.patch) > Cancelled HedgedReads cause block to be marked as

[jira] [Updated] (HDFS-12514) Cancelled HedgedReads cause block to be marked as suspect on Windows

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12514: -- Attachment: HDFS-12514.003.patch > Cancelled HedgedReads cause block to be marked as suspect on

  1   2   >