[GitHub] [hadoop] elek closed pull request #1560: HDDS-2214. TestSCMContainerPlacementRackAware has an intermittent failure
elek closed pull request #1560: HDDS-2214. TestSCMContainerPlacementRackAware has an intermittent failure URL: https://github.com/apache/hadoop/pull/1560 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1560: HDDS-2214. TestSCMContainerPlacementRackAware has an intermittent failure
elek commented on issue #1560: HDDS-2214. TestSCMContainerPlacementRackAware has an intermittent failure URL: https://github.com/apache/hadoop/pull/1560#issuecomment-541402229 Moved to https://github.com/apache/hadoop-ozone/pull/6 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1583: HDDS-2071. Support filters in ozone insight point
elek commented on issue #1583: HDDS-2071. Support filters in ozone insight point URL: https://github.com/apache/hadoop/pull/1583#issuecomment-541402263 Moved to https://github.com/apache/hadoop-ozone/pull/4 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek closed pull request #1583: HDDS-2071. Support filters in ozone insight point
elek closed pull request #1583: HDDS-2071. Support filters in ozone insight point URL: https://github.com/apache/hadoop/pull/1583 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-15977) RPC support for TLS
[ https://issues.apache.org/jira/browse/HADOOP-15977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950289#comment-16950289 ] hirik commented on HADOOP-15977: Hi [~daryn]. Happy to see this feature is on the road and thank you so much for making it happen. Do we have any release timeline for this feature? > RPC support for TLS > --- > > Key: HADOOP-15977 > URL: https://issues.apache.org/jira/browse/HADOOP-15977 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc, security >Reporter: Daryn Sharp >Assignee: Daryn Sharp >Priority: Major > > Umbrella ticket to track adding TLS and mutual TLS support to RPC. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1559: HDDS-1737. Add Volume check in KeyManager and File Operations.
elek commented on issue #1559: HDDS-1737. Add Volume check in KeyManager and File Operations. URL: https://github.com/apache/hadoop/pull/1559#issuecomment-541394470 cxorm HDDS-1737 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek removed a comment on issue #1559: HDDS-1737. Add Volume check in KeyManager and File Operations.
elek removed a comment on issue #1559: HDDS-1737. Add Volume check in KeyManager and File Operations. URL: https://github.com/apache/hadoop/pull/1559#issuecomment-541394470 cxorm HDDS-1737 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1398: HDDS-2064. OzoneManagerRatisServer#newOMRatisServer throws NPE when OM HA is configured incorrectly
elek commented on issue #1398: HDDS-2064. OzoneManagerRatisServer#newOMRatisServer throws NPE when OM HA is configured incorrectly URL: https://github.com/apache/hadoop/pull/1398#issuecomment-541394672 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:smengcl/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2064 apache/HDDS-2064 git push origin HDDS-2064 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...smengcl:HDDS-2064?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] cxorm commented on issue #1559: HDDS-1737. Add Volume check in KeyManager and File Operations.
cxorm commented on issue #1559: HDDS-1737. Add Volume check in KeyManager and File Operations. URL: https://github.com/apache/hadoop/pull/1559#issuecomment-541394720 > you please re-create your pull request in the new repository? Thanks @elek I am gald to do this : ) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1615: HDDS-2196 Add CLI Commands and Protobuf messages to trigger decom states
elek commented on issue #1615: HDDS-2196 Add CLI Commands and Protobuf messages to trigger decom states URL: https://github.com/apache/hadoop/pull/1615#issuecomment-541394661 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:sodonnel/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2196 apache/HDDS-2196 git push origin HDDS-2196 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...sodonnel:HDDS-2196?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1604: HDDS-2254. Fix flaky unit test TestContainerStateMachine#testRatisSnapshotRetention
elek commented on issue #1604: HDDS-2254. Fix flaky unit test TestContainerStateMachine#testRatisSnapshotRetention URL: https://github.com/apache/hadoop/pull/1604#issuecomment-541394657 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:avijayanhwx/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2254 apache/HDDS-2254 git push origin HDDS-2254 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...avijayanhwx:HDDS-2254?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1625: HDDS-2271. Avoid buffer copying in KeyValueHandler.
elek commented on issue #1625: HDDS-2271. Avoid buffer copying in KeyValueHandler. URL: https://github.com/apache/hadoop/pull/1625#issuecomment-541394659 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:szetszwo/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2271 apache/HDDS-2271 git push origin HDDS-2271 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...szetszwo:HDDS-2271?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1610: HDDS-1868. Ozone pipelines should be marked as ready only after the leader election is complete.
elek commented on issue #1610: HDDS-1868. Ozone pipelines should be marked as ready only after the leader election is complete. URL: https://github.com/apache/hadoop/pull/1610#issuecomment-541394654 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:swagle/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-1868 apache/HDDS-1868 git push origin HDDS-1868 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...swagle:HDDS-1868?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1593: HDDS-2204. Avoid buffer coping in checksum verification.
elek commented on issue #1593: HDDS-2204. Avoid buffer coping in checksum verification. URL: https://github.com/apache/hadoop/pull/1593#issuecomment-541394649 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:szetszwo/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2204 apache/HDDS-2204 git push origin HDDS-2204 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...szetszwo:HDDS-2204?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1583: HDDS-2071. Support filters in ozone insight point
elek commented on issue #1583: HDDS-2071. Support filters in ozone insight point URL: https://github.com/apache/hadoop/pull/1583#issuecomment-541394664 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:elek/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2071 apache/HDDS-2071 git push origin HDDS-2071 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...elek:HDDS-2071?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1431: HDDS-1569 Support creating multiple pipelines with same datanode
elek commented on issue #1431: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop/pull/1431#issuecomment-541394641 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:timmylicheng/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-1569 apache/HDDS-1569 git push origin HDDS-1569 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...timmylicheng:HDDS-1569?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1528: HDDS-2181. Ozone Manager should send correct ACL type in ACL requests…
elek commented on issue #1528: HDDS-2181. Ozone Manager should send correct ACL type in ACL requests… URL: https://github.com/apache/hadoop/pull/1528#issuecomment-541394638 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:vivekratnavel/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2181 apache/HDDS-2181 git push origin HDDS-2181 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...vivekratnavel:HDDS-2181?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1560: HDDS-2214. TestSCMContainerPlacementRackAware has an intermittent failure
elek commented on issue #1560: HDDS-2214. TestSCMContainerPlacementRackAware has an intermittent failure URL: https://github.com/apache/hadoop/pull/1560#issuecomment-541394670 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:elek/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2214 apache/HDDS-2214 git push origin HDDS-2214 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...elek:HDDS-2214?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1638: HDDS-2280. HddsUtils#CheckForException should not return null in case…
elek commented on issue #1638: HDDS-2280. HddsUtils#CheckForException should not return null in case… URL: https://github.com/apache/hadoop/pull/1638#issuecomment-541394648 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:bshashikant/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2280 apache/HDDS-2280 git push origin HDDS-2280 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...bshashikant:HDDS-2280?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1643: HDDS-2278. Run S3 test suite on OM HA cluster.
elek commented on issue #1643: HDDS-2278. Run S3 test suite on OM HA cluster. URL: https://github.com/apache/hadoop/pull/1643#issuecomment-541394645 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:bharatviswa504/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2278 apache/HDDS-2278 git push origin HDDS-2278 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...bharatviswa504:HDDS-2278?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1624: HDDS-2267. Container metadata scanner interval mismatch
elek commented on issue #1624: HDDS-2267. Container metadata scanner interval mismatch URL: https://github.com/apache/hadoop/pull/1624#issuecomment-541394652 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:adoroszlai/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2267 apache/HDDS-2267 git push origin HDDS-2267 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...adoroszlai:HDDS-2267?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1641: HDDS-2281. ContainerStateMachine#handleWriteChunk should ignore close container exception.
elek commented on issue #1641: HDDS-2281. ContainerStateMachine#handleWriteChunk should ignore close container exception. URL: https://github.com/apache/hadoop/pull/1641#issuecomment-541394647 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:bshashikant/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2281 apache/HDDS-2281 git push origin HDDS-2281 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...bshashikant:HDDS-2281?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1559: HDDS-1737. Add Volume check in KeyManager and File Operations.
elek commented on issue #1559: HDDS-1737. Add Volume check in KeyManager and File Operations. URL: https://github.com/apache/hadoop/pull/1559#issuecomment-541394552 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:cxorm/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-1737 apache/HDDS-1737 git push origin HDDS-1737 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...cxorm:HDDS-1737?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1637: HDDS-2206. Separate handling for OMException and IOException in the Ozone Manager. Contributed by Supratim Deka
elek commented on issue #1637: HDDS-2206. Separate handling for OMException and IOException in the Ozone Manager. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/1637#issuecomment-541394632 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:supratimdeka/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2206 apache/HDDS-2206 git push origin HDDS-2206 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...supratimdeka:HDDS-2206?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1632: HDDS-2194. Replication of Container fails with Only closed containers…
elek commented on issue #1632: HDDS-2194. Replication of Container fails with Only closed containers… URL: https://github.com/apache/hadoop/pull/1632#issuecomment-541394637 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:bharatviswa504/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2194 apache/HDDS-2194 git push origin HDDS-2194 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...bharatviswa504:HDDS-2194?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1586: HDDS-2240. Command line tool for OM HA.
elek commented on issue #1586: HDDS-2240. Command line tool for OM HA. URL: https://github.com/apache/hadoop/pull/1586#issuecomment-541394635 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:hanishakoneru/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2240 apache/HDDS-2240 git push origin HDDS-2240 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...hanishakoneru:HDDS-2240?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1622: HDDS-1228. Chunk Scanner Checkpoints
elek commented on issue #1622: HDDS-1228. Chunk Scanner Checkpoints URL: https://github.com/apache/hadoop/pull/1622#issuecomment-541394634 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:adoroszlai/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-1228 apache/HDDS-1228 git push origin HDDS-1228 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...adoroszlai:HDDS-1228?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16622) intermittent failure of ITestCommitOperations: too many s3guard writes
[ https://issues.apache.org/jira/browse/HADOOP-16622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950340#comment-16950340 ] Steve Loughran commented on HADOOP-16622: - HADOOP-16644 is going to get the modtime on file creation (small files) or issue a HEAD on the multipart uploads. If we can get in then the problem should go away. If it doesn't, there's something else lurking Thanks for doing the testing -always good to stress different AWS regions, as they are not uniform in behaviour > intermittent failure of ITestCommitOperations: too many s3guard writes > -- > > Key: HADOOP-16622 > URL: https://issues.apache.org/jira/browse/HADOOP-16622 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3 >Affects Versions: 3.3.0 >Reporter: Steve Loughran >Priority: Minor > > intermittent failure of ITestCommitOperations; expected 2 s3guard writes, saw > 7 > the logged commit state shows that only two entries were added, so I'm not > sure what is up. Proposed: in HADOOP-16207 I will add s3guard.operations log > to debug so we get a trace of all DDB put/delete calls; this will let us > debug it when it surfaces again -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1563: HDDS-2221. Monitor datanodes in ozoneperf compose cluster
elek commented on issue #1563: HDDS-2221. Monitor datanodes in ozoneperf compose cluster URL: https://github.com/apache/hadoop/pull/1563#issuecomment-541393782 Thank you very much to open this pull request. During the weekend the Ozone source code has been moved out from [apache/hadoop](https://github.com/apache/hadoop) repository to [apache/hadoop-ozone](https://github.com/apache/hadoop-ozone) repository. This git commits are rewritten, but the branch of this pull request is also transformed (state of Saturday morning), you can use the new, migrated branch to recreate this pull request. Your pull request is important for us: **Can you please re-create your pull request in the new repository?** **1**. Create a new fork of https://github.com/apache/hadoop-ozone **2**. Clone it and have both your fork and the apache repo as remotes: ``` git clone g...@github.com:elek/hadoop-ozone.git cd hadoop-ozone git remote add apache g...@github.com:apache/hadoop-ozone.git git fetch apache ``` **3**. Fetch your migrated branch and push it to your fork. ``` git checkout -b HDDS-2221 apache/HDDS-2221 git push origin HDDS-2221 ``` **4**. And create the new pull request on the new repository. https://github.com/apache/hadoop-ozone/compare/master...elek:HDDS-2221?expand=1 If you need more information, please check [this](https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Ozone+source+tree+split) wiki page or contact with me (my github user name + apache.org). Thank you, and sorry for the inconvenience. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek closed pull request #1563: HDDS-2221. Monitor datanodes in ozoneperf compose cluster
elek closed pull request #1563: HDDS-2221. Monitor datanodes in ozoneperf compose cluster URL: https://github.com/apache/hadoop/pull/1563 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] elek commented on issue #1563: HDDS-2221. Monitor datanodes in ozoneperf compose cluster
elek commented on issue #1563: HDDS-2221. Monitor datanodes in ozoneperf compose cluster URL: https://github.com/apache/hadoop/pull/1563#issuecomment-541402756 Closing because https://github.com/apache/hadoop-ozone/pull/1 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] hanishakoneru commented on issue #1586: HDDS-2240. Command line tool for OM HA.
hanishakoneru commented on issue #1586: HDDS-2240. Command line tool for OM HA. URL: https://github.com/apache/hadoop/pull/1586#issuecomment-541449310 @elek Thank you for your comments and suggestions. 1. I have changed the command to "ozone admin om". We can add scmcli also to the same _ozone admin_ command. Also followed the cli conventions. The command would look like _ozone admin om getserviceroles --service-id_ 2. Updated the protocol and using the a new OMRequest to get the service roles. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] hanishakoneru commented on a change in pull request #1586: HDDS-2240. Command line tool for OM HA.
hanishakoneru commented on a change in pull request #1586: HDDS-2240. Command
line tool for OM HA.
URL: https://github.com/apache/hadoop/pull/1586#discussion_r334290534
##
File path:
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManagerHA.java
##
@@ -0,0 +1,76 @@
+package org.apache.hadoop.ozone.om;
+
+import org.apache.hadoop.hdds.cli.GenericCli;
+import org.apache.hadoop.hdds.cli.HddsVersionProvider;
+import org.apache.hadoop.hdds.conf.OzoneConfiguration;
+import org.apache.hadoop.hdds.tracing.TracingUtil;
+import org.apache.hadoop.ozone.om.protocol.OzoneManagerProtocol;
+import
org.apache.hadoop.ozone.om.protocolPB.OzoneManagerProtocolClientSideTranslatorPB;
+import org.apache.hadoop.security.UserGroupInformation;
+import
org.apache.hadoop.security.authentication.client.AuthenticationException;
+import org.apache.ratis.protocol.ClientId;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+import picocli.CommandLine;
+import picocli.CommandLine.Command;
+
+import java.io.IOException;
+import java.util.Map;
+
+
+/**
+ * A command line tool for making calls in OM HA protocols.
+ */
+@Command(name = "ozone omha",
+hidden = true, description = "Command line tool for OM HA.",
+versionProvider = HddsVersionProvider.class,
+mixinStandardHelpOptions = true)
+public class OzoneManagerHA extends GenericCli {
+ private OzoneConfiguration conf;
+ private static final Logger LOG =
+ LoggerFactory.getLogger(OzoneManagerHA.class);
+
+ public static void main(String[] args) throws Exception {
+TracingUtil.initTracing("OzoneManager");
+new OzoneManagerHA().run(args);
+ }
+
+ private OzoneManagerHA() {
+super();
+ }
+
+ /**
+ * This function implements a sub-command to allow the OM to be
+ * initialized from the command line.
+ */
+ @CommandLine.Command(name = "--getservicestate",
+ customSynopsis = "ozone om [global options] --getservicestate " +
+ "--serviceId=",
+ hidden = false,
+ description = "Get the Ratis server state of all OMs belonging to given"
+
+ " OM Service ID",
+ mixinStandardHelpOptions = true,
+ versionProvider = HddsVersionProvider.class)
+ public void getRoleInfoOm(@CommandLine.Option(names = { "--serviceId" },
+ description = "The OM Service ID of the OMs to get the server states
for",
+ paramLabel = "id") String serviceId)
+ throws Exception {
+conf = createOzoneConfiguration();
+Map serviceStates = getServiceStates(conf, serviceId);
+for (String nodeId : serviceStates.keySet()) {
+ System.out.println(nodeId + " : " + serviceStates.get(nodeId));
+}
Review comment:
Done.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] adoroszlai closed pull request #1622: HDDS-1228. Chunk Scanner Checkpoints
adoroszlai closed pull request #1622: HDDS-1228. Chunk Scanner Checkpoints URL: https://github.com/apache/hadoop/pull/1622 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] adoroszlai commented on issue #1622: HDDS-1228. Chunk Scanner Checkpoints
adoroszlai commented on issue #1622: HDDS-1228. Chunk Scanner Checkpoints URL: https://github.com/apache/hadoop/pull/1622#issuecomment-541443631 Moved to https://github.com/apache/hadoop-ozone/pull/7 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] adoroszlai closed pull request #1624: HDDS-2267. Container metadata scanner interval mismatch
adoroszlai closed pull request #1624: HDDS-2267. Container metadata scanner interval mismatch URL: https://github.com/apache/hadoop/pull/1624 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] adoroszlai commented on issue #1624: HDDS-2267. Container metadata scanner interval mismatch
adoroszlai commented on issue #1624: HDDS-2267. Container metadata scanner interval mismatch URL: https://github.com/apache/hadoop/pull/1624#issuecomment-541443599 Moved to https://github.com/apache/hadoop-ozone/pull/8 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] hanishakoneru commented on a change in pull request #1586: HDDS-2240. Command line tool for OM HA.
hanishakoneru commented on a change in pull request #1586: HDDS-2240. Command
line tool for OM HA.
URL: https://github.com/apache/hadoop/pull/1586#discussion_r334290807
##
File path: hadoop-ozone/common/src/main/proto/OzoneManagerProtocol.proto
##
@@ -1097,11 +1097,34 @@ message UpdateGetS3SecretRequest {
required string awsSecret = 2;
}
+message OMServiceId {
+required string serviceID = 1;
+}
+
+/**
+ This proto is used to define the OM node Id and its ratis server state.
+*/
+message RoleInfo {
+required string omNodeID = 1;
+required string ratisServerRole = 2;
+}
+
+/**
+ This is used to get the Server States of OMs.
+*/
+message ServiceState {
+repeated RoleInfo roleInfos = 1;
+}
+
/**
The OM service that takes care of Ozone namespace.
*/
service OzoneManagerService {
// A client-to-OM RPC to send client requests to OM Ratis server
rpc submitRequest(OMRequest)
returns(OMResponse);
+
+// A client-to-OM RPC to get ratis server states of OMs
+rpc getServiceState(OMServiceId)
+ returns(ServiceState);
}
Review comment:
Clients do not need this information.
I have added a new OMRequest to get the OM server roles. Did not add it to
getServiceList api because getServiceList is called when creating RpcClient (so
all clients make this call when starting up). But adding the server roles also
to this api would mean one extra Ratis call to get the server roles which is
not required by all clients. Hence, kept the two calls separate.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] hadoop-yetus commented on issue #1586: HDDS-2240. Command line tool for OM HA.
hadoop-yetus commented on issue #1586: HDDS-2240. Command line tool for OM HA. URL: https://github.com/apache/hadoop/pull/1586#issuecomment-541449941 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | reexec | 42 | Docker mode activated. | ||| _ Prechecks _ | | +1 | dupname | 0 | No case conflicting files found. | | 0 | shelldocs | 1 | Shelldocs was not available. | | +1 | @author | 0 | The patch does not contain any @author tags. | | -1 | test4tests | 0 | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ trunk Compile Tests _ | | 0 | mvndep | 35 | Maven dependency ordering for branch | | -1 | mvninstall | 35 | hadoop-hdds in trunk failed. | | -1 | mvninstall | 38 | hadoop-ozone in trunk failed. | | -1 | compile | 24 | hadoop-hdds in trunk failed. | | -1 | compile | 19 | hadoop-ozone in trunk failed. | | +1 | checkstyle | 62 | trunk passed | | +1 | mvnsite | 0 | trunk passed | | +1 | shadedclient | 813 | branch has no errors when building and testing our client artifacts. | | -1 | javadoc | 27 | hadoop-hdds in trunk failed. | | -1 | javadoc | 24 | hadoop-ozone in trunk failed. | | 0 | spotbugs | 932 | Used deprecated FindBugs config; considering switching to SpotBugs. | | -1 | findbugs | 38 | hadoop-hdds in trunk failed. | | -1 | findbugs | 25 | hadoop-ozone in trunk failed. | ||| _ Patch Compile Tests _ | | 0 | mvndep | 23 | Maven dependency ordering for patch | | -1 | mvninstall | 40 | hadoop-hdds in the patch failed. | | -1 | mvninstall | 41 | hadoop-ozone in the patch failed. | | -1 | compile | 29 | hadoop-hdds in the patch failed. | | -1 | compile | 23 | hadoop-ozone in the patch failed. | | -1 | cc | 29 | hadoop-hdds in the patch failed. | | -1 | cc | 23 | hadoop-ozone in the patch failed. | | -1 | javac | 29 | hadoop-hdds in the patch failed. | | -1 | javac | 23 | hadoop-ozone in the patch failed. | | -0 | checkstyle | 34 | hadoop-ozone: The patch generated 27 new + 0 unchanged - 0 fixed = 27 total (was 0) | | +1 | mvnsite | 0 | the patch passed | | +1 | shellcheck | 32 | There were no new shellcheck issues. | | +1 | whitespace | 0 | The patch has no whitespace issues. | | +1 | shadedclient | 737 | patch has no errors when building and testing our client artifacts. | | -1 | javadoc | 27 | hadoop-hdds in the patch failed. | | -1 | javadoc | 24 | hadoop-ozone in the patch failed. | | -1 | findbugs | 36 | hadoop-hdds in the patch failed. | | -1 | findbugs | 26 | hadoop-ozone in the patch failed. | ||| _ Other Tests _ | | -1 | unit | 33 | hadoop-hdds in the patch failed. | | -1 | unit | 30 | hadoop-ozone in the patch failed. | | +1 | asflicense | 36 | The patch does not generate ASF License warnings. | | | | 2577 | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.3 Server=19.03.3 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1586/2/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/1586 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle shellcheck shelldocs cc | | uname | Linux 220484ce9b24 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / 5f4641a | | Default Java | 1.8.0_222 | | mvninstall | https://builds.apache.org/job/hadoop-multibranch/job/PR-1586/2/artifact/out/branch-mvninstall-hadoop-hdds.txt | | mvninstall | https://builds.apache.org/job/hadoop-multibranch/job/PR-1586/2/artifact/out/branch-mvninstall-hadoop-ozone.txt | | compile | https://builds.apache.org/job/hadoop-multibranch/job/PR-1586/2/artifact/out/branch-compile-hadoop-hdds.txt | | compile | https://builds.apache.org/job/hadoop-multibranch/job/PR-1586/2/artifact/out/branch-compile-hadoop-ozone.txt | | javadoc | https://builds.apache.org/job/hadoop-multibranch/job/PR-1586/2/artifact/out/branch-javadoc-hadoop-hdds.txt | | javadoc | https://builds.apache.org/job/hadoop-multibranch/job/PR-1586/2/artifact/out/branch-javadoc-hadoop-ozone.txt | | findbugs | https://builds.apache.org/job/hadoop-multibranch/job/PR-1586/2/artifact/out/branch-findbugs-hadoop-hdds.txt | | findbugs | https://builds.apache.org/job/hadoop-multibranch/job/PR-1586/2/artifact/out/branch-findbugs-hadoop-ozone.txt | | mvninstall | https://builds.apache.org/job/hadoop-multibranch/job/PR-1586/2/artifact/out/patch-mvninstall-hadoop-hdds.txt | | mvninstall |
[GitHub] [hadoop] hanishakoneru commented on a change in pull request #1586: HDDS-2240. Command line tool for OM HA.
hanishakoneru commented on a change in pull request #1586: HDDS-2240. Command line tool for OM HA. URL: https://github.com/apache/hadoop/pull/1586#discussion_r334290649 ## File path: hadoop-ozone/common/src/main/bin/ozone ## @@ -55,6 +55,7 @@ function hadoop_usage hadoop_add_subcommand "version" client "print the version" hadoop_add_subcommand "dtutil" client "operations related to delegation tokens" hadoop_add_subcommand "upgrade" client "HDFS to Ozone in-place upgrade tool" + hadoop_add_subcommand "omha" client "OM HA tool" Review comment: Changed the command to "ozone admin om". SCM HA is also in the pipeline sometime in the future. As Marton also suggested, we can have all admin commands under this. This will include SCMCli also. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] hanishakoneru commented on issue #1586: HDDS-2240. Command line tool for OM HA.
hanishakoneru commented on issue #1586: HDDS-2240. Command line tool for OM HA. URL: https://github.com/apache/hadoop/pull/1586#issuecomment-541449466 Thank you @dineshchitlangia @elek and @anuengineer for the review and comments. I have migrated the Pull Request to the new hadoop-ozone repo - https://github.com/apache/hadoop-ozone/pull/9 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] hanishakoneru commented on a change in pull request #1586: HDDS-2240. Command line tool for OM HA.
hanishakoneru commented on a change in pull request #1586: HDDS-2240. Command
line tool for OM HA.
URL: https://github.com/apache/hadoop/pull/1586#discussion_r334290856
##
File path: hadoop-ozone/common/src/main/proto/OzoneManagerProtocol.proto
##
@@ -1097,11 +1097,34 @@ message UpdateGetS3SecretRequest {
required string awsSecret = 2;
}
+message OMServiceId {
+required string serviceID = 1;
+}
+
+/**
+ This proto is used to define the OM node Id and its ratis server state.
+*/
+message RoleInfo {
+required string omNodeID = 1;
+required string ratisServerRole = 2;
+}
+
+/**
+ This is used to get the Server States of OMs.
+*/
+message ServiceState {
+repeated RoleInfo roleInfos = 1;
+}
+
/**
The OM service that takes care of Ozone namespace.
*/
service OzoneManagerService {
// A client-to-OM RPC to send client requests to OM Ratis server
rpc submitRequest(OMRequest)
returns(OMResponse);
+
+// A client-to-OM RPC to get ratis server states of OMs
Review comment:
You are right. There is no need for new RPC. I thought we could keep the
admin protocols separate from the client protocols. But I think we can just use
the OMRequest for now. Updated it.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16485) Remove dependency on jackson
[ https://issues.apache.org/jira/browse/HADOOP-16485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950719#comment-16950719 ] Tatu Saloranta commented on HADOOP-16485: - Just to add quick comment regarding Jackson versions: unless "Default Typing" is enabled, with call to `mapper.enableDefaultTyping(...)` (which is something most projects do not do, and is not the default), none of multiple CVEs actually applies. Full explanation of when it does apply can be found from [https://medium.com/@cowtowncoder/on-jackson-cves-dont-panic-here-is-what-you-need-to-know-54cd0d6e8062] . Unfortunately security tools faithfully indicate that every single version with CVEs is considered suspect (unfortunately they have no concept of conditional applicability?) and it is annoying to get reports about existing version having CVEs against it. This will change with Jackson 2.10 – 2.10.0 having been released 2 weeks ago (Sep 26, 2019). CVEs of this class will not be applicable for 2.10 or later versions. So regardless of what ultimate plan is for json handling, it is possible to at least get rid of CVE warnings by upgrading. I would probably recommend waiting until 2.10.1, as standard precaution: that should be released during October. > Remove dependency on jackson > > > Key: HADOOP-16485 > URL: https://issues.apache.org/jira/browse/HADOOP-16485 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Wei-Chiu Chuang >Priority: Major > Labels: release-blocker > > Looking at git history, there were 5 commits related to updating jackson > versions due to various CVEs since 2018. And it seems to get worse more > recently. > File this jira to discuss the possibility of removing jackson dependency once > for all. I see that jackson is deeply integrated into Hadoop codebase, so not > a trivial task. However, if Hadoop is forced to make a new set of releases > because of Jackson vulnerabilities, it may start to look not so costly. > At the very least, consider stripping jackson-databind coode, since that's > where the majority of CVEs come from. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[GitHub] [hadoop] cxorm edited a comment on issue #1559: HDDS-1737. Add Volume check in KeyManager and File Operations.
cxorm edited a comment on issue #1559: HDDS-1737. Add Volume check in KeyManager and File Operations. URL: https://github.com/apache/hadoop/pull/1559#issuecomment-541295619 Thanks @bharatviswa504 The unit test can pass on my machine (But with 2x seconds) So I want to test my PR again to check the issue This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
