[jira] [Created] (YARN-9137) Get the IP and port of the docker container and display it on WEB UI2
Xun Liu created YARN-9137: - Summary: Get the IP and port of the docker container and display it on WEB UI2 Key: YARN-9137 URL: https://issues.apache.org/jira/browse/YARN-9137 Project: Hadoop YARN Issue Type: Sub-task Reporter: Xun Liu Assignee: Xun Liu 1. When using a container network such as Calico, the IP of the container is not the IP of the host, but is allocated in the private network, and the different containers can be directly connected. Exposing the services in the container through a reverse proxy such as Ngxin makes it easy for users to view the IP and port on WEB UI2 to use the services in the container, such as Tomcat, TensorBoard, and so on. 2. When not using a container network such as Calico, the container also has its own container port. So you need to display the IP and port of the docker container on WEB UI2. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
[jira] [Created] (YARN-9136) getNMResourceInfo NodeManager REST API method is not documented
Szilard Nemeth created YARN-9136:
Summary: getNMResourceInfo NodeManager REST API method is not
documented
Key: YARN-9136
URL: https://issues.apache.org/jira/browse/YARN-9136
Project: Hadoop YARN
Issue Type: Improvement
Reporter: Szilard Nemeth
Assignee: Alex Bodo
I cannot find documentation for the resources endpoint in NMWebServices:
/ws/v1/node/resources/\{resourcename\}
I looked in the file NodeManagerRest.md for documentation but haven't found any.
This is supposedly unintentionally not documented.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
[jira] [Created] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils
Szilard Nemeth created YARN-9134: Summary: No test coverage for redefining FPGA / GPU resource types in TestResourceUtils Key: YARN-9134 URL: https://issues.apache.org/jira/browse/YARN-9134 Project: Hadoop YARN Issue Type: Improvement Reporter: Szilard Nemeth Assignee: Szilard Nemeth The patch also includes some trivial code cleanup. Also, setupResourceTypes has been deprecated as it is dangerous to use, see the javadoc for details. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
[jira] [Created] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects
Szilard Nemeth created YARN-9135: Summary: NM State store ResourceMappings serialization are tested with Strings instead of real Device objects Key: YARN-9135 URL: https://issues.apache.org/jira/browse/YARN-9135 Project: Hadoop YARN Issue Type: Improvement Reporter: Szilard Nemeth Assignee: Szilard Nemeth -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
Re: [VOTE - 2] Merge HDFS-12943 branch to trunk - Consistent Reads from Standby
+1 Thanks for addressing concerns from the previous vote. On Fri, Dec 14, 2018 at 6:24 PM Konstantin Shvachko wrote: > Hi Hadoop developers, > > I would like to propose to merge to trunk the feature branch HDFS-12943 for > Consistent Reads from Standby Node. The feature is intended to scale read > RPC workloads. On large clusters reads comprise 95% of all RPCs to the > NameNode. We should be able to accommodate higher overall RPC workloads (up > to 4x by some estimates) by adding multiple ObserverNodes. > > The main functionality has been implemented see sub-tasks of HDFS-12943. > We followed up with the test plan. Testing was done on two independent > clusters (see HDFS-14058 and HDFS-14059) with security enabled. > We ran standard HDFS commands, MR jobs, admin commands including manual > failover. > We know of one cluster running this feature in production. > > Since the previous vote we addressed Daryn's concern (see HDFS-13873), > added documentation for the new feature, and fixed a few other jiras. > > I attached a unified patch to the umbrella jira for the review. > Please vote on this thread. The vote will run for 7 days until Wed Dec 21. > > Thanks, > --Konstantin > -- Zhe Zhang Apache Hadoop Committer http://zhe-thoughts.github.io/about/ | @oldcap
[jira] [Created] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler
Szilard Nemeth created YARN-9133: Summary: Make tests more easy to comprehend in TestGpuResourceHandler Key: YARN-9133 URL: https://issues.apache.org/jira/browse/YARN-9133 Project: Hadoop YARN Issue Type: Improvement Reporter: Szilard Nemeth Assignee: Szilard Nemeth Tests are not quite easy to read: - Some more helper methods would improve readability. - Eliminating the boolean flag that controls if docker is used -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/ [Dec 14, 2018 5:36:26 AM] (aajisaka) HDFS-13970. Use MultiMap for CacheManager Directives to simplify the [Dec 14, 2018 12:54:57 PM] (templedf) HDFS-14121. Log message about the old hosts file format is misleading [Dec 14, 2018 6:59:02 PM] (gifuma) HDFS-14145. [Dec 14, 2018 7:04:36 PM] (gifuma) HDFS-14088. RequestHedgingProxyProvider can throw NullPointerException [Dec 14, 2018 7:10:54 PM] (gifuma) HDFS-14006. Refactor name node to allow different token verification [Dec 14, 2018 10:08:22 PM] (billie) YARN-9032. Support sh shell for interactive container shell at command [Dec 14, 2018 10:52:26 PM] (eyang) YARN-9125. Fixed Carriage Return detection in Docker container launch [Dec 15, 2018 1:29:47 AM] (aajisaka) YARN-9122. Add table of contents to YARN Service API document. -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.registry.secure.TestSecureLogins hadoop.hdfs.qjournal.server.TestJournalNodeSync hadoop.hdfs.web.TestWebHdfsTimeouts cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/diff-compile-javac-root.txt [336K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/diff-checkstyle-root.txt [17M] hadolint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/diff-patch-hadolint.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/diff-patch-pylint.txt [60K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/whitespace-eol.txt [9.3M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/whitespace-tabs.txt [1.1M] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/branch-findbugs-hadoop-hdds_client.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/branch-findbugs-hadoop-hdds_framework.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/branch-findbugs-hadoop-hdds_tools.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/branch-findbugs-hadoop-ozone_client.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/branch-findbugs-hadoop-ozone_common.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/branch-findbugs-hadoop-ozone_ozonefs.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/branch-findbugs-hadoop-ozone_s3gateway.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/branch-findbugs-hadoop-ozone_tools.txt [8.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/diff-javadoc-javadoc-root.txt [752K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/patch-unit-hadoop-common-project_hadoop-registry.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/988/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [328K]
