[jira] [Created] (YARN-9176) [Submarine] Repair 404 error of links in documentation

2019-01-03 Thread Dongdong Hong (JIRA) 
Dongdong Hong created YARN-9176:
---

 Summary: [Submarine] Repair  404 error of  links in documentation 
 Key: YARN-9176
 URL: https://issues.apache.org/jira/browse/YARN-9176
 Project: Hadoop YARN
  Issue Type: Bug
  Components: documentation
Affects Versions: 3.2.0
Reporter: Dongdong Hong
 Fix For: 3.2.0
 Attachments: 404 error.jpg, 404.jpg

links in src/site/markdown/Examples.md and src/site/markdown/QuickStart.md will 
get 404, repair this links. !404.jpg!!404 error.jpg!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-9175) Null resources check in ResourceInfo for branch-3.0

2019-01-03 Thread Jonathan Hung (JIRA) 
Jonathan Hung created YARN-9175:
---

 Summary: Null resources check in ResourceInfo for branch-3.0
 Key: YARN-9175
 URL: https://issues.apache.org/jira/browse/YARN-9175
 Project: Hadoop YARN
  Issue Type: Bug
Reporter: Jonathan Hung
Assignee: Jonathan Hung


Check for null {{resources}} in ResourceInfo class to avoid NPE when rendering 
RM UI.

This was fixed as part of YARN-7934 which didn't make it to 3.0 and below.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-9174) branch-3.0/branch-2 refactoring of GpuDevice class

2019-01-03 Thread Jonathan Hung (JIRA) 
Jonathan Hung created YARN-9174:
---

 Summary: branch-3.0/branch-2 refactoring of GpuDevice class
 Key: YARN-9174
 URL: https://issues.apache.org/jira/browse/YARN-9174
 Project: Hadoop YARN
  Issue Type: Task
Reporter: Jonathan Hung
Assignee: Jonathan Hung


YARN-7224 refactors Gpu device numbers to a separate GpuDevice class, along 
with Docker support. This ticket is for doing the GpuDevice refactoring for 
branch-3.0 and branch-2.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-01-03 Thread Apache Jenkins Server 
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/

[Jan 2, 2019 1:39:45 PM] (wwei) MAPREDUCE-7174. Mapreduce example wordmedian 
should handle generic
[Jan 2, 2019 2:30:40 PM] (nandakumar131) HDDS-949. Update Ratis to 
0.4.0-a8c4ca0-SNAPSHOT. Contributed by Xiaoyu
[Jan 2, 2019 4:33:09 PM] (mackrorysd) HADOOP-15860. ABFS: Throw exception when 
directory / file name ends with
[Jan 2, 2019 7:30:54 PM] (aengineer) HDDS-482. NullPointer exception thrown on 
console when cli operation
[Jan 2, 2019 7:52:12 PM] (aengineer) HDDS-393. Audit Parser tool for processing 
ozone audit logs. Contributed
[Jan 2, 2019 10:24:01 PM] (stevel) HADOOP-16025. Update the year to 2019.




-1 overall


The following subsystems voted -1:
asflicense findbugs hadolint pathlen unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.security.ssl.TestSSLFactory 
   hadoop.registry.secure.TestSecureLogins 
   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerAutoCreatedQueuePreemption
 
   hadoop.yarn.client.cli.TestRMAdminCLI 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/diff-compile-javac-root.txt
  [336K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/diff-checkstyle-root.txt
  [17M]

   hadolint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/diff-patch-hadolint.txt
  [4.0K]

   pathlen:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/diff-patch-pylint.txt
  [60K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/diff-patch-shelldocs.txt
  [12K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/whitespace-eol.txt
  [9.3M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/whitespace-tabs.txt
  [1.1M]

   findbugs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/branch-findbugs-hadoop-hdds_client.txt
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/branch-findbugs-hadoop-hdds_framework.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/branch-findbugs-hadoop-hdds_tools.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/branch-findbugs-hadoop-ozone_client.txt
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/branch-findbugs-hadoop-ozone_common.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/branch-findbugs-hadoop-ozone_ozonefs.txt
  [12K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/branch-findbugs-hadoop-ozone_s3gateway.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/branch-findbugs-hadoop-ozone_tools.txt
  [8.0K]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/diff-javadoc-javadoc-root.txt
  [752K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [168K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1005/artifact/out/patch-unit-hadoop-common-project_hadoop-registry.txt
  [12K]

[jira] [Created] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-03 Thread Wilfred Spiegelenburg (JIRA) 
Wilfred Spiegelenburg created YARN-9173:
---

 Summary: FairShare calculation broken for large values after 
YARN-8833
 Key: YARN-9173
 URL: https://issues.apache.org/jira/browse/YARN-9173
 Project: Hadoop YARN
  Issue Type: Bug
  Components: fairscheduler
Affects Versions: 3.3.0
Reporter: Wilfred Spiegelenburg
Assignee: Wilfred Spiegelenburg


After the fix for the infinite loop in YARN-8833 we now get the wrong values 
back for fairshare calculations under certain circumstances. The current 
implementation works when the total resource is smaller than Integer.MAXVALUE.

When the total resource goes above that value the number of iterations is not 
enough to converge to the correct value.

The new test {{testResourceUsedWithWeightToResourceRatio()}} only checks that 
the calculation does not hang but does not check the outcome of the calculation.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Application Master Failure

2019-01-03 Thread Ved Gaurav 
If Application Master fails, how the currently running containers gets
released?

Regards,
Ved Prakash