[jira] [Created] (YARN-8745) Misplaced the TestRMWebServicesFairScheduler.java file.

2018-09-05 Thread Y. SREENIVASULU REDDY (JIRA) 
Y. SREENIVASULU REDDY created YARN-8745:
---

 Summary: Misplaced the TestRMWebServicesFairScheduler.java file.
 Key: YARN-8745
 URL: https://issues.apache.org/jira/browse/YARN-8745
 Project: Hadoop YARN
  Issue Type: Bug
  Components: fairscheduler, test
Reporter: Y. SREENIVASULU REDDY
Assignee: Y. SREENIVASULU REDDY


TestRMWebServicesFairScheduler.java file exist in
{noformat}
hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesFairScheduler.java
{noformat}
But the package structure is 
{noformat}
package org.apache.hadoop.yarn.server.resourcemanager.webapp.fairscheduler;
{noformat}

so moving the file to proper package.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-8746) ui2 overview doesn't display GPU usage info when using Fairscheduler

2018-09-05 Thread collinma (JIRA) 
collinma created YARN-8746:
--

 Summary: ui2 overview doesn't display GPU usage info when using 
Fairscheduler 
 Key: YARN-8746
 URL: https://issues.apache.org/jira/browse/YARN-8746
 Project: Hadoop YARN
  Issue Type: Bug
  Components: fairscheduler
Affects Versions: 3.1.1
Reporter: collinma


When using fair scheduler, GPU related information isn't displayed because the 
"metrics" api doesn't return any GPU related usage information( has run yarn on 
GPU per [this 
|[https://hadoop.apache.org/docs/r3.1.1/hadoop-yarn/hadoop-yarn-site/UsingGpus.html]).]
  The hadoop version is 3.1.1



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

[jira] [Created] (YARN-8747) ui2 page loading failed due to js error under some time zone configuration

2018-09-05 Thread collinma (JIRA) 
collinma created YARN-8747:
--

 Summary: ui2 page loading failed due to js error under some time 
zone configuration
 Key: YARN-8747
 URL: https://issues.apache.org/jira/browse/YARN-8747
 Project: Hadoop YARN
  Issue Type: Bug
  Components: webapp
Affects Versions: 3.1.1
Reporter: collinma
 Attachments: image-2018-09-05-18-54-03-991.png

We deployed hadoop 3.1.1 on centos 7.2 servers whose timezone is configured as 
GMT+8,  the web browser time zone is GMT+8 too. yarn ui page loaded failed due 
to js error:

 

!image-2018-09-05-18-54-03-991.png!

The moment-timezone js component raised that error. This has been fixed in 
moment-timezone 
v0.5.1([see|[https://github.com/moment/moment-timezone/issues/294]).] We need 
to update moment-timezone version accordingly



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Re: [Vote] Merge discussion for Node attribute support feature YARN-3409

2018-09-05 Thread Naganarasimha Garla 
Hi All,
 Thanks for feedback folks, based on the positive response starting
a Vote thread for merging YARN-3409 to master.

Regards,
+ Naga & Sunil

On Wed, 5 Sep 2018 2:51 am Wangda Tan,  wrote:

> +1 for the merge, it gonna be a great addition to 3.2.0 release. Thanks to
> everybody for pushing this feature to complete.
>
> Best,
> Wangda
>
> On Tue, Sep 4, 2018 at 8:25 AM Bibinchundatt 
> wrote:
>
>> +1 for merge. Fetaure would be a good addition to 3.2 release.
>>
>> --
>> Bibin A Chundatt
>> M: +91-9742095715
>> E: bibin.chund...@huawei.com
>> 2012实验室-印研IT&Cloud BU分部
>> 2012 Laboratories-IT&Cloud BU Branch Dept.
>> From:Naganarasimha Garla
>> To:common-...@hadoop.apache.org,Hdfs-dev,yarn-dev@hadoop.apache.org,
>> mapreduce-...@hadoop.apache.org,
>> Date:2018-08-29 20:00:44
>> Subject:[Discuss] Merge discussion for Node attribute support feature
>> YARN-3409
>>
>> Hi All,
>>
>> We would like to hear your thoughts on merging “Node Attributes Support in
>> YARN” branch (YARN-3409) [2] into trunk in a few weeks. The goal is to get
>> it in for HADOOP 3.2.
>>
>> *Major work happened in this branch*
>>
>> YARN-6858. Attribute Manager to store and provide node attributes in RM
>> YARN-7871. Support Node attributes reporting from NM to RM( distributed
>> node attributes)
>> YARN-7863. Modify placement constraints to support node attributes
>> YARN-7875. Node Attribute store for storing and recovering attributes
>>
>> *Detailed Design:*
>>
>> Please refer [1] for detailed design document.
>>
>> *Testing Efforts:*
>>
>> We did detailed tests for the feature in the last few weeks.
>> This feature will be enabled only when Node Attributes constraints are
>> specified through SchedulingRequest from AM.
>> Manager implementation will help to store and recover Node Attributes.
>> This
>> works with existing placement constraints.
>>
>> *Regarding to API stability:*
>>
>> All newly added @Public APIs are @Unstable.
>>
>> Documentation jira [3] could help to provide detailed configuration
>> details. This feature works from end-to-end and we tested this in our
>> local
>> cluster. Branch code is run against trunk and tracked via [4].
>>
>> We would love to get your thoughts before opening a voting thread.
>>
>> Special thanks to a team of folks who worked hard and contributed towards
>> this efforts including design discussion / patch / reviews, etc.: Weiwei
>> Yang, Bibin Chundatt, Wangda Tan, Vinod Kumar Vavilappali, Konstantinos
>> Karanasos, Arun Suresh, Varun Saxena, Devaraj Kavali, Lei Guo, Chong Chen.
>>
>> [1] :
>>
>> https://issues.apache.org/jira/secure/attachment/12937633/Node-Attributes-Requirements-Design-doc_v2.pdf
>> [2] : https://issues.apache.org/jira/browse/YARN-3409
>> [3] : https://issues.apache.org/jira/browse/YARN-7865
>> [4] : https://issues.apache.org/jira/browse/YARN-8718
>>
>> Thanks,
>> + Naga & Sunil Govindan
>>
>

[jira] [Created] (YARN-8748) Javadoc warnings within the nodemanager package

2018-09-05 Thread Shane Kumpf (JIRA) 
Shane Kumpf created YARN-8748:
-

 Summary: Javadoc warnings within the nodemanager package
 Key: YARN-8748
 URL: https://issues.apache.org/jira/browse/YARN-8748
 Project: Hadoop YARN
  Issue Type: Bug
Affects Versions: 3.2.0
Reporter: Shane Kumpf


There are a number of javadoc warnings in trunk in classes under the 
nodemanager package. These should be addressed or suppressed.
{code:java}
[WARNING] Javadoc Warnings
[WARNING] 
/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/ContainerExecutor.java:93:
 warning - Tag @see: reference not found: 
ContainerLaunch.ShellScriptBuilder#listDebugInformation
[WARNING] 
/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/JavaSandboxLinuxContainerRuntime.java:118:
 warning - YarnConfiguration#YARN_CONTAINER_SANDBOX (referenced by @value tag) 
is an unknown reference.
[WARNING] 
/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/JavaSandboxLinuxContainerRuntime.java:118:
 warning - YarnConfiguration#YARN_CONTAINER_SANDBOX_FILE_PERMISSIONS 
(referenced by @value tag) is an unknown reference.
[WARNING] 
/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/JavaSandboxLinuxContainerRuntime.java:118:
 warning - YarnConfiguration#YARN_CONTAINER_SANDBOX_POLICY (referenced by 
@value tag) is an unknown reference.
[WARNING] 
/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/JavaSandboxLinuxContainerRuntime.java:118:
 warning - YarnConfiguration#YARN_CONTAINER_SANDBOX_WHITELIST_GROUP (referenced 
by @value tag) is an unknown reference.
[WARNING] 
/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/JavaSandboxLinuxContainerRuntime.java:118:
 warning - YarnConfiguration#YARN_CONTAINER_SANDBOX_POLICY_GROUP_PREFIX 
(referenced by @value tag) is an unknown reference.
[WARNING] 
/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/JavaSandboxLinuxContainerRuntime.java:211:
 warning - YarnConfiguration#YARN_CONTAINER_SANDBOX_WHITELIST_GROUP (referenced 
by @value tag) is an unknown reference.
[WARNING] 
/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/JavaSandboxLinuxContainerRuntime.java:211:
 warning - NMContainerPolicyUtils#SECURITY_FLAG (referenced by @value tag) is 
an unknown reference.
[WARNING] 
/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/resources/TrafficControlBandwidthHandlerImpl.java:248:
 warning - @return tag has no arguments.
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org