[jira] [Commented] (YARN-7392) Render cluster information on the new yarn web ui

2017-11-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235260#comment-16235260 ] Sunil G commented on YARN-7392: --- +1 on latest patch. Pending jenkins. > Render cluster information on the

[jira] [Commented] (YARN-7392) Render cluster information on the new yarn web ui

2017-11-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235246#comment-16235246 ] Sunil G commented on YARN-7392: --- Please change Yarn to YARN in all js and hbs side > Render cluster

[jira] [Updated] (YARN-7364) Queue dash board in new YARN UI has incorrect values

2017-11-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7364: -- Attachment: YARN-7364.002.patch Attaching patch to handle queue dash board page in cluster-overview for both CS

[jira] [Commented] (YARN-7364) Queue dash board in new YARN UI has incorrect values

2017-11-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234555#comment-16234555 ] Sunil G commented on YARN-7364: --- With the current patch, FS UI wont come correct. I ll update a patch soon to

[jira] [Updated] (YARN-7364) Queue dash board in new YARN UI has incorrect values

2017-11-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7364: -- Affects Version/s: 3.0.0-beta1 > Queue dash board in new YARN UI has incorrect values >

[jira] [Updated] (YARN-7364) Queue dash board in new YARN UI has incorrect values

2017-11-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7364: -- Target Version/s: 3.0.0 > Queue dash board in new YARN UI has incorrect values >

[jira] [Updated] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2017-10-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7411: -- Attachment: YARN-7411.001.patch v1 patch > Inter-Queue preemption's computeFixpointAllocation need to handle

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-10-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226845#comment-16226845 ] Sunil G commented on YARN-7119: --- Thanks [~maniraj...@gmail.com]. Few comments # In {{parseResourceValue}},

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226814#comment-16226814 ] Sunil G commented on YARN-7159: --- [~maniraj...@gmail.com], could you please help to check the test case error.

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-10-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226809#comment-16226809 ] Sunil G commented on YARN-7413: --- Yes. I agree with [~templedf]. One document here will definitely help

[jira] [Commented] (YARN-7316) Cleaning up the usage of Resources and ResourceCalculator

2017-10-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226802#comment-16226802 ] Sunil G commented on YARN-7316: --- I understood your point well. However post your suggested approach, we will

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-10-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226789#comment-16226789 ] Sunil G commented on YARN-6953: --- [~maniraj...@gmail.com], please help to rebase. > Clean up

[jira] [Updated] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-10-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6909: -- Attachment: YARN-6909.002.patch Yes [~templedf], you are correct. I just did some refactoring to improve

[jira] [Updated] (YARN-7398) Update LICENSE.txt with respect to new YARN UI merge

2017-10-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7398: -- Summary: Update LICENSE.txt with respect to new YARN UI merge (was: LICENSE.txt is broken in branch-2 by

[jira] [Commented] (YARN-7398) LICENSE.txt is broken in branch-2 by YARN-4849 merge

2017-10-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226545#comment-16226545 ] Sunil G commented on YARN-7398: --- Thanks [~varun_saxena]. Committing to branch-2 > LICENSE.txt is broken in

[jira] [Commented] (YARN-7398) LICENSE.txt is broken in branch-2 by YARN-4849 merge

2017-10-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226439#comment-16226439 ] Sunil G commented on YARN-7398: --- +1 Committing this if no objections. [~varun_saxena], please help to check.

[jira] [Updated] (YARN-7398) LICENSE.txt is broken in branch-2 by YARN-4849 merge

2017-10-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7398: -- Attachment: YARN-7398.branch-2.02.patch bower files are not needed and we gave that version earlier. Attaching

[jira] [Commented] (YARN-7398) LICENSE.txt is broken in branch-2 by YARN-4849 merge

2017-10-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226421#comment-16226421 ] Sunil G commented on YARN-7398: --- [~varun_saxena] One quick comment. We also need to ass below entries to

[jira] [Commented] (YARN-7316) Cleaning up the usage of Resources and ResourceCalculator

2017-10-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226124#comment-16226124 ] Sunil G commented on YARN-7316: --- I think it was mainly because of a readability and to go with a common

[jira] [Updated] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-10-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6909: -- Attachment: YARN-6909.001.patch Attaching v1 patch. > The performance advantages of YARN-6679 are lost when

[jira] [Commented] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-10-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224653#comment-16224653 ] Sunil G commented on YARN-7410: --- Yes [~leftnoteasy]. I also found performance is improved. Attaching details

[jira] [Updated] (YARN-7331) Change in few metrics in new YARN UI related to native-services

2017-10-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7331: -- Attachment: YARN-7331.yarn-native-services.002.patch Thanks [~jianhe]. Fixed all comments. Also removed Dash

[jira] [Updated] (YARN-1963) Support priorities across applications within the same queue

2017-10-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-1963: -- Fix Version/s: 2.8.0 3.0.0-alpha1 > Support priorities across applications within the same

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224331#comment-16224331 ] Sunil G commented on YARN-7159: --- [~maniraj...@gmail.com] Some of test case failures are related. Pls help to

[jira] [Resolved] (YARN-1963) Support priorities across applications within the same queue

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-1963. --- Resolution: Fixed Closing this issue as all sub-items are done. > Support priorities across applications

[jira] [Updated] (YARN-2099) Preemption in fair scheduler should consider app priorities

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2099: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1963) > Preemption in fair scheduler should

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223854#comment-16223854 ] Sunil G commented on YARN-2098: --- linking to YARN-1963 > App priority support in Fair Scheduler >

[jira] [Updated] (YARN-2098) App priority support in Fair Scheduler

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2098: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1963) > App priority support in Fair Scheduler >

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223839#comment-16223839 ] Sunil G commented on YARN-7119: --- Thanks [~maniraj...@gmail.com] Few comments #

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223838#comment-16223838 ] Sunil G commented on YARN-7159: --- Thanks [~maniraj...@gmail.com]. Some more comments # In

[jira] [Commented] (YARN-6984) DominantResourceCalculator.isAnyMajorResourceZero() should test all resources

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223826#comment-16223826 ] Sunil G commented on YARN-6984: --- Thanks [~templedf]! Appreciate the same. >

[jira] [Commented] (YARN-7224) Support GPU isolation for docker container

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223823#comment-16223823 ] Sunil G commented on YARN-7224: --- Committing shortly. > Support GPU isolation for docker container >

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223621#comment-16223621 ] Sunil G commented on YARN-7369: --- bq.but they won't be new anymore. Yes. The existing statement to put them in

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-10-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223288#comment-16223288 ] Sunil G commented on YARN-7369: --- Thank you [~templedf] for helping in this. Few quick comments. # I think

[jira] [Commented] (YARN-7224) Support GPU isolation for docker container

2017-10-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223175#comment-16223175 ] Sunil G commented on YARN-7224: --- Test cases/ASF license are not related. Generally latest patch seems fine.

[jira] [Commented] (YARN-7332) Compute effectiveCapacity per each resource vector

2017-10-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222684#comment-16222684 ] Sunil G commented on YARN-7332: --- Yes. Earlier test failures seems a jenkins pblm. Its not related to patch.

[jira] [Commented] (YARN-7398) LICENSE.txt is broken in branch-2 by YARN-4849 merge

2017-10-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222611#comment-16222611 ] Sunil G commented on YARN-7398: --- I could see the major changes only for Mozilla License. And that is added in

[jira] [Updated] (YARN-7375) Possible NPE in RMWebapp when HA is enabled and the active RM fails

2017-10-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7375: -- Summary: Possible NPE in RMWebapp when HA is enabled and the active RM fails (was: NPE in the RM Webapp when HA

[jira] [Created] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2017-10-27 Thread Sunil G (JIRA)
Sunil G created YARN-7411: - Summary: Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee Key: YARN-7411 URL:

[jira] [Commented] (YARN-7398) LICENSE.txt is broken in branch-2 by YARN-4849 merge

2017-10-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222314#comment-16222314 ] Sunil G commented on YARN-7398: --- [~varun_saxena] Could I consider the attached patch as final patch after

[jira] [Updated] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-10-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7410: -- Attachment: YARN-7410.001.patch Attaching an initial patch on behalf of [~leftnoteasy] and submitting for

[jira] [Created] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-10-27 Thread Sunil G (JIRA)
Sunil G created YARN-7410: - Summary: Cleanup FixedValueResource to avoid dependency to ResourceUtils Key: YARN-7410 URL: https://issues.apache.org/jira/browse/YARN-7410 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7224) Support GPU isolation for docker container

2017-10-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222140#comment-16222140 ] Sunil G commented on YARN-7224: --- Thanks [~leftnoteasy] for the patch. Generally I am fine with the patch.

[jira] [Commented] (YARN-7398) LICENSE.txt is broken in branch-2 by YARN-4849 merge

2017-10-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220416#comment-16220416 ] Sunil G commented on YARN-7398: --- [~varun_saxena], it seems we miss a bit here. pls refer

[jira] [Commented] (YARN-7375) NPE in the RM Webapp when HA is enabled and the active RM fails

2017-10-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220180#comment-16220180 ] Sunil G commented on YARN-7375: --- +1. Committing later today if no objections. > NPE in the RM Webapp when HA

[jira] [Updated] (YARN-7332) Compute effectiveCapacity per each resource vector

2017-10-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7332: -- Attachment: YARN-7332.YARN-5881.003.patch Thanks [~leftnoteasy]. Yes, makes sense. And that was an interesting

[jira] [Commented] (YARN-7396) NPE when accessing container logs due to null dirsHandler

2017-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219842#comment-16219842 ] Sunil G commented on YARN-7396: --- Yes. Makes sense to me. > NPE when accessing container logs due to null

[jira] [Commented] (YARN-7224) Support GPU isolation for docker container

2017-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219840#comment-16219840 ] Sunil G commented on YARN-7224: --- bq.In general dockerCommandPlugin.updateDockerRunCommand helps to update

[jira] [Updated] (YARN-7332) Compute effectiveCapacity per each resource vector

2017-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7332: -- Attachment: YARN-7332.YARN-5881.002.patch Thanks [~leftnoteasy] Updating patch with test case. > Compute

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218980#comment-16218980 ] Sunil G commented on YARN-7244: --- I think latest patch seems fine to me. > ShuffleHandler is not aware of

[jira] [Commented] (YARN-7224) Support GPU isolation for docker container

2017-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218686#comment-16218686 ] Sunil G commented on YARN-7224: --- Thanks [~leftnoteasy]. Few more comments # Javadoc is missing in

[jira] [Commented] (YARN-7316) Cleaning up the usage of Resources and ResourceCalculator

2017-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218317#comment-16218317 ] Sunil G commented on YARN-7316: --- Thanks [~lovekesh.bansal]. I am in line with your approach. Could you please

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218311#comment-16218311 ] Sunil G commented on YARN-7159: --- bq.Based on my understaning, it has two parts. 1) Changes in

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-10-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218149#comment-16218149 ] Sunil G commented on YARN-6953: --- +1. Committing later today if there are no objections. > Clean up

[jira] [Commented] (YARN-7375) NPE in the RM Webapp when HA is enabled and the active RM fails

2017-10-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217237#comment-16217237 ] Sunil G commented on YARN-7375: --- No Issues. I submitted this patch to jenkins and will see whether warning

[jira] [Commented] (YARN-7224) Support GPU isolation for docker container

2017-10-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216956#comment-16216956 ] Sunil G commented on YARN-7224: --- Thanks [~leftnoteasy] for the effort. Few comments #

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-10-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216435#comment-16216435 ] Sunil G commented on YARN-6953: --- Kicking jenkins again before committing. Pinging [~templedf] to see if he

[jira] [Commented] (YARN-7383) Node resource not parsed correctly for resource names containing dot

2017-10-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216431#comment-16216431 ] Sunil G commented on YARN-7383: --- Yes. Since we can have more devices like fpga etc, this naming model was

[jira] [Commented] (YARN-7375) NPE in the RM Webapp when HA is enabled and the active RM fails

2017-10-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216422#comment-16216422 ] Sunil G commented on YARN-7375: --- Patch looks good. However its better to keep

[jira] [Updated] (YARN-6984) DominantResourceCalculator.isAnyMajorResourceZero() should test all resources

2017-10-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6984: -- Attachment: YARN-6984.002.patch Thanks [~templedf]. Updating new patch >

[jira] [Updated] (YARN-7332) Compute effectiveCapacity per each resource vector

2017-10-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7332: -- Attachment: YARN-7332.YARN-5881.001.patch Updating v1 patch. cc/ [~leftnoteasy]. > Compute effectiveCapacity

[jira] [Updated] (YARN-6984) DominantResourceCalculator.isAnyMajorResourceZero() should test all resources

2017-10-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6984: -- Attachment: YARN-6984.001.patch Attaching an initial version of patch. cc/ [~leftnoteasy] [~templedf] >

[jira] [Updated] (YARN-6984) DominantResourceCalculator.isAnyMajorResourceZero() should test all resources

2017-10-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6984: -- Target Version/s: 3.1.0 (was: YARN-3926) > DominantResourceCalculator.isAnyMajorResourceZero() should test all

[jira] [Updated] (YARN-7307) Revisit resource-types.xml loading behaviors

2017-10-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7307: -- Attachment: YARN-7307.004.patch Thanks [~leftnoteasy] Updated patch addressing all comments. > Revisit

[jira] [Commented] (YARN-7370) Intra-queue preemption properties should be refreshable

2017-10-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214866#comment-16214866 ] Sunil G commented on YARN-7370: --- Yes. I am also in same line in using {{-refreshQueues}} for refreshing all

[jira] [Updated] (YARN-7364) Queue dash board in new YARN UI has incorrect values

2017-10-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7364: -- Attachment: YARN-7364.001.patch attaching v1 patch. cc/ [~rohithsharma] [~vrushalic] [~leftnoteasy] > Queue

[jira] [Created] (YARN-7364) Queue dash board in new YARN UI has incorrect values

2017-10-19 Thread Sunil G (JIRA)
Sunil G created YARN-7364: - Summary: Queue dash board in new YARN UI has incorrect values Key: YARN-7364 URL: https://issues.apache.org/jira/browse/YARN-7364 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7307) Revisit resource-types.xml loading behaviors

2017-10-18 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7307: -- Attachment: YARN-7307.003.patch Thanks [~leftnoteasy] Attaching v3 patch fixing all comments. For #2, as

[jira] [Commented] (YARN-6927) Add support for individual resource types requests in MapReduce

2017-10-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208845#comment-16208845 ] Sunil G commented on YARN-6927: --- Yes. Thats correct. +1 on this. > Add support for individual resource types

[jira] [Comment Edited] (YARN-7338) Support same origin policy for cross site scripting prevention.

2017-10-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208745#comment-16208745 ] Sunil G edited comment on YARN-7338 at 10/18/17 3:07 AM: - This patch has filters

[jira] [Updated] (YARN-7338) Support same origin policy for cross site scripting prevention.

2017-10-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7338: -- Attachment: YARN-7338.001.patch This patch has filters added to ui2 > Support same origin policy for cross site

[jira] [Commented] (YARN-7338) Support same origin policy for cross site scripting prevention.

2017-10-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208739#comment-16208739 ] Sunil G commented on YARN-7338: --- Thanks [~eyang] for sharing more points here. {noformat} Request

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207983#comment-16207983 ] Sunil G commented on YARN-7244: --- Thanks [~kshukla] and [~jlowe] Usage of {{AuxiliaryLocalPathHandler}} looks

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2017-10-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207920#comment-16207920 ] Sunil G commented on YARN-6492: --- [~maniraj...@gmail.com] With the support of resource vectors, could we not

[jira] [Commented] (YARN-7338) Support same origin policy for cross site scripting prevention.

2017-10-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207909#comment-16207909 ] Sunil G commented on YARN-7338: --- Also we have checked many bank websites like "Bank Of America" and google

[jira] [Comment Edited] (YARN-6856) Support CLI for Node Attributes Mapping

2017-10-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207179#comment-16207179 ] Sunil G edited comment on YARN-6856 at 10/17/17 8:48 AM: -

[jira] [Commented] (YARN-6856) Support CLI for Node Attributes Mapping

2017-10-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207179#comment-16207179 ] Sunil G commented on YARN-6856: --- [~naganarasimha...@apache.org] Thanks for the patch. A quick question here.

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207175#comment-16207175 ] Sunil G commented on YARN-7159: --- Thanks [~maniraj...@gmail.com] for the effort. I could see the improvement

[jira] [Commented] (YARN-7338) Support same origin policy for cross site scripting prevention.

2017-10-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207087#comment-16207087 ] Sunil G commented on YARN-7338: --- Thanks [~eyang] for clarifying. As mentioned earlier, when client access ui2

[jira] [Commented] (YARN-7338) Support same origin policy for cross site scripting prevention.

2017-10-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206987#comment-16206987 ] Sunil G commented on YARN-7338: --- UI2 is launched as a separate service context in same RM webserver. And UI2

[jira] [Created] (YARN-7332) Compute effectiveCapacity per each resource vector

2017-10-16 Thread Sunil G (JIRA)
Sunil G created YARN-7332: - Summary: Compute effectiveCapacity per each resource vector Key: YARN-7332 URL: https://issues.apache.org/jira/browse/YARN-7332 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-7307) Revisit resource-types.xml loading behaviors

2017-10-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7307: -- Attachment: YARN-7307.002.patch Thanks [~leftnoteasy]. Updating v2 patch after addressing the comments. Ideally

[jira] [Updated] (YARN-7331) Change in few metrics in new YARN UI related to native-services

2017-10-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7331: -- Attachment: YARN-7331.yarn-native-services.001.patch attaching an initial version of patch. cc/ [~jianhe]

[jira] [Created] (YARN-7331) Change in few metrics in new YARN UI related to native-services

2017-10-16 Thread Sunil G (JIRA)
Sunil G created YARN-7331: - Summary: Change in few metrics in new YARN UI related to native-services Key: YARN-7331 URL: https://issues.apache.org/jira/browse/YARN-7331 Project: Hadoop YARN Issue

[jira] [Comment Edited] (YARN-6927) Add support for individual resource types requests in MapReduce

2017-10-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205011#comment-16205011 ] Sunil G edited comment on YARN-6927 at 10/15/17 4:01 AM: - Yes. This sounds a better

[jira] [Commented] (YARN-6927) Add support for individual resource types requests in MapReduce

2017-10-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205011#comment-16205011 ] Sunil G commented on YARN-6927: --- Yes. This sounds a better syntax {{(memory=x unit, vcore=y unit, gpu=z unit,

[jira] [Updated] (YARN-6927) Add support for individual resource types requests in MapReduce

2017-10-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6927: -- Target Version/s: 3.1.0 (was: YARN-3926) > Add support for individual resource types requests in MapReduce >

[jira] [Updated] (YARN-6927) Add support for individual resource types requests in MapReduce

2017-10-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6927: -- Affects Version/s: (was: YARN-3926) > Add support for individual resource types requests in MapReduce >

[jira] [Commented] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204528#comment-16204528 ] Sunil G commented on YARN-7254: --- These test case are tracked in YARN-7270 and is already committed. This

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.009.patch Fixing findbugs > UI and metrics changes related to absolute resource

[jira] [Commented] (YARN-7170) Investigate bower dependencies for YARN UI v2

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203951#comment-16203951 ] Sunil G commented on YARN-7170: --- Yes. We need this there as well. > Investigate bower dependencies for YARN

[jira] [Comment Edited] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203868#comment-16203868 ] Sunil G edited comment on YARN-7270 at 10/13/17 5:07 PM: - Yes. Correct. Fine from

[jira] [Commented] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203868#comment-16203868 ] Sunil G commented on YARN-7270: --- Yes. Correct. Fine from end as well. Thanks. > Resource#getVirtualCores()

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.008.patch one more test case correction. updating v8 patch. > UI and metrics

[jira] [Commented] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203727#comment-16203727 ] Sunil G commented on YARN-7270: --- javac warning is related. In {{TestResourcePBImpl}}, please use

[jira] [Resolved] (YARN-7324) TestCapacitySchedulerWithMultiResourceTypes.testBasicCapacitySchedulerWithProfile fails in trunk

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7324. --- Resolution: Invalid Marking as invalid as its a branch specific issue. >

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.007.patch Several test cases are failing and its been tracked in YARN-7324 and

[jira] [Created] (YARN-7324) TestCapacitySchedulerWithMultiResourceTypes.testBasicCapacitySchedulerWithProfile fails in trunk

2017-10-13 Thread Sunil G (JIRA)
Sunil G created YARN-7324: - Summary: TestCapacitySchedulerWithMultiResourceTypes.testBasicCapacitySchedulerWithProfile fails in trunk Key: YARN-7324 URL: https://issues.apache.org/jira/browse/YARN-7324

[jira] [Commented] (YARN-7170) Investigate bower dependencies for YARN UI v2

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203317#comment-16203317 ] Sunil G commented on YARN-7170: --- I tried this command with v2 patch. I could see that dependency is lesser

[jira] [Resolved] (YARN-7314) Multiple Resource manager test cases failing

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7314. --- Resolution: Duplicate > Multiple Resource manager test cases failing >

<    6   7   8   9   10   11   12   13   14   15   >