[jira] [Updated] (YARN-8212) Pending backlog for async allocation threads should be configurable

[ https://issues.apache.org/jira/browse/YARN-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8212: --- Attachment: YARN-8212.001.patch > Pending backlog for async allocation threads should be configurable > ---

[jira] [Commented] (YARN-8212) Pending backlog for async allocation threads should be configurable

[ https://issues.apache.org/jira/browse/YARN-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16453892#comment-16453892 ] Tao Yang commented on YARN-8212: Attached v1 patch for review. > Pending backlog for async

[jira] [Created] (YARN-8222) NPE in RMContainerImpl$FinishedTransition#updateAttemptMetrics

Tao Yang created YARN-8222: -- Summary: NPE in RMContainerImpl$FinishedTransition#updateAttemptMetrics Key: YARN-8222 URL: https://issues.apache.org/jira/browse/YARN-8222 Project: Hadoop YARN Issue T

[jira] [Updated] (YARN-8222) NPE in RMContainerImpl$FinishedTransition#updateAttemptMetrics

[ https://issues.apache.org/jira/browse/YARN-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8222: --- Description: (1) NPE in This NPE looks like may happen when node heartbeat delay and try to update attempt me

[jira] [Updated] (YARN-8222) NPE in RMContainerImpl$FinishedTransition#updateAttemptMetrics

[ https://issues.apache.org/jira/browse/YARN-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8222: --- Description: Recently we did some performance tests and found two NPE problems when calling rmContext.getRMApp

[jira] [Updated] (YARN-8222) NPE when calling rmContext.getRMApps().get(...).getCurrentAppAttempt()

[ https://issues.apache.org/jira/browse/YARN-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8222: --- Summary: NPE when calling rmContext.getRMApps().get(...).getCurrentAppAttempt() (was: NPE in RMContainerImpl$

[jira] [Updated] (YARN-8222) NPE when calling rmContext.getRMApps().get(...).getCurrentAppAttempt()

[ https://issues.apache.org/jira/browse/YARN-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8222: --- Attachment: YARN-8222.001.patch > NPE when calling rmContext.getRMApps().get(...).getCurrentAppAttempt() >

[jira] [Commented] (YARN-8222) NPE when calling rmContext.getRMApps().get(...).getCurrentAppAttempt()

[ https://issues.apache.org/jira/browse/YARN-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16456133#comment-16456133 ] Tao Yang commented on YARN-8222: Attached v1 patch for review. > NPE when calling rmContex

[jira] [Created] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal but its allocatedOrReservedContainer is null

Tao Yang created YARN-8233: -- Summary: NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal but its allocatedOrReservedContainer is null Key: YARN-8233 URL: https://issues.apache.org/jira/browse/YARN

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8233: --- Summary: NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedCo

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457421#comment-16457421 ] Tao Yang commented on YARN-8233: Attached v1 patch for review. > NPE in CapacityScheduler#

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8233: --- Attachment: YARN-8233.001.patch > NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal >

[jira] [Updated] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8025: --- Attachment: YARN-8025.001.patch > UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to > pr

[jira] [Assigned] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang reassigned YARN-8025: -- Assignee: Tao Yang > UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to > preCompu

[jira] [Commented] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457499#comment-16457499 ] Tao Yang commented on YARN-8025: Thanks [~yangjiandan] for discovering this problem. This

[jira] [Created] (YARN-8245) Validate the existence of parent queue for add-queue operation in scheduler-conf REST API

Tao Yang created YARN-8245: -- Summary: Validate the existence of parent queue for add-queue operation in scheduler-conf REST API Key: YARN-8245 URL: https://issues.apache.org/jira/browse/YARN-8245 Project: Ha

[jira] [Updated] (YARN-8245) Validate the existence of parent queue for add-queue operation in scheduler-conf REST API

[ https://issues.apache.org/jira/browse/YARN-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8245: --- Attachment: YARN-8245.001.patch > Validate the existence of parent queue for add-queue operation in > schedule

[jira] [Updated] (YARN-8245) Validate the existence of parent queue for add-queue operation in scheduler-conf REST API

[ https://issues.apache.org/jira/browse/YARN-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8245: --- Affects Version/s: 3.2.0 > Validate the existence of parent queue for add-queue operation in > scheduler-conf

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16463507#comment-16463507 ] Tao Yang commented on YARN-8233: cc [~leftnoteasy] and [~cheersyang], can you help to revie

[jira] [Commented] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16463744#comment-16463744 ] Tao Yang commented on YARN-8025: Thanks [~cheersyang] for reminding me.  # Make sense to m

[jira] [Updated] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8025: --- Attachment: YARN-8025.002.patch > UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to > pr

[jira] [Updated] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7003: --- Attachment: YARN-7003.002.patch > DRAINING state of queues can't be recovered after RM restart > --

[jira] [Commented] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16465728#comment-16465728 ] Tao Yang commented on YARN-7003: Update v2 patch for trunk now. [~cheersyang], can you help

[jira] [Updated] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7003: --- Attachment: YARN-7003.003.patch > DRAINING state of queues can't be recovered after RM restart > --

[jira] [Commented] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470239#comment-16470239 ] Tao Yang commented on YARN-7003: Thanks [~cheersyang] for your detailed analyzation. Make s

[jira] [Updated] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7003: --- Attachment: YARN-7003.004.patch > DRAINING state of queues can't be recovered after RM restart > --

[jira] [Commented] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470564#comment-16470564 ] Tao Yang commented on YARN-7003: UT failures seems irrelative with this patch. Attached v4

[jira] [Comment Edited] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16470564#comment-16470564 ] Tao Yang edited comment on YARN-7003 at 5/10/18 3:41 PM: - UT failur

[jira] [Created] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

Tao Yang created YARN-7461: -- Summary: DominantResourceCalculator#ratio calculation problem when right resource contains zero value Key: YARN-7461 URL: https://issues.apache.org/jira/browse/YARN-7461 Project:

[jira] [Updated] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7461: --- Attachment: YARN-7461.001.patch > DominantResourceCalculator#ratio calculation problem when right resource > c

[jira] [Updated] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7461: --- Attachment: YARN-7461.002.patch Thanks [~templedf] for your comments. I tried to reproduce our problem before w

[jira] [Comment Edited] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16245157#comment-16245157 ] Tao Yang edited comment on YARN-7461 at 11/9/17 3:33 AM: - Thanks [~

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16247143#comment-16247143 ] Tao Yang commented on YARN-7461: Thanks [~templedf] for your comments. I wrongly assumed t

[jira] [Created] (YARN-7471) queueUsagePercentage is wrongly calculated for applications in zero-capacity queues

Tao Yang created YARN-7471: -- Summary: queueUsagePercentage is wrongly calculated for applications in zero-capacity queues Key: YARN-7471 URL: https://issues.apache.org/jira/browse/YARN-7471 Project: Hadoop Y

[jira] [Updated] (YARN-7471) queueUsagePercentage is wrongly calculated for applications in zero-capacity queues

[ https://issues.apache.org/jira/browse/YARN-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7471: --- Attachment: YARN-7471.001.patch > queueUsagePercentage is wrongly calculated for applications in zero-capacity

[jira] [Created] (YARN-7489) ConcurrentModificationException in RMAppImpl#getRMAppMetrics

Tao Yang created YARN-7489: -- Summary: ConcurrentModificationException in RMAppImpl#getRMAppMetrics Key: YARN-7489 URL: https://issues.apache.org/jira/browse/YARN-7489 Project: Hadoop YARN Issue Typ

[jira] [Updated] (YARN-7489) ConcurrentModificationException in RMAppImpl#getRMAppMetrics

[ https://issues.apache.org/jira/browse/YARN-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7489: --- Description: The REST clients have sometimes failed to query applications through apps REST API in RMWebServic

[jira] [Updated] (YARN-7489) ConcurrentModificationException in RMAppImpl#getRMAppMetrics

[ https://issues.apache.org/jira/browse/YARN-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7489: --- Attachment: YARN-7489.001.patch > ConcurrentModificationException in RMAppImpl#getRMAppMetrics > --

[jira] [Updated] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7461: --- Attachment: YARN-7461.003.patch Updating the patch to skip ratio calculation for resource types whose left val

[jira] [Created] (YARN-7508) NPE in FiCaSchedulerApp when debug log enabled and try to commit outdated reserved proposal in async-scheduling mode

Tao Yang created YARN-7508: -- Summary: NPE in FiCaSchedulerApp when debug log enabled and try to commit outdated reserved proposal in async-scheduling mode Key: YARN-7508 URL: https://issues.apache.org/jira/browse/YARN-75

[jira] [Updated] (YARN-7508) NPE in FiCaSchedulerApp when debug log enabled and try to commit outdated reserved proposal in async-scheduling mode

[ https://issues.apache.org/jira/browse/YARN-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7508: --- Attachment: YARN-7508.001.patch Uploading v1 patch. [~sunilg], Could you help to review, please? > NPE in FiCa

[jira] [Assigned] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang reassigned YARN-7509: -- Assignee: Tao Yang > AsyncScheduleThread and ResourceCommitterService are still running after RM > is t

[jira] [Created] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

Tao Yang created YARN-7509: -- Summary: AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby Key: YARN-7509 URL: https://issues.apache.org/jira/browse/YARN-7509

[jira] [Updated] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7509: --- Attachment: YARN-7509.001.patch Attaching v1 patch for review. > AsyncScheduleThread and ResourceCommitterServ

[jira] [Created] (YARN-7511) NPE in ContainerLocalizer when localization failed for running container

Tao Yang created YARN-7511: -- Summary: NPE in ContainerLocalizer when localization failed for running container Key: YARN-7511 URL: https://issues.apache.org/jira/browse/YARN-7511 Project: Hadoop YARN

[jira] [Updated] (YARN-7511) NPE in ContainerLocalizer when localization failed for running container

[ https://issues.apache.org/jira/browse/YARN-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7511: --- Attachment: YARN-7511.001.patch Attaching v1 patch for review. > NPE in ContainerLocalizer when localization f

[jira] [Commented] (YARN-7508) NPE in FiCaSchedulerApp when debug log enabled and try to commit outdated reserved proposal in async-scheduling mode

[ https://issues.apache.org/jira/browse/YARN-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16256364#comment-16256364 ] Tao Yang commented on YARN-7508: Thanks [~sunilg] and [~bibinchundatt] for your review and

[jira] [Created] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

Tao Yang created YARN-7525: -- Summary: Incorrect query parameters in cluster nodes REST API document Key: YARN-7525 URL: https://issues.apache.org/jira/browse/YARN-7525 Project: Hadoop YARN Issue Ty

[jira] [Updated] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

[ https://issues.apache.org/jira/browse/YARN-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7525: --- Attachment: YARN-7525.001.patch > Incorrect query parameters in cluster nodes REST API document > -

[jira] [Updated] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

[ https://issues.apache.org/jira/browse/YARN-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7525: --- Fix Version/s: (was: 2.9.1) (was: 3.0.0-alpha4) > Incorrect query parameters in clus

[jira] [Created] (YARN-7527) Over-allocate node resource in async-scheduling mode of CapacityScheduler

Tao Yang created YARN-7527: -- Summary: Over-allocate node resource in async-scheduling mode of CapacityScheduler Key: YARN-7527 URL: https://issues.apache.org/jira/browse/YARN-7527 Project: Hadoop YARN

[jira] [Updated] (YARN-7527) Over-allocate node resource in async-scheduling mode of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7527: --- Attachment: YARN-7527.001.patch Attaching init patch for review. > Over-allocate node resource in async-schedu

[jira] [Updated] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

[ https://issues.apache.org/jira/browse/YARN-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7525: --- Attachment: YARN-7525.002.patch Thanks [~bibinchundatt] for your review and suggestion. Yes, it's good to add

[jira] [Commented] (YARN-7489) ConcurrentModificationException in RMAppImpl#getRMAppMetrics

[ https://issues.apache.org/jira/browse/YARN-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258833#comment-16258833 ] Tao Yang commented on YARN-7489: Thanks [~bibinchundatt] for your review and commit. > Con

[jira] [Updated] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

[ https://issues.apache.org/jira/browse/YARN-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7525: --- Attachment: YARN-7525-branch-2.001.patch YARN-7525-branch-2.8.001.patch Attaching patches for b

[jira] [Updated] (YARN-7489) ConcurrentModificationException in RMAppImpl#getRMAppMetrics

[ https://issues.apache.org/jira/browse/YARN-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7489: --- Attachment: YARN-7489-branch-2.001.patch Attaching patch for 2.9 and 2.8. > ConcurrentModificationException in

[jira] [Commented] (YARN-7004) Add configs cache to optimize refreshQueues performance for large scale of queues

[ https://issues.apache.org/jira/browse/YARN-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259019#comment-16259019 ] Tao Yang commented on YARN-7004: Thanks [~leftnoteasy] and [~jhung] for your comments. Thi

[jira] [Updated] (YARN-7527) Over-allocate node resource in async-scheduling mode of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7527: --- Attachment: YARN-7527-branch-2.001.patch Thanks [~leftnoteasy] for review and commit. Attaching patch for branc

[jira] [Created] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

Tao Yang created YARN-7591: -- Summary: NPE in async-scheduling mode of CapacityScheduler Key: YARN-7591 URL: https://issues.apache.org/jira/browse/YARN-7591 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7591: --- Attachment: YARN-7591.001.patch Attaching init patch without UT for review. [~leftnoteasy], please help to rev

[jira] [Commented] (YARN-5139) [Umbrella] Move YARN scheduler towards global scheduler

[ https://issues.apache.org/jira/browse/YARN-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274131#comment-16274131 ] Tao Yang commented on YARN-5139: Async-scheduling decouples scheduling from nm heartbeats a

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: YARN-7005.001.patch Attaching init patch for review. [~leftnoteasy], please help to review in your

[jira] [Created] (YARN-7593) SessionMovedException in ZKRMStateStore and can't auto recover after ZK connection timeout

Tao Yang created YARN-7593: -- Summary: SessionMovedException in ZKRMStateStore and can't auto recover after ZK connection timeout Key: YARN-7593 URL: https://issues.apache.org/jira/browse/YARN-7593 Project: H

[jira] [Updated] (YARN-7593) SessionMovedException in ZKRMStateStore and can't recover

[ https://issues.apache.org/jira/browse/YARN-7593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7593: --- Summary: SessionMovedException in ZKRMStateStore and can't recover (was: SessionMovedException in ZKRMStateSto

[jira] [Updated] (YARN-7593) SessionMovedException in ZKRMStateStore and can't auto recover

[ https://issues.apache.org/jira/browse/YARN-7593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7593: --- Summary: SessionMovedException in ZKRMStateStore and can't auto recover (was: SessionMovedException in ZKRMSta

[jira] [Commented] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16276346#comment-16276346 ] Tao Yang commented on YARN-7591: Thanks [~leftnoteasy] for review. {quote} I'm still not s

[jira] [Commented] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16276622#comment-16276622 ] Tao Yang commented on YARN-7005: Thanks [~leftnoteasy] for your suggestions. Yes, it's enou

[jira] [Updated] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7591: --- Attachment: YARN-7591.002.patch Thanks [~leftnoteasy] for your suggestion. Attaching v2 patch with comments of

[jira] [Created] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

Tao Yang created YARN-7621: -- Summary: Support submitting apps with queue path for CapacityScheduler Key: YARN-7621 URL: https://issues.apache.org/jira/browse/YARN-7621 Project: Hadoop YARN Issue Ty

[jira] [Updated] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7621: --- Attachment: YARN-7621.001.patch Attaching init patch for review. > Support submitting apps with queue path for

[jira] [Assigned] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang reassigned YARN-7621: -- Assignee: Tao Yang > Support submitting apps with queue path for CapacityScheduler > ---

[jira] [Commented] (YARN-5139) [Umbrella] Move YARN scheduler towards global scheduler

[ https://issues.apache.org/jira/browse/YARN-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283265#comment-16283265 ] Tao Yang commented on YARN-5139: Thanks [~leftnoteasy] for detailed introduction above and

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283419#comment-16283419 ] Tao Yang commented on YARN-7494: Thanks for the patch. [~sunilg] Some thoughts from my side

[jira] [Comment Edited] (YARN-7494) Add muti node lookup support for better placement

[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283419#comment-16283419 ] Tao Yang edited comment on YARN-7494 at 12/8/17 11:43 AM: -- Thanks

[jira] [Comment Edited] (YARN-7494) Add muti node lookup support for better placement

[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283419#comment-16283419 ] Tao Yang edited comment on YARN-7494 at 12/8/17 11:45 AM: -- Thanks

[jira] [Comment Edited] (YARN-7494) Add muti node lookup support for better placement

[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283419#comment-16283419 ] Tao Yang edited comment on YARN-7494 at 12/8/17 11:47 AM: -- Thanks

[jira] [Created] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

Tao Yang created YARN-7636: -- Summary: Re-reservation count may overflow when cluster resource exhausted for a long time Key: YARN-7636 URL: https://issues.apache.org/jira/browse/YARN-7636 Project: Hadoop YA

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Attachment: YARN-7636.001.patch > Re-reservation count may overflow when cluster resource exhausted for a long

[jira] [Commented] (YARN-7457) Delay scheduling should be an individual policy instead of part of scheduler implementation

[ https://issues.apache.org/jira/browse/YARN-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290223#comment-16290223 ] Tao Yang commented on YARN-7457: Hi, [~leftnoteasy], [~templedf] I'm glad to take a crack a

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: YARN-7005.002.patch Thanks [~leftnoteasy] for your suggestion. Attaching v2 patch with performance

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: (was: YARN-7005.002.patch) > Skip unnecessary sorting and iterating process for child queues wi

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: YARN-7005.002.patch > Skip unnecessary sorting and iterating process for child queues without > pe

[jira] [Commented] (YARN-7457) Delay scheduling should be an individual policy instead of part of scheduler implementation

[ https://issues.apache.org/jira/browse/YARN-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292621#comment-16292621 ] Tao Yang commented on YARN-7457: Thanks all for your comments. I didn't clarify the true p

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: YARN-7005.003.patch Attaching v3 patch. [~leftnoteasy], [~sunilg], please help to review in your f

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: YARN-7005.003.patch > Skip unnecessary sorting and iterating process for child queues without > pe

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: (was: YARN-7005.003.patch) > Skip unnecessary sorting and iterating process for child queues wi

[jira] [Created] (YARN-7751) Decommissioned NM leaves orphaned containers

Tao Yang created YARN-7751: -- Summary: Decommissioned NM leaves orphaned containers Key: YARN-7751 URL: https://issues.apache.org/jira/browse/YARN-7751 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-6678) Committer thread crashes with IllegalStateException in async-scheduling mode of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6678: --- Attachment: YARN-6678.branch-2.005.patch Attached branch-2 patch for cleanly applying. Thanks [~sunilg] and [~

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122755#comment-16122755 ] Tao Yang commented on YARN-6257: This problem was imported by YARN-3293 (2.8.0+). The opera

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16124563#comment-16124563 ] Tao Yang commented on YARN-6257: [~leftnoteasy], thanks for the reply. Yes, duplicated keys

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16124569#comment-16124569 ] Tao Yang commented on YARN-6629: Sorry for the late reply. Thanks [~sunilg] for reviewing t

[jira] [Updated] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6629: --- Attachment: YARN-6629.002.patch Uploaded a new patch with test case. > NPE occurred when container allocation

[jira] [Commented] (YARN-6044) Resource bar of Capacity Scheduler UI does not show correctly

[ https://issues.apache.org/jira/browse/YARN-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16124767#comment-16124767 ] Tao Yang commented on YARN-6044: Thanks [~djp] and [~sunilg] for your reply. The solution m

[jira] [Resolved] (YARN-6044) Resource bar of Capacity Scheduler UI does not show correctly

[ https://issues.apache.org/jira/browse/YARN-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang resolved YARN-6044. Resolution: Duplicate > Resource bar of Capacity Scheduler UI does not show correctly > -

[jira] [Created] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

Tao Yang created YARN-7003: -- Summary: DRAINING state of queues can't be recovered after RM restart Key: YARN-7003 URL: https://issues.apache.org/jira/browse/YARN-7003 Project: Hadoop YARN Issue Typ

[jira] [Updated] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7003: --- Affects Version/s: 2.9.0 > DRAINING state of queues can't be recovered after RM restart > -

[jira] [Updated] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7003: --- Affects Version/s: (was: 3.0.0-alpha3) 3.0.0-alpha4 > DRAINING state of queues can't

[jira] [Updated] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7003: --- Attachment: YARN-7003.001.patch > DRAINING state of queues can't be recovered after RM restart > --

[jira] [Created] (YARN-7004) Add configs cache to optimize refreshQueues performance for large scale queues

Tao Yang created YARN-7004: -- Summary: Add configs cache to optimize refreshQueues performance for large scale queues Key: YARN-7004 URL: https://issues.apache.org/jira/browse/YARN-7004 Project: Hadoop YARN

[jira] [Updated] (YARN-7004) Add configs cache to optimize refreshQueues performance for large scale queues

[ https://issues.apache.org/jira/browse/YARN-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7004: --- Attachment: YARN-7004.001.patch Uploaded v1 patch for review. > Add configs cache to optimize refreshQueues pe

<    1   2   3   4   5   6   7   8   9   10   >