[jira] [Updated] (YARN-9237) RM prints a lot of "Cannot get RMApp by appId" log when RM failover

2019-01-25 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9237: Attachment: YARN-9237.001.patch > RM prints a lot of "Cannot get RMApp by appId" log when RM failove

[jira] [Commented] (YARN-9237) RM prints a lot of "Cannot get RMApp by appId" log when RM failover

2019-01-25 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16752119#comment-16752119 ] Jiandan Yang commented on YARN-9237: - Thanks [~cheersyang] for your quick response.

[jira] [Updated] (YARN-9237) RM prints a lot of "Cannot get RMApp by appId" log when RM failover

2019-01-25 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9237: Attachment: YARN-9237.002.patch > RM prints a lot of "Cannot get RMApp by appId" log when RM failove

[jira] [Comment Edited] (YARN-9237) RM prints a lot of "Cannot get RMApp by appId" log when RM failover

2019-01-25 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16752119#comment-16752119 ] Jiandan Yang edited comment on YARN-9237 at 1/25/19 10:33 AM: -

[jira] [Created] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-9247: --- Summary: NM fails to start when downgrading from 3.x to 2.7 Key: YARN-9247 URL: https://issues.apache.org/jira/browse/YARN-9247 Project: Hadoop YARN Issue Type

[jira] [Updated] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9247: Description: NM will throws *java.io.IOException: Unexpected container state key* when downgrading

[jira] [Commented] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16754511#comment-16754511 ] Jiandan Yang commented on YARN-9247: - Although a low version compatible for a high ve

[jira] [Updated] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9247: Description: NM will throws *java.io.IOException: Unexpected container state key* when downgrading

[jira] [Updated] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9247: Affects Version/s: 2.7.2 > NM fails to start when downgrading from 3.x to 2.7 >

[jira] [Updated] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9247: Attachment: YARN-9247.branch-2.7.2.001.patch > NM fails to start when downgrading from 3.x to 2.7 >

[jira] [Commented] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16754613#comment-16754613 ] Jiandan Yang commented on YARN-9247: - test failed due to *'protoc --version' did not

[jira] [Created] (YARN-9329) Doing updatePriority is blocking when using FairScheduler

2019-02-22 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-9329: --- Summary: Doing updatePriority is blocking when using FairScheduler Key: YARN-9329 URL: https://issues.apache.org/jira/browse/YARN-9329 Project: Hadoop YARN Iss

[jira] [Updated] (YARN-9329) Doing updatePriority is blocking when using FairScheduler

2019-02-22 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9329: Attachment: YARN-9329.001.patch > Doing updatePriority is blocking when using FairScheduler > --

[jira] [Commented] (YARN-9329) Doing updatePriority is blocking when using FairScheduler

2019-02-24 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776557#comment-16776557 ] Jiandan Yang commented on YARN-9329: - Thanks [~cheersyang] and [~sunilg]. I do agree

[jira] [Updated] (YARN-9329) Doing updatePriority is blocking when using FairScheduler

2019-02-24 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9329: Attachment: YARN-9329.002.patch > Doing updatePriority is blocking when using FairScheduler > --

[jira] [Updated] (YARN-9329) Doing updatePriority is blocking when using FairScheduler

2019-02-24 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9329: Attachment: (was: YARN-9329.002.patch) > Doing updatePriority is blocking when using FairSchedul

[jira] [Updated] (YARN-9329) Doing updatePriority is blocking when using FairScheduler

2019-02-24 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9329: Attachment: YARN-9329.002.patch > Doing updatePriority is blocking when using FairScheduler > --

[jira] [Updated] (YARN-9329) updatePriority is blocked when using FairScheduler

2019-02-24 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9329: Summary: updatePriority is blocked when using FairScheduler (was: Doing updatePriority is blocking

[jira] [Commented] (YARN-8464) Async scheduling thread could be interrupted when there are no NodeManagers in cluster

2019-03-19 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796781#comment-16796781 ] Jiandan Yang commented on YARN-8464: - Hi, [~leftnoteasy], Could you give more detail

[jira] [Created] (YARN-9406) DeleteTask may leak when upgrading from 2.7 to 3.x

2019-03-25 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-9406: --- Summary: DeleteTask may leak when upgrading from 2.7 to 3.x Key: YARN-9406 URL: https://issues.apache.org/jira/browse/YARN-9406 Project: Hadoop YARN Issue Type

[jira] [Commented] (YARN-9406) DeleteTask may leak when upgrading from 2.7 to 3.x

2019-03-25 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16800455#comment-16800455 ] Jiandan Yang commented on YARN-9406: - For compatibility, Creating FileDeletionTask wh

[jira] [Updated] (YARN-9406) DeleteTask may leak when upgrading from 2.7 to 3.x

2019-03-25 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9406: Attachment: YARN-9406.001.patch > DeleteTask may leak when upgrading from 2.7 to 3.x > -

[jira] [Commented] (YARN-9406) DeleteTask may leak when upgrading from 2.7 to 3.x

2019-03-25 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16800463#comment-16800463 ] Jiandan Yang commented on YARN-9406: - My mistake, NMProtoUtils has used FileDeletionT

[jira] [Resolved] (YARN-9406) DeleteTask may leak when upgrading from 2.7 to 3.x

2019-03-25 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang resolved YARN-9406. - Resolution: Invalid > DeleteTask may leak when upgrading from 2.7 to 3.x > ---

[jira] [Commented] (YARN-7715) Support NM promotion/demotion of running containers.

2018-05-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16475703#comment-16475703 ] Jiandan Yang commented on YARN-7715: - [~miklos.szeg...@cloudera.com] How to inform AM

[jira] [Commented] (YARN-7715) Support NM promotion/demotion of running containers.

2018-05-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16476776#comment-16476776 ] Jiandan Yang commented on YARN-7715: - Hi, [~miklos.szeg...@cloudera.com] Thanks for y

[jira] [Commented] (YARN-7715) Support NM promotion/demotion of running containers.

2018-05-16 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16476961#comment-16476961 ] Jiandan Yang commented on YARN-7715: - Thanks [~miklos.szeg...@cloudera.com] Updating e

[jira] [Created] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-8320: --- Summary: Add support CPU isolation for latency-sensitive (LS) tasks Key: YARN-8320 URL: https://issues.apache.org/jira/browse/YARN-8320 Project: Hadoop YARN

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Description: Currently NodeManager uses “cpu.cfs_period_us”, “cpu.cfs_quota_us” and “cpu.shares” to

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for laten

[jira] [Commented] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16480529#comment-16480529 ] Jiandan Yang commented on YARN-8320: - upload design doc v1. Please feel free to let me

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: (was: CPU-isolation-for-latency-sensitive-services-v1.pdf) > Add support CPU isolatio

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for laten

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: (was: CPU-isolation-for-latency-sensitive-services-v1.pdf) > Add support CPU isolatio

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for laten

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Summary: Add support CPU isolation for latency-sensitive (LS) service (was: Add support CPU isolati

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-20 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for laten

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-20 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: (was: CPU-isolation-for-latency-sensitive-services-v1.pdf) > Add support CPU isolatio

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-21 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: YARN-8320.001.patch > Add support CPU isolation for latency-sensitive (LS) service > ---

[jira] [Commented] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-21 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482336#comment-16482336 ] Jiandan Yang commented on YARN-8320: - upload v1 patch to initiate disscussion > Add s

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-21 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: (was: YARN-8320.001.patch) > Add support CPU isolation for latency-sensitive (LS) se

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-21 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: YARN-8320.001.patch > Add support CPU isolation for latency-sensitive (LS) service > ---

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-21 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: (was: CPU-isolation-for-latency-sensitive-services-v1.pdf) > Add support CPU isolatio

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-21 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for laten

[jira] [Commented] (YARN-8320) Support CPU isolation for latency-sensitive (LS) service

2018-05-23 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487066#comment-16487066 ] Jiandan Yang commented on YARN-8320: - [~cheersyang] and I discuss design offline toget

[jira] [Updated] (YARN-8320) Support CPU isolation for latency-sensitive (LS) service

2018-05-23 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v2.pdf > Support CPU isolation for latency-s

[jira] [Created] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-14 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7497: --- Summary: Add HDFSSchedulerConfigurationStore for RM HA Key: YARN-7497 URL: https://issues.apache.org/jira/browse/YARN-7497 Project: Hadoop YARN Issue Type: New

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.001.patch > Add HDFSSchedulerConfigurationStore for RM HA > ---

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Description: YARN-5947 add LeveldbConfigurationStore using Leveldb as backing store, but it does not

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.002.patch upload v2 patch > Add HDFSSchedulerConfigurationStore for RM HA > --

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.003.patch fix UT and whitespace error > Add HDFSSchedulerConfigurationStore f

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-16 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.004.patch fix findbug error > Add HDFSSchedulerConfigurationStore for RM HA >

[jira] [Commented] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16270497#comment-16270497 ] Jiandan Yang commented on YARN-7497: - [~jhung] Please help me to review and give me so

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.005.patch > Add HDFSSchedulerConfigurationStore for RM HA > ---

[jira] [Commented] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16270525#comment-16270525 ] Jiandan Yang commented on YARN-7497: - [~gphillips] I have moved those two static const

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.006.patch fix TestYarnConfigurationFields fail > Add HDFSSchedulerConfiguratio

[jira] [Commented] (YARN-5636) Support reserving resources on certain nodes for certain applications

2017-12-11 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16287229#comment-16287229 ] Jiandan Yang commented on YARN-5636: - [~Tao Jie] I think you solution is good. You can

[jira] [Created] (YARN-7693) ContainersMonitor support configurable

2018-01-01 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7693: --- Summary: ContainersMonitor support configurable Key: YARN-7693 URL: https://issues.apache.org/jira/browse/YARN-7693 Project: Hadoop YARN Issue Type: New Featur

[jira] [Updated] (YARN-7693) ContainersMonitor support configurable

2018-01-01 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7693: Description: Currently ContainersMonitor has only one default implementation ContainersMonitorImpl,

[jira] [Updated] (YARN-7693) ContainersMonitor support configurable

2018-01-01 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7693: Attachment: YARN-7693.001.patch > ContainersMonitor support configurable > --

[jira] [Updated] (YARN-7693) ContainersMonitor support configurable

2018-01-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7693: Attachment: YARN-7693.002.patch fix TestYarnConfigurationFields error > ContainersMonitor support co

[jira] [Commented] (YARN-7693) ContainersMonitor support configurable

2018-01-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16309129#comment-16309129 ] Jiandan Yang commented on YARN-7693: - [~miklos.szeg...@cloudera.com] Thanks for your a

[jira] [Comment Edited] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

2018-01-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16312473#comment-16312473 ] Jiandan Yang edited comment on YARN-6673 at 1/5/18 4:49 AM: - [

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

2018-01-04 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16312473#comment-16312473 ] Jiandan Yang commented on YARN-6673: - [~miklos.szeg...@cloudera.com] How about setting

[jira] [Commented] (YARN-7693) ContainersMonitor support configurable

2018-01-05 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16313097#comment-16313097 ] Jiandan Yang commented on YARN-7693: - [~miklos.szeg...@cloudera.com] Opportunistic Co

[jira] [Commented] (YARN-5951) Changes to allow CapacityScheduler to use configuration store

2017-08-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16110501#comment-16110501 ] Jiandan Yang commented on YARN-5951: - [~jhung] [~leftnoteasy] I found this patch has t

[jira] [Commented] (YARN-5951) Changes to allow CapacityScheduler to use configuration store

2017-08-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1611#comment-1611 ] Jiandan Yang commented on YARN-5951: - [~jhung] Sorry, my mistake, it's [YARN-5947|htt

[jira] [Created] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7168: --- Summary: The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted Key: YARN-7168 URL: https://issues.apache.org/jira/browse/YARN-7168

[jira] [Updated] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7168: Attachment: mat.jpg > The size of dataQueue and ackQueue in DataStreamer has no limit when writer >

[jira] [Updated] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7168: Description: In our cluster, when found NodeManager frequently FullGC when decommissioning NodeManag

[jira] [Updated] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7168: Description: In our cluster, when found NodeManager frequently FullGC when decommissioning NodeManag

[jira] [Updated] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7168: Description: In our cluster, when found NodeManager frequently FullGC when decommissioning NodeManag

[jira] [Updated] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7168: Description: In our cluster, when found NodeManager frequently FullGC when decommissioning NodeManag

[jira] [Commented] (YARN-7168) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156350#comment-16156350 ] Jiandan Yang commented on YARN-7168: - Sorry, I should create this issue in Hadoop HDFS

[jira] [Created] (YARN-8645) Yarn NM fail to start when remount cpu control group

2018-08-09 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-8645: --- Summary: Yarn NM fail to start when remount cpu control group Key: YARN-8645 URL: https://issues.apache.org/jira/browse/YARN-8645 Project: Hadoop YARN Issue Ty

[jira] [Created] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-8664: --- Summary: ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting Key: YARN-8664 URL: https://issues.apache.org/jira/browse/YARN-8664 Project: Hadoop Y

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: YARN-8664-branch-2.8.2.001.patch > ApplicationMasterProtocolPBServiceImpl#allocate throw

[jira] [Commented] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16579884#comment-16579884 ] Jiandan Yang commented on YARN-8664: - replace rmNode.getTotalCapability() with Reso

[jira] [Commented] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580626#comment-16580626 ] Jiandan Yang commented on YARN-8664: - Jenkins report ERROR: Docker failed to build im

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: YARN-8664-branch-2.8.2.002.patch > ApplicationMasterProtocolPBServiceImpl#allocate throw

[jira] [Commented] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580688#comment-16580688 ] Jiandan Yang commented on YARN-8664: - Thank [~cheersyang] for quick response. There i

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: YARN-8664-branch-2.8.001.pathch > ApplicationMasterProtocolPBServiceImpl#allocate throw

[jira] [Commented] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580881#comment-16580881 ] Jiandan Yang commented on YARN-8664: - [~cheersyang] Jenkins is probably not OK. Would

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-15 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Description: ResourceManager logs about exception is: {code:java} 2018-08-09 00:52:30,746 WARN [IPC

[jira] [Created] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-26 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-8717: --- Summary: set memory.limit_in_bytes when NodeManager starting Key: YARN-8717 URL: https://issues.apache.org/jira/browse/YARN-8717 Project: Hadoop YARN Issue Typ

[jira] [Updated] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8717: Description: CGroupsCpuResourceHandlerImpl sets cpu quota at hirarchy of hadoop-yarn to restrict to

[jira] [Updated] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8717: Environment: (was: CGroupsCpuResourceHandlerImpl sets cpu quota at hirarchy of hadoop-yarn to r

[jira] [Updated] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-27 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8717: Description: CGroupsCpuResourceHandlerImpl sets cpu quota at hirarchy of hadoop-yarn to restrict to

[jira] [Updated] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8717: Attachment: YARN-8717.001.patch > set memory.limit_in_bytes when NodeManager starting >

[jira] [Commented] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16594858#comment-16594858 ] Jiandan Yang commented on YARN-8717: - Hi [~cheersyang] Thanks for watching. We found

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: YARN-8664-branch-2.8.002.pathch > ApplicationMasterProtocolPBServiceImpl#allocate throw

[jira] [Comment Edited] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-09-06 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16594858#comment-16594858 ] Jiandan Yang edited comment on YARN-8717 at 9/7/18 3:05 AM: -

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-09-11 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: (was: YARN-8664-branch-2.8.2.002.patch) > ApplicationMasterProtocolPBServiceImpl#all

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-09-11 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: (was: YARN-8664-branch-2.8.2.001.patch) > ApplicationMasterProtocolPBServiceImpl#all

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-09-11 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: (was: YARN-8664-branch-2.8.002.pathch) > ApplicationMasterProtocolPBServiceImpl#allo

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-09-11 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: (was: YARN-8664-branch-2.8.001.pathch) > ApplicationMasterProtocolPBServiceImpl#allo

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-09-11 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8664: Attachment: YARN-8664-branch-2.8.004.patch > ApplicationMasterProtocolPBServiceImpl#allocate throw N

[jira] [Updated] (YARN-7693) ContainersMonitor support configurable

2018-01-24 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7693: Priority: Blocker (was: Minor) > ContainersMonitor support configurable > --

[jira] [Updated] (YARN-7693) ContainersMonitor support configurable

2018-01-24 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7693: Priority: Minor (was: Blocker) > ContainersMonitor support configurable > --

[jira] [Created] (YARN-7880) FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls

2018-02-02 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7880: --- Summary: FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls Key: YARN-7880 URL: https://issues.apache.org/jira/browse/YARN-7880 Project: Hadoop

<    1   2   3   >