[jira] [Commented] (YARN-9721) An easy method to exclude a nodemanager from the yarn cluster cleanly

2019-08-07 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902027#comment-16902027 ] Zac Zhou commented on YARN-9721: Thanks, [~tangzhankun], I prefer method 1 and 2.  Metho

[jira] [Commented] (YARN-9721) An easy method to exclude a nodemanager from the yarn cluster cleanly

2019-08-06 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900727#comment-16900727 ] Zac Zhou commented on YARN-9721:   [~sunilg] Thanks a lot for your comments~ Maybe I co

[jira] [Updated] (YARN-9721) An easy method to exclude a nodemanager from the yarn cluster cleanly

2019-08-05 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9721: --- Description: If we want to take offline a nodemanager server, nodes.exclude-path and "rmadmin -refreshNodes"

[jira] [Updated] (YARN-9721) An easy method to exclude a nodemanager from the yarn cluster cleanly

2019-08-05 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9721: --- Description: If we want to take offline a nodemanager server, nodes.exclude-path and "rmadmin -refreshNodes"

[jira] [Created] (YARN-9721) An easy method to exclude a nodemanager from the yarn cluster cleanly

2019-08-05 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9721: -- Summary: An easy method to exclude a nodemanager from the yarn cluster cleanly Key: YARN-9721 URL: https://issues.apache.org/jira/browse/YARN-9721 Project: Hadoop YARN

[jira] [Commented] (YARN-9447) RM Crashes with NPE at TimelineServiceV2Publisher.putEntity

2019-04-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16817505#comment-16817505 ] Zac Zhou commented on YARN-9447: [~Prabhu Joseph], Thanks for fixing it. I think this iss

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-04 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16759785#comment-16759785 ] Zac Zhou commented on YARN-9161: The new failed case seems not related to this patch. I ru

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-03 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16759404#comment-16759404 ] Zac Zhou commented on YARN-9161: Since [YARN-9262|https://issues.apache.org/jira/browse/YA

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-03 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.012.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-02 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.011.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Comment Edited] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-02 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758973#comment-16758973 ] Zac Zhou edited comment on YARN-9161 at 2/2/19 11:59 AM: - For the

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-02 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758973#comment-16758973 ] Zac Zhou commented on YARN-9161: For the failed test cases of TestRMAppAttemptTransitions,

[jira] [Comment Edited] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-02 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758973#comment-16758973 ] Zac Zhou edited comment on YARN-9161 at 2/2/19 11:56 AM: - For the

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-01 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758113#comment-16758113 ] Zac Zhou commented on YARN-9161: Thanks, [~sunilg] Yeah. For the latest patch, I just cha

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-31 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.010.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-31 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16757911#comment-16757911 ] Zac Zhou commented on YARN-9161: Thank you [~sunilg] for triggering Jenkins. Distributeds

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-28 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16754599#comment-16754599 ] Zac Zhou commented on YARN-9161: YARN-9161.009.patch is to fix some checkstyle and findbug

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-28 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.009.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9231) TestDistributedShell fix timeout

2019-01-27 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16753696#comment-16753696 ] Zac Zhou commented on YARN-9231: [~Prabhu Joseph] , I run into the same problem. Thanks a

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-27 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.008.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-25 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.007.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751938#comment-16751938 ] Zac Zhou commented on YARN-9161: There are some code conflicts with  [YARN-9116|https://is

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751934#comment-16751934 ] Zac Zhou commented on YARN-9161: [~sunilg], Thanks a lot for your comments~ {quote}I have

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-22 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16749522#comment-16749522 ] Zac Zhou commented on YARN-9161: [~sunilg] , Thanks a lot for your comments. Checked with

[jira] [Commented] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-22 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16749497#comment-16749497 ] Zac Zhou commented on YARN-6695: I checked the logic for TimelineServiceV2Publisher. If  y

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-22 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16749498#comment-16749498 ] Zac Zhou commented on YARN-9161: [~sunilg], [~leftnoteasy], [~tangzhankun]  welcome to ad

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-21 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16748468#comment-16748468 ] Zac Zhou commented on YARN-9161: I tested the TestCapacitySchedulerSurgicalPreemption loca

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-17 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745779#comment-16745779 ] Zac Zhou commented on YARN-9161: Update patch to fix failed UT cases > Absolute resources

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-17 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.006.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-17 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745759#comment-16745759 ] Zac Zhou commented on YARN-9205: [~tangzhankun] {quote}private static Map getResourceInfo

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744183#comment-16744183 ] Zac Zhou commented on YARN-9161: Add UT for container allocation and fix some code style i

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.005.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.004.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2019-01-10 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16739331#comment-16739331 ] Zac Zhou commented on YARN-8489: [~leftnoteasy], [~suma.shivaprasad] When you get spare t

[jira] [Comment Edited] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-09 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16738921#comment-16738921 ] Zac Zhou edited comment on YARN-9161 at 1/10/19 2:36 AM: - The test

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-09 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16738921#comment-16738921 ] Zac Zhou commented on YARN-9161: The test case is broken by  [YARN-9183|https://issues.apa

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-09 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16738327#comment-16738327 ] Zac Zhou commented on YARN-9161: [~sunilg], Thanks for your comments~ The failed unit te

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.003.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16737830#comment-16737830 ] Zac Zhou commented on YARN-9185: [~eyang] Thanks a lot for fixing it~ > TimelineServiceV

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16737791#comment-16737791 ] Zac Zhou commented on YARN-8489: [~suma.shivaprasad] Thanks a lot for your comments~ > N

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8489: --- Attachment: YARN-8489.005.patch > Need to support "dominant" component concept inside YARN service > -

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8489: --- Attachment: YARN-8489.004.patch > Need to support "dominant" component concept inside YARN service > -

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16737084#comment-16737084 ] Zac Zhou commented on YARN-8489: [~leftnoteasy], [~suma.shivaprasad] Thanks a lot for you

[jira] [Commented] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16737091#comment-16737091 ] Zac Zhou commented on YARN-9185: When the following configuration is specified: yarn.t

[jira] [Updated] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9185: --- Issue Type: Sub-task (was: Bug) Parent: YARN-8489 > TimelineServiceV2Publisher throws NPE when app is

[jira] [Created] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

2019-01-08 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9185: -- Summary: TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated Key: YARN-9185 URL: https://issues.apache.org/jira/browse/YARN-9185 Project:

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-07 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.002.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9155) Can't re-run a submarine job, if the previous job with the same service name has finished

2019-01-07 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735602#comment-16735602 ] Zac Zhou commented on YARN-9155: [~leftnoteasy], Thanks a lot for your comments. it makes

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-02 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732613#comment-16732613 ] Zac Zhou commented on YARN-9161: Thanks a lot, [~leftnoteasy], [~sunilg] {code:java} // W/

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-02 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732006#comment-16732006 ] Zac Zhou commented on YARN-9161: I checked the failed test case TestRunJobCliParsing and f

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2018-12-31 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: (was: YARN-9161.001.patch) > Absolute resources of capacity scheduler doesn't support GPU and

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2018-12-31 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.001.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Created] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2018-12-28 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9161: -- Summary: Absolute resources of capacity scheduler doesn't support GPU and FPGA Key: YARN-9161 URL: https://issues.apache.org/jira/browse/YARN-9161 Project: Hadoop YARN

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2018-12-28 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16730541#comment-16730541 ] Zac Zhou commented on YARN-9161: a patch would be attached shortly. > Absolute resources

[jira] [Commented] (YARN-9003) Support multi-homed network for docker container

2018-12-26 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16728938#comment-16728938 ] Zac Zhou commented on YARN-9003: I'm not sure whether --net can specify multiple networks.

[jira] [Commented] (YARN-9155) Can't re-run a submarine job, if the previous job with the same service name has finished

2018-12-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16728293#comment-16728293 ] Zac Zhou commented on YARN-9155: Or should we add an after service listeners interface to

[jira] [Updated] (YARN-9155) Can't re-run a submarine job, if a previous job with the same service name has finished

2018-12-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9155: --- Summary: Can't re-run a submarine job, if a previous job with the same service name has finished (was: Can't

[jira] [Updated] (YARN-9155) Can't re-run a submarine job, if the previous job with the same service name has finished

2018-12-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9155: --- Summary: Can't re-run a submarine job, if the previous job with the same service name has finished (was: Can'

[jira] [Commented] (YARN-9155) Can't submit a submarine job, if a previous job with the same service name has finished

2018-12-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16728276#comment-16728276 ] Zac Zhou commented on YARN-9155: Could we add a parameter in Service API to indicate that

[jira] [Created] (YARN-9155) Can't submit a submarine job, if a previous job with the same service name has finished

2018-12-24 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9155: -- Summary: Can't submit a submarine job, if a previous job with the same service name has finished Key: YARN-9155 URL: https://issues.apache.org/jira/browse/YARN-9155 Project: Hado

[jira] [Commented] (YARN-9144) WebAppProxyServlet can't redirect to ATS V1.5 when a yarn native service app is finished

2018-12-18 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16724723#comment-16724723 ] Zac Zhou commented on YARN-9144: Fix code stype > WebAppProxyServlet can't redirect to AT

[jira] [Updated] (YARN-9144) WebAppProxyServlet can't redirect to ATS V1.5 when a yarn native service app is finished

2018-12-18 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9144: --- Attachment: YARN-9144.002.patch > WebAppProxyServlet can't redirect to ATS V1.5 when a yarn native service app

[jira] [Created] (YARN-9144) WebAppProxyServlet can't redirect to ATS V1.5 when a yarn native service app is finished

2018-12-18 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9144: -- Summary: WebAppProxyServlet can't redirect to ATS V1.5 when a yarn native service app is finished Key: YARN-9144 URL: https://issues.apache.org/jira/browse/YARN-9144 Project: Had

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-12-17 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16722923#comment-16722923 ] Zac Zhou commented on YARN-8489: [~suma.shivaprasad] , Thanks a lot. The failed test case

[jira] [Updated] (YARN-9141) [submarine] JobStatus outputs with system UTC clock, not local clock

2018-12-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9141: --- Description: The current time is Mon Dec 17 12:26:31 CST 2018. But submarine job status output is like this:

[jira] [Created] (YARN-9141) [submarine] JobStatus outputs with system UTC clock, not local clock

2018-12-16 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9141: -- Summary: [submarine] JobStatus outputs with system UTC clock, not local clock Key: YARN-9141 URL: https://issues.apache.org/jira/browse/YARN-9141 Project: Hadoop YARN I

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-12-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8489: --- Attachment: YARN-8489.003.patch > Need to support "dominant" component concept inside YARN service > -

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-12-15 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8489: --- Attachment: YARN-8489.002.patch > Need to support "dominant" component concept inside YARN service > -

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-12-11 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16716694#comment-16716694 ] Zac Zhou commented on YARN-8489: @[~suma.shivaprasad] any Updates? Or would you mind if I

[jira] [Comment Edited] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-12-11 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16716694#comment-16716694 ] Zac Zhou edited comment on YARN-8489 at 12/11/18 9:47 AM: -- [~suma

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-12-04 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16708652#comment-16708652 ] Zac Zhou commented on YARN-8960: I think it should be ok, [~leftnoteasy] any comments? >

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-12-04 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16708649#comment-16708649 ] Zac Zhou commented on YARN-9001: Yup, I think it can be applied to 3.2.0. Since this patch

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: YARN-8960.007.patch > [Submarine] Can't get submarine service status using the command of "yarn ap

[jira] [Comment Edited] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687457#comment-16687457 ] Zac Zhou edited comment on YARN-8960 at 11/15/18 4:18 AM: -- Add a

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687457#comment-16687457 ] Zac Zhou commented on YARN-8960: Add a parameter, named distribute_keytab, which can be us

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: YARN-8960.006.patch > [Submarine] Can't get submarine service status using the command of "yarn ap

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: YARN-8960.006.patch > [Submarine] Can't get submarine service status using the command of "yarn ap

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: (was: YARN-8960.006.patch) > [Submarine] Can't get submarine service status using the command

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686692#comment-16686692 ] Zac Zhou commented on YARN-8960:   Thanks,[~leftnoteasy] For comment 1 {quote}1) doLogin

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: YARN-8960.005.patch > [Submarine] Can't get submarine service status using the command of "yarn ap

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686076#comment-16686076 ] Zac Zhou commented on YARN-9001: Thanks, [~leftnoteasy] I checked the code and found ther

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9001: --- Attachment: YARN-9001-branch-3.2.001.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-13 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: YARN-8960.004.patch > [Submarine] Can't get submarine service status using the command of "yarn ap

[jira] [Comment Edited] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684788#comment-16684788 ] Zac Zhou edited comment on YARN-8960 at 11/13/18 6:53 AM: -- As dis

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684788#comment-16684788 ] Zac Zhou commented on YARN-8960: As discussion offline, we can use the same kerberos keyta

[jira] [Comment Edited] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684788#comment-16684788 ] Zac Zhou edited comment on YARN-8960 at 11/13/18 6:50 AM: -- As dis

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684664#comment-16684664 ] Zac Zhou edited comment on YARN-8714 at 11/13/18 3:14 AM: -- Looks

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684664#comment-16684664 ] Zac Zhou edited comment on YARN-8714 at 11/13/18 3:14 AM: -- Looks

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684664#comment-16684664 ] Zac Zhou edited comment on YARN-8714 at 11/13/18 3:13 AM: -- Looks

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684664#comment-16684664 ] Zac Zhou commented on YARN-8714: Looks great, it would be convenient for notebook app, lik

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684639#comment-16684639 ] Zac Zhou commented on YARN-9001: Sure, Wangda The following test cases have been executed

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683661#comment-16683661 ] Zac Zhou commented on YARN-9001: The ut error seems is not related to the patch, resubmit

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9001: --- Attachment: YARN-9001.004.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs > ---

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-11 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9001: --- Attachment: YARN-9001.003.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs > ---

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-10 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682419#comment-16682419 ] Zac Zhou commented on YARN-8960: Maybe, we need both of them, To enable "yarn app -status

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-10 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9001: --- Attachment: YARN-9001.002.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs > ---

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-09 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16681388#comment-16681388 ] Zac Zhou commented on YARN-9001: I'll submit a patch shortly > [Submarine] Use AppAdminCl

[jira] [Created] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-09 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9001: -- Summary: [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs Key: YARN-9001 URL: https://issues.apache.org/jira/browse/YARN-9001 Project: Hadoop YARN

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-01 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Summary: [Submarine] Can't get submarine service status using the command of "yarn app -status" under security

[jira] [Updated] (YARN-8960) {Submarine} Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-01 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Summary: {Submarine} Can't get submarine service status using the command of "yarn app -status" under security

  1   2   >