[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469577#comment-16469577 ] Haibo Chen commented on YARN-8250: -- Not sure how to address the last checkstyle issue, bec

[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469398#comment-16469398 ] Haibo Chen commented on YARN-8250: -- This is based on UpdateContainerTokenEvent. There are

[jira] [Updated] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8250: - Attachment: YARN-8250-YARN-1011.02.patch > Create another implementation of ContainerScheduler to support N

[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469356#comment-16469356 ] Haibo Chen commented on YARN-8250: -- The unit test failures are unrelated. The ones in Tes

[jira] [Updated] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8250: - Attachment: YARN-8250-YARN-1011.01.patch > Create another implementation of ContainerScheduler to support N

[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469001#comment-16469001 ] Haibo Chen commented on YARN-8250: -- Thanks for the review, [~miklos.szeg...@cloudera.com]!

[jira] [Commented] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468132#comment-16468132 ] Haibo Chen commented on YARN-8090: -- +1 on the patch pending  Jenkins. The precommit job (

[jira] [Commented] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468048#comment-16468048 ] Haibo Chen commented on YARN-8090: -- Thanks for the patch, [~miklos.szeg...@cloudera.com].

[jira] [Updated] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8090: - Priority: Minor (was: Major) > Race conditions in FadvisedChunkedFile > --

[jira] [Updated] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8090: - Description: When a file is closed mutple times by multiple threads, all but the first close will generate

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468012#comment-16468012 ] Haibo Chen commented on YARN-7715: -- Makes sense. Can you add containerId to all the warnin

[jira] [Updated] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8250: - Attachment: YARN-8250-YARN-1011.00.patch > Create another implementation of ContainerScheduler to support N

[jira] [Commented] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467949#comment-16467949 ] Haibo Chen commented on YARN-6675: -- Per offline discussion with [~miklos.szeg...@cloudera.

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16465285#comment-16465285 ] Haibo Chen commented on YARN-7715: -- I think the new patch would still call updateContainer

[jira] [Updated] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8250: - Issue Type: Sub-task (was: Improvement) Parent: YARN-1011 > Create another implementation of Conta

[jira] [Created] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-04 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8250: Summary: Create another implementation of ContainerScheduler to support NM overallocation Key: YARN-8250 URL: https://issues.apache.org/jira/browse/YARN-8250 Project: Hadoop

[jira] [Updated] (YARN-8244) TestContainerSchedulerQueuing.testStartMultipleContainers failed

2018-05-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8244: - Description: {code:java} testStartMultipleContainers(org.apache.hadoop.yarn.server.nodemanager.containerman

[jira] [Updated] (YARN-8244) TestContainerSchedulerQueuing.testStartMultipleContainers failed

2018-05-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8244: - Summary: TestContainerSchedulerQueuing.testStartMultipleContainers failed (was: ContainersLauncher.Contai

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16464221#comment-16464221 ] Haibo Chen commented on YARN-7715: -- Thanks [~miklos.szeg...@cloudera.com] for the patch! I

[jira] [Commented] (YARN-7933) [atsv2 read acls] Add TimelineWriter#writeDomain

2018-05-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16462638#comment-16462638 ] Haibo Chen commented on YARN-7933: -- Thanks [~rohithsharma] for updating the patch!  Looks

[jira] [Created] (YARN-8240) Add queue-level control to allow all applications in a queue to opt-out

2018-05-01 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8240: Summary: Add queue-level control to allow all applications in a queue to opt-out Key: YARN-8240 URL: https://issues.apache.org/jira/browse/YARN-8240 Project: Hadoop YARN

[jira] [Updated] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2018-04-27 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7190: - Affects Version/s: 3.0.3 3.0.1 > Ensure only NM classpath in 2.x gets TSv2 related h

[jira] [Updated] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2018-04-27 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7190: - Affects Version/s: 2.9.0 3.0.2 3.0.x > Ensure only NM classpa

[jira] [Updated] (YARN-8219) Add application launch time to ATSV2

2018-04-26 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8219: - Description: YARN-7088 publishes application launch time to RMStore and also adds it to the YARN UI. It wo

[jira] [Updated] (YARN-8218) Add application launch time to ATSV1

2018-04-26 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8218: - Component/s: (was: timelineserver) > Add application launch time to ATSV1 > ---

[jira] [Commented] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16446512#comment-16446512 ] Haibo Chen commented on YARN-6675: -- The TestContainersMonitorResourceChange.testContainer

[jira] [Updated] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6675: - Attachment: YARN-6675-YARN-1011.01.patch > Add NM support to launch opportunistic containers based on overa

[jira] [Commented] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16446366#comment-16446366 ] Haibo Chen commented on YARN-6675: -- Thanks [~miklos.szeg...@cloudera.com] for the review.

[jira] [Updated] (YARN-7334) Add documentation of oversubscription

2018-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7334: - Description: Need to add user documentation of YARN oversubscription, plus API/proto changes before releas

[jira] [Commented] (YARN-8184) Too many metrics if containerLocalizer/ResourceLocalizationService uses ReadWriteDiskValidator

2018-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16446077#comment-16446077 ] Haibo Chen commented on YARN-8184: -- The failed unit tests are unrelated, and I could not r

[jira] [Commented] (YARN-8184) Too many metrics if containerLocalizer/ResourceLocalizationService uses ReadWriteDiskValidator

2018-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16445852#comment-16445852 ] Haibo Chen commented on YARN-8184: -- Agree that expensive disk checking should only be perf

[jira] [Commented] (YARN-8185) Improve log in class DirectoryCollection

2018-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16445819#comment-16445819 ] Haibo Chen commented on YARN-8185: -- TestContainerManager#testContainerUpgradeRollbackDueTo

[jira] [Updated] (YARN-8185) Improve log in DirectoryCollection constructor

2018-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8185: - Summary: Improve log in DirectoryCollection constructor (was: Improve log in class DirectoryCollection) >

[jira] [Updated] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-04-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6675: - Attachment: YARN-6675-YARN-1011.00.patch > Add NM support to launch opportunistic containers based on overa

[jira] [Resolved] (YARN-7088) Add application launch time to Resource Manager REST API

2018-04-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7088. -- Resolution: Fixed > Add application launch time to Resource Manager REST API > --

[jira] [Updated] (YARN-7088) Add application launch time to Resource Manager REST API

2018-04-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7088: - Description: Currently, the start time in the old and new UI actually shows the app submission time. There

[jira] [Commented] (YARN-7088) Add application launch time to Resource Manager REST API

2018-04-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16441292#comment-16441292 ] Haibo Chen commented on YARN-7088: -- Oops, I did not refresh often enough.   I'll commit th

[jira] [Commented] (YARN-7088) Add application launch time to Resource Manager REST API

2018-04-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16441288#comment-16441288 ] Haibo Chen commented on YARN-7088: -- That's a good point, [~sunilg]. The launchTime per att

[jira] [Commented] (YARN-7088) Add application launch time to Resource Manager REST API

2018-04-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16440831#comment-16440831 ] Haibo Chen commented on YARN-7088: -- Sure. > Add application launch time to Resource Manag

[jira] [Reopened] (YARN-7088) Add application launch time to Resource Manager REST API

2018-04-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reopened YARN-7088: -- > Add application launch time to Resource Manager REST API >

[jira] [Updated] (YARN-7088) Add application launch time to Resource Manager REST API

2018-04-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7088: - Summary: Add application launch time to Resource Manager REST API (was: Fix application start time and add

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2018-04-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16440278#comment-16440278 ] Haibo Chen commented on YARN-7088: -- Will check it in tomorrow if there is no objection. >

[jira] [Commented] (YARN-8162) Remove Method DirectoryCollection#verifyDirUsingMkdir

2018-04-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16440086#comment-16440086 ] Haibo Chen commented on YARN-8162: -- Checking this in. > Remove Method DirectoryCollection

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2018-04-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439979#comment-16439979 ] Haibo Chen commented on YARN-7088: -- +1 pending Jenkins. > Fix application start time and

[jira] [Commented] (YARN-8162) Remove Method DirectoryCollection#verifyDirUsingMkdir

2018-04-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439862#comment-16439862 ] Haibo Chen commented on YARN-8162: -- +1 pending jenkins. > Remove Method DirectoryCollecti

[jira] [Updated] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2018-04-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-1014: - Issue Type: Improvement (was: Sub-task) Parent: (was: YARN-1011) > Configure OOM Killer to kil

[jira] [Commented] (YARN-8162) Remove Method DirectoryCollection#verifyDirUsingMkdir

2018-04-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439780#comment-16439780 ] Haibo Chen commented on YARN-8162: -- Thanks [~yufeigu] for the patch! I agree with you on t

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2018-04-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439762#comment-16439762 ] Haibo Chen commented on YARN-7088: -- Thanks for the update! Can you please clean up schedul

[jira] [Assigned] (YARN-8089) Recover domain from backend for TimelineCollector.

2018-04-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-8089: Assignee: Haibo Chen > Recover domain from backend for TimelineCollector. >

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2018-04-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16438059#comment-16438059 ] Haibo Chen commented on YARN-7088: -- {quote}I update the launchTime only if it is non zero

[jira] [Assigned] (YARN-8042) Improve debugging on ATSv2 reader server

2018-04-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-8042: Assignee: Haibo Chen > Improve debugging on ATSv2 reader server > --

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1

2018-04-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5094: - Component/s: (was: timelineserver) > some YARN container events have timestamp of -1 >

[jira] [Commented] (YARN-7931) [atsv2 read acls] Include domain table creation as part of schema creator

2018-04-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1643#comment-1643 ] Haibo Chen commented on YARN-7931: -- +1. Will check this in shortly > [atsv2 read acls] In

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2018-04-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16434598#comment-16434598 ] Haibo Chen commented on YARN-7088: -- Thanks [~kanwaljeets] for the patch! I have a few ques

[jira] [Commented] (YARN-8131) Provice CLI option to DS for publishing entities into sub application

2018-04-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431028#comment-16431028 ] Haibo Chen commented on YARN-8131: -- I'd argue that we'd like to mark subApplication Entity

[jira] [Commented] (YARN-8131) Provice CLI option to DS for publishing entities into sub application

2018-04-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430813#comment-16430813 ] Haibo Chen commented on YARN-8131: -- [~rohithsharma] I don't think we should let the end us

[jira] [Commented] (YARN-3401) [Security] users should not be able to create a generic TimelineEntity and associate arbitrary type

2018-04-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16429456#comment-16429456 ] Haibo Chen commented on YARN-3401: -- The goal/scope of this Jira to is ensure that AMs cann

[jira] [Updated] (YARN-8107) Give an informative message when incorrect format is used in ATSv2 filter attributes

2018-04-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8107: - Summary: Give an informative message when incorrect format is used in ATSv2 filter attributes (was: NPE wh

[jira] [Commented] (YARN-8107) NPE when incorrect format is used in ATSv2 filter attributes

2018-04-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16428553#comment-16428553 ] Haibo Chen commented on YARN-8107: -- +1 checking this shortly > NPE when incorrect format

[jira] [Commented] (YARN-7931) [atsv2 read acls] Include domain table creation as part of schema creator

2018-04-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16428411#comment-16428411 ] Haibo Chen commented on YARN-7931: -- I have one question. The DomainRowKeyConverter.encode(

[jira] [Commented] (YARN-8107) NPE when incorrect format is used in ATSv2 filter attributes

2018-04-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427945#comment-16427945 ] Haibo Chen commented on YARN-8107: -- Yes, I was thing more along the lines with 1), but we

[jira] [Commented] (YARN-8107) NPE when incorrect format is used in ATSv2 filter attributes

2018-04-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427557#comment-16427557 ] Haibo Chen commented on YARN-8107: -- Thanks [~rohithsharma] for the patch! I have one quest

[jira] [Commented] (YARN-6936) [Atsv2] Retrospect storing entities into sub application table from client perspective

2018-04-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427436#comment-16427436 ] Haibo Chen commented on YARN-6936: -- Done. > [Atsv2] Retrospect storing entities into sub

[jira] [Commented] (YARN-6936) [Atsv2] Retrospect storing entities into sub application table from client perspective

2018-04-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427294#comment-16427294 ] Haibo Chen commented on YARN-6936: -- I have committed the patch to trunk. [~rohithsharma] A

[jira] [Updated] (YARN-6936) [Atsv2] Retrospect storing entities into sub application table from client perspective

2018-04-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6936: - Fix Version/s: 3.2.0 > [Atsv2] Retrospect storing entities into sub application table from client > perspe

[jira] [Commented] (YARN-6936) [Atsv2] Retrospect storing entities into sub application table from client perspective

2018-04-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427290#comment-16427290 ] Haibo Chen commented on YARN-6936: -- There seems to be some problem with patch command not

[jira] [Commented] (YARN-6936) [Atsv2] Retrospect storing entities into sub application table from client perspective

2018-04-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427134#comment-16427134 ] Haibo Chen commented on YARN-6936: -- I notice one issue with the latest patch. It adds the

[jira] [Commented] (YARN-6936) [Atsv2] Retrospect storing entities into sub application table from client perspective

2018-04-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16426097#comment-16426097 ] Haibo Chen commented on YARN-6936: -- The latest patch looks good to me, with two minor comm

[jira] [Assigned] (YARN-3401) [Security] users should not be able to create a generic TimelineEntity and associate arbitrary type

2018-04-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-3401: Assignee: Haibo Chen > [Security] users should not be able to create a generic TimelineEntity and >

[jira] [Updated] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2018-04-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7213: - Release Note: Support HBase 2.0.0-beta1 as an alternative backend for YARN ATSv2 in addition to HBase 1.2.6

[jira] [Resolved] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2018-04-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7213. -- Resolution: Done Fix Version/s: 3.2.0 > [Umbrella] Test and validate HBase-2.0.x with Atsv2 >

[jira] [Commented] (YARN-7946) Update TimelineServerV2 doc as per YARN-7919

2018-04-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16426016#comment-16426016 ] Haibo Chen commented on YARN-7946: -- Thanks [~rohithsharma] for the review! I have committe

[jira] [Commented] (YARN-7931) [atsv2 read acls] Include domain table creation as part of schema creator

2018-04-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424793#comment-16424793 ] Haibo Chen commented on YARN-7931: -- +1 on the latest patch. [~rohithsharma] Do you want to

[jira] [Commented] (YARN-6936) [Atsv2] Retrospect storing entities into sub application table from client perspective

2018-04-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424562#comment-16424562 ] Haibo Chen commented on YARN-6936: -- I have been thinking about this issue along with YARN-

[jira] [Commented] (YARN-6936) [Atsv2] Retrospect storing entities into sub application table from client perspective

2018-04-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424389#comment-16424389 ] Haibo Chen commented on YARN-6936: -- I can do 10pm. > [Atsv2] Retrospect storing entities

[jira] [Updated] (YARN-8051) TestRMEmbeddedElector#testCallbackSynchronization is flakey

2018-04-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8051: - Fix Version/s: 3.2.0 > TestRMEmbeddedElector#testCallbackSynchronization is flakey > --

[jira] [Commented] (YARN-8051) TestRMEmbeddedElector#testCallbackSynchronization is flakey

2018-04-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424138#comment-16424138 ] Haibo Chen commented on YARN-8051: -- TestCapacityOverTimePolicy.testAllocation() failure is

[jira] [Commented] (YARN-8051) TestRMEmbeddedElector#testCallbackSynchronization is flakey

2018-04-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16423310#comment-16423310 ] Haibo Chen commented on YARN-8051: -- +1 pending Jenkins. > TestRMEmbeddedElector#testCallb

[jira] [Resolved] (YARN-8093) Support HBase 2.0.0-beta1 as ATSv2 backend

2018-03-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-8093. -- Resolution: Duplicate > Support HBase 2.0.0-beta1 as ATSv2 backend >

[jira] [Updated] (YARN-8093) Support HBase 2.0.0-beta1 as ATSv2 backend

2018-03-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8093: - Issue Type: Sub-task (was: Task) Parent: YARN-7055 > Support HBase 2.0.0-beta1 as ATSv2 backend >

[jira] [Created] (YARN-8093) Support HBase 2.0.0-beta1 as ATSv2 backend

2018-03-29 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8093: Summary: Support HBase 2.0.0-beta1 as ATSv2 backend Key: YARN-8093 URL: https://issues.apache.org/jira/browse/YARN-8093 Project: Hadoop YARN Issue Type: Task

[jira] [Commented] (YARN-8087) Allow YARN ATSv2 ACLs to be disabled

2018-03-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420128#comment-16420128 ] Haibo Chen commented on YARN-8087: -- Thanks [~sunilg] for the pointer! We'll keep that in m

[jira] [Updated] (YARN-8089) Recover domain from backend for TimelineCollector.

2018-03-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8089: - Issue Type: Sub-task (was: Task) Parent: YARN-7055 > Recover domain from backend for TimelineColle

[jira] [Created] (YARN-8089) Recover domain from backend for TimelineCollector.

2018-03-29 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8089: Summary: Recover domain from backend for TimelineCollector. Key: YARN-8089 URL: https://issues.apache.org/jira/browse/YARN-8089 Project: Hadoop YARN Issue Type: Task

[jira] [Updated] (YARN-8088) [atsv2 read acls] REST API to get domain info by id

2018-03-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8088: - Issue Type: Sub-task (was: Task) Parent: YARN-7055 > [atsv2 read acls] REST API to get domain info

[jira] [Created] (YARN-8088) [atsv2 read acls] REST API to get domain info by id

2018-03-29 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8088: Summary: [atsv2 read acls] REST API to get domain info by id Key: YARN-8088 URL: https://issues.apache.org/jira/browse/YARN-8088 Project: Hadoop YARN Issue Type: Tas

[jira] [Created] (YARN-8087) Allow YARN ATSv2 ACLs to be disabled

2018-03-29 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8087: Summary: Allow YARN ATSv2 ACLs to be disabled Key: YARN-8087 URL: https://issues.apache.org/jira/browse/YARN-8087 Project: Hadoop YARN Issue Type: Task Com

[jira] [Updated] (YARN-8087) Allow YARN ATSv2 ACLs to be disabled

2018-03-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8087: - Issue Type: Sub-task (was: Task) Parent: YARN-7055 > Allow YARN ATSv2 ACLs to be disabled > --

[jira] [Commented] (YARN-6936) [Atsv2] Retrospect storing entities into sub application table from client perspective

2018-03-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419666#comment-16419666 ] Haibo Chen commented on YARN-6936: -- I checked the entity publisher in TimelineV2ClientImpl

[jira] [Updated] (YARN-7946) Update TimelineServerV2 doc as per YARN-7919

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7946: - Attachment: YARN-7946.02.patch > Update TimelineServerV2 doc as per YARN-7919 > ---

[jira] [Commented] (YARN-8051) TestRMEmbeddedElector#testCallbackSynchronization is flakey

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417891#comment-16417891 ] Haibo Chen commented on YARN-8051: -- Thanks [~rkanter] for the patch. HADOOP-12427 is dedic

[jira] [Updated] (YARN-7690) expose reserved memory/Vcores of nodemanager at webUI

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7690: - Issue Type: Improvement (was: New Feature) > expose reserved memory/Vcores of nodemanager at webUI >

[jira] [Updated] (YARN-8012) Support Unmanaged Container Cleanup

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8012: - Target Version/s: 2.7.1, 3.2.0 (was: 2.7.1, 3.0.0) > Support Unmanaged Container Cleanup > ---

[jira] [Resolved] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7859. -- Resolution: Won't Do > New feature: add queue scheduling deadLine in fairScheduler. > ---

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7859: - Hadoop Flags: (was: Reviewed) Fix Version/s: (was: 3.0.0) > New feature: add queue scheduling de

[jira] [Reopened] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reopened YARN-7859: -- > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Resolved] (YARN-3988) DockerContainerExecutor should allow user specify "docker run" parameters

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-3988. -- Resolution: Won't Fix Closing this as DockerContainerExecutor has been deprecated in branch-2 and remove

[jira] [Resolved] (YARN-2478) Nested containers should be supported

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-2478. -- Resolution: Won't Fix Closing this as DockerContainerExecutor has been deprecated in branch-2 and remove

[jira] [Resolved] (YARN-2482) DockerContainerExecutor configuration

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-2482. -- Resolution: Won't Fix Closing this as DockerContainerExecutor has been deprecated in branch-2 and remove

[jira] [Resolved] (YARN-2479) DockerContainerExecutor must support handling of distributed cache

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-2479. -- Resolution: Won't Fix Closing this as DockerContainerExecutor has been deprecated in branch-2 and remove

<    1   2   3   4   5   6   7   8   9   10   >