[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-06-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037632#comment-16037632 ] Haibo Chen commented on YARN-6670: -- Filed YARN-6690 to consolidate the configs with ResourceTypes, and

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-06-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16039597#comment-16039597 ] Haibo Chen commented on YARN-6670: -- Thanks [~kkaranasos] for your review! bq. The parameter names that

[jira] [Commented] (YARN-7063) TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2

2017-09-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162210#comment-16162210 ] Haibo Chen commented on YARN-7063: -- bq. Do we have any other option? Agree with you there is no other

[jira] [Commented] (YARN-7128) The error message in TimelineSchemaCreator is not enough to find out the error.

2017-09-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162216#comment-16162216 ] Haibo Chen commented on YARN-7128: -- +1 on the patch. Thanks for the contribution [~lingjinjiang]! > The

[jira] [Commented] (YARN-7132) FairScheduler.initScheduler() contains a surprising unary plus

2017-09-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162453#comment-16162453 ] Haibo Chen commented on YARN-7132: -- Thanks [~Cyl] for your contribution. I have committed the patch to

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4511: - Attachment: YARN-4511-YARN-1011.02.patch Updated the patch address issues identified by

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177326#comment-16177326 ] Haibo Chen commented on YARN-7009: -- Thanks for the update. I think we can avoid

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177333#comment-16177333 ] Haibo Chen commented on YARN-4511: -- Thanks [~leftnoteasy] for reviewing. I will be on vacations for the

[jira] [Assigned] (YARN-1015) FS should watch resource utilization of containers and allocate speculative containers if appropriate

2017-09-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-1015: Assignee: Haibo Chen (was: Karthik Kambatla) > FS should watch resource utilization of containers

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4511: - Attachment: YARN-4511-YARN-1011.01.patch Another patch to address the issues reported by Jenkins. >

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166994#comment-16166994 ] Haibo Chen commented on YARN-4511: -- TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable is

[jira] [Updated] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2017-09-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6675: - Attachment: (was: YARN-6675.00.patch) > Add NM support to launch opportunistic containers based on

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176681#comment-16176681 ] Haibo Chen commented on YARN-7009: -- Thanks [~miklos.szeg...@cloudera.com] for the patch. A few comments:

[jira] [Commented] (YARN-6943) Update Yarn to YARN in documentation

2017-09-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172042#comment-16172042 ] Haibo Chen commented on YARN-6943: -- [~chetna] I have added you as a contributor to YARN. You should have

[jira] [Updated] (YARN-7293) ContainerLaunch.cleanupContainer may leak a starting container process

2017-10-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7293: - Summary: ContainerLaunch.cleanupContainer may leak a starting container process (was:

[jira] [Updated] (YARN-7293) ContainerLaunch.cleanupContainer may miss a starting container

2017-10-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7293: - Description: Currently, NM can leave a starting container that is supposed to be killed running if the

[jira] [Commented] (YARN-7213) [Atsv2] Test and validate HBase-2.0.x with Atsv2

2017-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197169#comment-16197169 ] Haibo Chen commented on YARN-7213: -- I see. thanks for the update! > [Atsv2] Test and validate HBase-2.0.x

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2017-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197345#comment-16197345 ] Haibo Chen commented on YARN-7064: -- I deployed a pseudo-distributed cluster on a linux machine. However,

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197368#comment-16197368 ] Haibo Chen commented on YARN-4511: -- Forget to mention why allowedResourceForOverAllocation() is there even

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198915#comment-16198915 ] Haibo Chen commented on YARN-4511: -- Thanks a lot for the review, [~asuresh]! bq. in the context of

[jira] [Created] (YARN-7300) DiskValidator is not used in LocalDirAllocator

2017-10-09 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7300: Summary: DiskValidator is not used in LocalDirAllocator Key: YARN-7300 URL: https://issues.apache.org/jira/browse/YARN-7300 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7300) DiskValidator is not used in LocalDirAllocator

2017-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197426#comment-16197426 ] Haibo Chen commented on YARN-7300: -- CC [~yufeigu], [~rchiang] > DiskValidator is not used in

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193897#comment-16193897 ] Haibo Chen commented on YARN-4511: -- Thanks for the reviews, [~leftnoteasy]! The scope of the variable

[jira] [Commented] (YARN-7213) [Atsv2] Test and validate HBase-2.0.x with Atsv2

2017-10-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193289#comment-16193289 ] Haibo Chen commented on YARN-7213: -- I have not looked at all unit test failures, so it is unclear to me,

[jira] [Commented] (YARN-7213) [Atsv2] Test and validate HBase-2.0.x with Atsv2

2017-10-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193286#comment-16193286 ] Haibo Chen commented on YARN-7213: -- Sorry for the delayed reponse, [~rohithsharma]. I uploaded a patch

[jira] [Updated] (YARN-7213) [Atsv2] Test and validate HBase-2.0.x with Atsv2

2017-10-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7213: - Attachment: YARN-7213.prelim.patch > [Atsv2] Test and validate HBase-2.0.x with Atsv2 >

[jira] [Created] (YARN-7334) Add documentation of oversubscription

2017-10-16 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7334: Summary: Add documentation of oversubscription Key: YARN-7334 URL: https://issues.apache.org/jira/browse/YARN-7334 Project: Hadoop YARN Issue Type: Bug Affects

[jira] [Updated] (YARN-7334) Add documentation of oversubscription

2017-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7334: - Issue Type: Sub-task (was: Bug) Parent: YARN-1011 > Add documentation of oversubscription >

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206358#comment-16206358 ] Haibo Chen commented on YARN-4511: -- Yep, I have created YARN-7334 as a blocker to document the API/proto

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4511: - Attachment: YARN-4511-YARN-1011.04.patch > Common scheduler changes supporting scheduler-specific

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206632#comment-16206632 ] Haibo Chen commented on YARN-4511: -- Patch updated to address the follow major issues: 1) rename

[jira] [Commented] (YARN-7310) TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler

2017-10-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204305#comment-16204305 ] Haibo Chen commented on YARN-7310: -- +1, will commit it shortly unless there is objection >

[jira] [Updated] (YARN-7337) Expose per-node over-allocation info in Resource Manager

2017-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7337: - Issue Type: Sub-task (was: Task) Parent: YARN-1011 > Expose per-node over-allocation info in

[jira] [Created] (YARN-7337) Expose per-node over-allocation info in Resource Manager

2017-10-16 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7337: Summary: Expose per-node over-allocation info in Resource Manager Key: YARN-7337 URL: https://issues.apache.org/jira/browse/YARN-7337 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2017-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5473: - Summary: Expose per-application over-allocation info in the Resource Manager (was: Expose over-allocation

[jira] [Commented] (YARN-6735) Have a way to turn off system metrics from NMs

2017-09-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158959#comment-16158959 ] Haibo Chen commented on YARN-6735: -- I see. That makes sense. > Have a way to turn off system metrics from

[jira] [Commented] (YARN-7063) TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2

2017-09-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16159241#comment-16159241 ] Haibo Chen commented on YARN-7063: -- Thanks [~varun_saxena] for the patch! I think the root cause is rather

[jira] [Assigned] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-08-30 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-1014: Assignee: Haibo Chen (was: Karthik Kambatla) > Configure OOM Killer to kill OPPORTUNISTIC

[jira] [Commented] (YARN-7181) CPUTimeTracker.updateElapsedJiffies can report negative usage

2017-09-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161851#comment-16161851 ] Haibo Chen commented on YARN-7181: -- +1 Will commit it shortly. > CPUTimeTracker.updateElapsedJiffies can

[jira] [Commented] (YARN-7169) Backport new yarn-ui to TSv2's branch2 code (YARN-5355_branch2)

2017-09-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157482#comment-16157482 ] Haibo Chen commented on YARN-7169: -- One outstanding issue, though not in the core code, is YARN-7063,

[jira] [Commented] (YARN-6735) Have a way to turn off system metrics from NMs

2017-09-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157941#comment-16157941 ] Haibo Chen commented on YARN-6735: -- [~vrushalic] [~rohithsharma] What are the system metrics that NMs are

[jira] [Commented] (YARN-7132) FairScheduler.initScheduler() contains a surprising unary plus

2017-09-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157933#comment-16157933 ] Haibo Chen commented on YARN-7132: -- Thanks [~Cyl] for the path. LGTM +1. > FairScheduler.initScheduler()

[jira] [Updated] (YARN-7063) TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2

2017-09-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7063: - Fix Version/s: YARN-5335_branch2 > TestTimelineReaderWebServicesHBaseStorage fails with

[jira] [Commented] (YARN-7063) TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2

2017-09-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163503#comment-16163503 ] Haibo Chen commented on YARN-7063: -- Thanks [~vrushalic]. I have set the fix version accordingly. >

[jira] [Commented] (YARN-7063) TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2

2017-09-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163159#comment-16163159 ] Haibo Chen commented on YARN-7063: -- +1 on the latests patch. Will commit it shortly. >

[jira] [Commented] (YARN-7063) TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2

2017-09-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163179#comment-16163179 ] Haibo Chen commented on YARN-7063: -- Thanks [~varun_saxena] for the fix! I have committed it to

[jira] [Comment Edited] (YARN-7063) TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2

2017-09-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162210#comment-16162210 ] Haibo Chen edited comment on YARN-7063 at 9/11/17 11:17 PM: bq. Do we have any

[jira] [Assigned] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-08-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-4511: Assignee: Haibo Chen (was: Karthik Kambatla) > Common scheduler changes supporting

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-08-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4511: - Attachment: YARN-4511-YARN-1011.00.patch > Common scheduler changes supporting scheduler-specific

[jira] [Resolved] (YARN-7032) [ATSv2] NPE while starting hbase co-processor

2017-08-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7032. -- Resolution: Won't Fix > [ATSv2] NPE while starting hbase co-processor >

[jira] [Updated] (YARN-7128) The error message in TimelineSchemaCreator is not enough to find out the error.

2017-08-30 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7128: - Issue Type: Sub-task (was: Bug) Parent: YARN-7055 > The error message in TimelineSchemaCreator is

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2017-08-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149450#comment-16149450 ] Haibo Chen commented on YARN-7064: -- [~miklos.szeg...@cloudera.com] sorry for being late to look at this.

[jira] [Commented] (YARN-6868) Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml

2017-08-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146485#comment-16146485 ] Haibo Chen commented on YARN-6868: -- +1. Will commit it tomorrow. > Add test scope to certain entries in

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4511: - Attachment: YARN-4511-YARN-1011.03.patch > Common scheduler changes supporting scheduler-specific

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197757#comment-16197757 ] Haibo Chen commented on YARN-4511: -- Uploaded a new patch that based on Wangda's review 1) removes

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-10-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193572#comment-16193572 ] Haibo Chen commented on YARN-7009: -- Unit test failures in the report are tracked and fixed in YARN-7211.

[jira] [Commented] (YARN-7213) [Atsv2] Test and validate HBase-2.0.x with Atsv2

2017-10-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193606#comment-16193606 ] Haibo Chen commented on YARN-7213: -- HBASE-18368 seems to be breaking some of the unit tests according to

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202335#comment-16202335 ] Haibo Chen commented on YARN-4511: -- Thanks for the background on YARN-5139, [~leftnoteasy]. My

[jira] [Comment Edited] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202335#comment-16202335 ] Haibo Chen edited comment on YARN-4511 at 10/12/17 5:45 PM: Thanks for the

[jira] [Updated] (YARN-6690) Consolidate NM overallocation thresholds with ResourceTypes

2017-10-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6690: - Description: YARN-3926 (ResourceTypes) introduces a new class ResourceInformation to encapsulate all

[jira] [Assigned] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-10-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-1014: Assignee: Miklos Szegedi (was: Haibo Chen) > Configure OOM Killer to kill OPPORTUNISTIC containers

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210615#comment-16210615 ] Haibo Chen commented on YARN-4511: -- Looks like the build has been failing due to 404 when downloading

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210281#comment-16210281 ] Haibo Chen commented on YARN-7346: -- [~rohithsharma], do we have a branch yet for the hbase 2.0 work? If

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210571#comment-16210571 ] Haibo Chen commented on YARN-4511: -- The findbug warnings are bogus in that all the increments/decrements

[jira] [Commented] (YARN-7341) TestRouterWebServiceUtil#testMergeMetrics is flakey

2017-10-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207879#comment-16207879 ] Haibo Chen commented on YARN-7341: -- +1. Will commit it shortly >

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-10-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208287#comment-16208287 ] Haibo Chen commented on YARN-7346: -- YARN-7213 is the effort to move to hbase 2.0 (alpha3 though because we

[jira] [Commented] (YARN-6546) SLS is slow while loading 10k queues

2017-10-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208499#comment-16208499 ] Haibo Chen commented on YARN-6546: -- The patch LGTM. Will commit it shortly. > SLS is slow while loading

[jira] [Issue Comment Deleted] (YARN-6546) SLS is slow while loading 10k queues

2017-10-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6546: - Comment: was deleted (was: +1. Will commit it later if there is no objection.) > SLS is slow while

[jira] [Commented] (YARN-6546) SLS is slow while loading 10k queues

2017-10-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208344#comment-16208344 ] Haibo Chen commented on YARN-6546: -- +1. Will commit it later if there is no objection. > SLS is slow

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-10-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208611#comment-16208611 ] Haibo Chen commented on YARN-7346: -- [~tedyu], which maven repository has 2.0.0-alpha4-SNAPSHOT been

[jira] [Updated] (YARN-7362) Set assumption of capacity scheduler for TestClientRMService.testUpdateApplicationPriorityRequest() and testUpdatePriorityAndKillAppWithZeroClusterResource()

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7362: - Summary: Set assumption of capacity scheduler for

[jira] [Updated] (YARN-7359) TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7359: - Attachment: YARN-7359.00.patch > TestAppManager.testQueueSubmitWithNoPermission() should be scheduler

[jira] [Resolved] (YARN-7362) Set assumption of capacity scheduler for TestClientRMService.testUpdateApplicationPriorityRequest() and testUpdatePriorityAndKillAppWithZeroClusterResource()

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7362. -- Resolution: Duplicate > Set assumption of capacity scheduler for >

[jira] [Created] (YARN-7360) TestRM.testNMTokenSentForNormalContainer() fails with Fair Scheduler

2017-10-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7360: Summary: TestRM.testNMTokenSentForNormalContainer() fails with Fair Scheduler Key: YARN-7360 URL: https://issues.apache.org/jira/browse/YARN-7360 Project: Hadoop YARN

[jira] [Created] (YARN-7358) TestZKConfigurationStore and TestZKConfigurationStore should explicitly set capacity scheduler

2017-10-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7358: Summary: TestZKConfigurationStore and TestZKConfigurationStore should explicitly set capacity scheduler Key: YARN-7358 URL: https://issues.apache.org/jira/browse/YARN-7358

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210277#comment-16210277 ] Haibo Chen commented on YARN-7346: -- The patch I have attached in YARN-7213 uses hbase2.0-alpha3 which has

[jira] [Updated] (YARN-7358) TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7358: - Summary: TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity

[jira] [Updated] (YARN-7358) TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7358: - Description: TestZKConfigurationStore and TestLeveldbConfigurationStore both assume capacity scheduler in

[jira] [Updated] (YARN-7358) TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7358: - Priority: Minor (was: Major) > TestZKConfigurationStore and TestLeveldbConfigurationStore should

[jira] [Updated] (YARN-7358) TestZKConfigurationStore and TestZKConfigurationStore should explicitly set capacity scheduler

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7358: - Description: TestZKConfigurationStore and Test > TestZKConfigurationStore and TestZKConfigurationStore

[jira] [Updated] (YARN-7358) TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7358: - Attachment: YARN-7358.00.patch > TestZKConfigurationStore and TestLeveldbConfigurationStore should

[jira] [Updated] (YARN-7362) Set assumption of capacity scheduler for TestClientRMService.testUpdateApplicationPriorityRequest() and testUpdatePriorityAndKillAppWithZeroClusterResource()

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7362: - Affects Version/s: 3.0.0-alpha3 > Set assumption of capacity scheduler for >

[jira] [Updated] (YARN-7362) Set assumption of capacity scheduler for TestClientRMService.testUpdateApplicationPriorityRequest() and testUpdatePriorityAndKillAppWithZeroClusterResource()

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7362: - Target Version/s: 3.0.0 > Set assumption of capacity scheduler for >

[jira] [Created] (YARN-7362) Explicitly set assumption of capacity scheduler for TestClientRMService. testUpdateApplicationPriorityRequest() and testUpdatePriorityAndKillAppWithZeroClusterResource()

2017-10-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7362: Summary: Explicitly set assumption of capacity scheduler for TestClientRMService. testUpdateApplicationPriorityRequest() and testUpdatePriorityAndKillAppWithZeroClusterResource() Key: YARN-7362

[jira] [Updated] (YARN-7355) TestDistributedShell should be scheduler agnostic

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7355: - Attachment: YARN-7355.00.patch > TestDistributedShell should be scheduler agnostic >

[jira] [Created] (YARN-7359) TestAppManager.testQueueSubmitWithNoPermission()

2017-10-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7359: Summary: TestAppManager.testQueueSubmitWithNoPermission() Key: YARN-7359 URL: https://issues.apache.org/jira/browse/YARN-7359 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7359) TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7359: - Priority: Minor (was: Major) > TestAppManager.testQueueSubmitWithNoPermission() should be scheduler

[jira] [Updated] (YARN-7359) TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7359: - Summary: TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic (was:

[jira] [Assigned] (YARN-7359) TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-7359: Assignee: Haibo Chen > TestAppManager.testQueueSubmitWithNoPermission() should be scheduler

[jira] [Updated] (YARN-7359) TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7359: - Issue Type: Improvement (was: Bug) > TestAppManager.testQueueSubmitWithNoPermission() should be scheduler

[jira] [Created] (YARN-7355) TestDistributedShell should be scheduler agnostic

2017-10-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7355: Summary: TestDistributedShell should be scheduler agnostic Key: YARN-7355 URL: https://issues.apache.org/jira/browse/YARN-7355 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7358) TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7358: - Issue Type: Improvement (was: Bug) > TestZKConfigurationStore and TestLeveldbConfigurationStore should

[jira] [Updated] (YARN-7360) TestRM.testNMTokenSentForNormalContainer() fails with Fair Scheduler

2017-10-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7360: - Attachment: YARN-7360.00.patch > TestRM.testNMTokenSentForNormalContainer() fails with Fair Scheduler >

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16211631#comment-16211631 ] Haibo Chen commented on YARN-4511: -- Thanks [~miklos.szeg...@cloudera.com] for the review! I will address

[jira] [Commented] (YARN-7373) The atomicity of container update in RM is not clear

2017-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215598#comment-16215598 ] Haibo Chen commented on YARN-7373: -- Thanks [~asuresh] for the detailed information! Agreed that we should

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4511: - Attachment: YARN-4511-YARN-1011.08.patch v8 of the patch added synchronization on the node while doing the

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215593#comment-16215593 ] Haibo Chen commented on YARN-4511: -- Right. Will update the patch real quick > Common scheduler changes

[jira] [Updated] (YARN-1015) FS should watch resource utilization of containers and allocate speculative containers if appropriate

2017-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-1015: - Description: FS should looks at resource utilization of nodes (provided by NM in heartbeat) and allocate

[jira] [Updated] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-1015: - Summary: FS should watch node resource utilization and allocate opportunistic containers if appropriate

[jira] [Resolved] (YARN-7373) The atomicity of container update in RM is not clear

2017-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7373. -- Resolution: Information Provided > The atomicity of container update in RM is not clear >

<    4   5   6   7   8   9   10   11   12   13   >