[jira] [Commented] (YARN-4807) MockAM#waitForState sleep duration is too long

[ https://issues.apache.org/jira/browse/YARN-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192771#comment-15192771 ] Sunil G commented on YARN-4807: --- Yes [~kasha]. Many of the waiteState has cumulative timeout value hardcoded

[jira] [Commented] (YARN-4807) MockAM#waitForState sleep duration is too long

[ https://issues.apache.org/jira/browse/YARN-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192753#comment-15192753 ] Varun Vasudev commented on YARN-4807: - I'd prefer to start with Karthik's approach. Let's make the

[jira] [Commented] (YARN-4773) Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled

[ https://issues.apache.org/jira/browse/YARN-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192735#comment-15192735 ] Jun Gong commented on YARN-4773: hi [~bibinchundatt], if the aggregation restarts again, previous tmp file

[jira] [Commented] (YARN-4808) SchedulerNode can use a few more cosmetic changes

[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192693#comment-15192693 ] Inigo Goiri commented on YARN-4808: --- I'd say is slightly cleaner using just {{RMNode}} to hold

[jira] [Commented] (YARN-4773) Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled

[ https://issues.apache.org/jira/browse/YARN-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192685#comment-15192685 ] Bibin A Chundatt commented on YARN-4773: [~hex108]/[~jlowe] {quote} however we do not need call

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192683#comment-15192683 ] Peng Zhang commented on YARN-3054: -- Thanks [~kasha] I agreed with "have a preemption priority or even a

[jira] [Commented] (YARN-4808) SchedulerNode can use a few more cosmetic changes

[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192599#comment-15192599 ] Hadoop QA commented on YARN-4808: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192582#comment-15192582 ] Shiwei Guo commented on YARN-3933: -- I noticed this, will fix it soon. > Race condition when calling

[jira] [Created] (YARN-4809) De-duplicate container completion across schedulers

Karthik Kambatla created YARN-4809: -- Summary: De-duplicate container completion across schedulers Key: YARN-4809 URL: https://issues.apache.org/jira/browse/YARN-4809 Project: Hadoop YARN

[jira] [Updated] (YARN-4808) SchedulerNode can use a few more cosmetic changes

[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4808: --- Attachment: yarn-4808-1.patch > SchedulerNode can use a few more cosmetic changes >

[jira] [Commented] (YARN-4808) SchedulerNode can use a few more cosmetic changes

[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192557#comment-15192557 ] Karthik Kambatla commented on YARN-4808: [~elgoiri], [~leftnoteasy] - could you guys take a quick

[jira] [Updated] (YARN-4808) SchedulerNode can use a few more cosmetic changes

[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4808: --- Attachment: yarn-4808-1.patch > SchedulerNode can use a few more cosmetic changes >

[jira] [Created] (YARN-4808) SchedulerNode can use a few more cosmetic changes

Karthik Kambatla created YARN-4808: -- Summary: SchedulerNode can use a few more cosmetic changes Key: YARN-4808 URL: https://issues.apache.org/jira/browse/YARN-4808 Project: Hadoop YARN

[jira] [Commented] (YARN-1297) Miscellaneous Fair Scheduler speedups

[ https://issues.apache.org/jira/browse/YARN-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192547#comment-15192547 ] Yufei Gu commented on YARN-1297: Thanks, [~asuresh]. > Miscellaneous Fair Scheduler speedups >

[jira] [Commented] (YARN-4807) MockAM#waitForState sleep duration is too long

[ https://issues.apache.org/jira/browse/YARN-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192416#comment-15192416 ] Karthik Kambatla commented on YARN-4807: Actually, the problem seems worse. We have multiple

[jira] [Updated] (YARN-4795) ContainerMetrics drops records

[ https://issues.apache.org/jira/browse/YARN-4795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4795: --- Attachment: YARN-4795.001.patch > ContainerMetrics drops records >

[jira] [Resolved] (YARN-4802) ContainerMetrics drops records

[ https://issues.apache.org/jira/browse/YARN-4802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-4802. Resolution: Duplicate > ContainerMetrics drops records > -- > >

[jira] [Resolved] (YARN-4803) ContainerMetrics drops records

[ https://issues.apache.org/jira/browse/YARN-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-4803. Resolution: Duplicate > ContainerMetrics drops records > -- > >

[jira] [Resolved] (YARN-4801) ContainerMetrics drops records

[ https://issues.apache.org/jira/browse/YARN-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-4801. Resolution: Duplicate > ContainerMetrics drops records > -- > >

[jira] [Resolved] (YARN-4796) ContainerMetrics drops records

[ https://issues.apache.org/jira/browse/YARN-4796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-4796. Resolution: Duplicate > ContainerMetrics drops records > -- > >

[jira] [Resolved] (YARN-4800) ContainerMetrics drops records

[ https://issues.apache.org/jira/browse/YARN-4800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-4800. Resolution: Duplicate > ContainerMetrics drops records > -- > >

[jira] [Resolved] (YARN-4797) ContainerMetrics drops records

[ https://issues.apache.org/jira/browse/YARN-4797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-4797. Resolution: Duplicate > ContainerMetrics drops records > -- > >

[jira] [Resolved] (YARN-4798) ContainerMetrics drops records

[ https://issues.apache.org/jira/browse/YARN-4798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-4798. Resolution: Duplicate > ContainerMetrics drops records > -- > >

[jira] [Resolved] (YARN-4799) ContainerMetrics drops records

[ https://issues.apache.org/jira/browse/YARN-4799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-4799. Resolution: Duplicate > ContainerMetrics drops records > -- > >

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192356#comment-15192356 ] Steve Loughran commented on YARN-4545: -- LGTM, +1 > Allow YARN distributed shell to use ATS v1.5 APIs

[jira] [Commented] (YARN-4678) Cluster used capacity is > 100 when container reserved

[ https://issues.apache.org/jira/browse/YARN-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192334#comment-15192334 ] Hadoop QA commented on YARN-4678: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4807) MockAM#waitForState sleep duration is too long

[ https://issues.apache.org/jira/browse/YARN-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192270#comment-15192270 ] Sunil G commented on YARN-4807: --- As I see, {{MockRM#waitForState}} is also considering 500ms to 1sec in

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192268#comment-15192268 ] Sunil G commented on YARN-4751: --- Thanks [~eepayne] for pointing out the dependencies. Yes, its come with a

[jira] [Updated] (YARN-4678) Cluster used capacity is > 100 when container reserved

[ https://issues.apache.org/jira/browse/YARN-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4678: -- Attachment: 0003-YARN-4678.patch Updating patch by removing reservedCapacity from LeafQueue also. Hence this

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192255#comment-15192255 ] Sunil G commented on YARN-4781: --- Thanks [~leftnoteasy] for sharing more thoughts on same. IIUC, this will

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192239#comment-15192239 ] Hadoop QA commented on YARN-4712: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4712: Attachment: YARN-4712-YARN-2928.v1.005.patch Hi [~sjlee0] & [~varun_saxena], Considering

[jira] [Commented] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192221#comment-15192221 ] Karthik Kambatla commented on YARN-4805: Comparing against earlier builds from today, this change

[jira] [Commented] (YARN-4796) ContainerMetrics drops records

[ https://issues.apache.org/jira/browse/YARN-4796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192215#comment-15192215 ] Varun Vasudev commented on YARN-4796: - [~templedf] - I think this got filed twice by mistake. YARN-4795

[jira] [Commented] (YARN-3122) Metrics for container's actual CPU usage

[ https://issues.apache.org/jira/browse/YARN-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192201#comment-15192201 ] Naganarasimha G R commented on YARN-3122: - Any thoughts on the above comment [~adhoot] & [~kasha].