[jira] [Comment Edited] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855396#comment-16855396 ] Peter Bacsko edited comment on YARN-9595 at 6/4/19 6:50 AM: Th

[jira] [Commented] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855396#comment-16855396 ] Peter Bacsko commented on YARN-9595: Thanks for commit this quickly [~tangzhankun] >

[jira] [Commented] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855392#comment-16855392 ] Hadoop QA commented on YARN-9578: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855366#comment-16855366 ] Hadoop QA commented on YARN-9580: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9578: --- Attachment: YARN-9578.004.patch > Add limit/actions/summarize options for app activities REST API > --

[jira] [Commented] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855289#comment-16855289 ] Tao Yang commented on YARN-9580: Sorry about forgetting to check imports in UT class. Att

[jira] [Updated] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9580: --- Attachment: YARN-9580.branch-3.2.002.patch > Fulfilled reservation information in assignment is lost when tran

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-06-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855280#comment-16855280 ] Tao Yang commented on YARN-8995: Thanks [~zhuqi] for the patch. I prefer not maintain a g

[jira] [Commented] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855277#comment-16855277 ] Weiwei Yang commented on YARN-9580: --- Hi [~Tao Yang] There seems to have issues in the p

[jira] [Commented] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855274#comment-16855274 ] Hadoop QA commented on YARN-9580: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855221#comment-16855221 ] Tao Yang edited comment on YARN-9580 at 6/4/19 2:51 AM: Sure, than

[jira] [Created] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-03 Thread Tao Yang (JIRA)
Tao Yang created YARN-9598: -- Summary: Make reservation work well when multi-node enabled Key: YARN-9598 URL: https://issues.apache.org/jira/browse/YARN-9598 Project: Hadoop YARN Issue Type: Bug

[jira] [Reopened] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YARN-9580: --- > Fulfilled reservation information in assignment is lost when transferring in > ParentQueue#assignContai

[jira] [Updated] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9580: --- Attachment: YARN-9580.branch-3.2.001.patch > Fulfilled reservation information in assignment is lost when tran

[jira] [Commented] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855235#comment-16855235 ] Hudson commented on YARN-9595: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #166

[jira] [Commented] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855228#comment-16855228 ] Zhankun Tang commented on YARN-9595: Thanks, Peter! LGTM. +1. Committing shortly. > F

[jira] [Commented] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855221#comment-16855221 ] Tao Yang commented on YARN-9580: Sure, thanks [~cheersyang] for the review and commit. I

[jira] [Commented] (YARN-9597) Memory efficiency in speculator

2019-06-03 Thread Ahmed Hussein (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855155#comment-16855155 ] Ahmed Hussein commented on YARN-9597: - By looking at previous Jira reports, it is clea

[jira] [Created] (YARN-9597) Memory efficiency in speculator

2019-06-03 Thread Ahmed Hussein (JIRA)
Ahmed Hussein created YARN-9597: --- Summary: Memory efficiency in speculator Key: YARN-9597 URL: https://issues.apache.org/jira/browse/YARN-9597 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855127#comment-16855127 ] Hadoop QA commented on YARN-9595: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

2019-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855115#comment-16855115 ] Hadoop QA commented on YARN-9596: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

2019-06-03 Thread Muhammad Samir Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan reassigned YARN-9596: - Assignee: Muhammad Samir Khan > QueueMetrics has incorrect metrics when labelled

[jira] [Created] (YARN-9596) QueueMetrics has incorrect metrics when labelled partitions are involved

2019-06-03 Thread Muhammad Samir Khan (JIRA)
Muhammad Samir Khan created YARN-9596: - Summary: QueueMetrics has incorrect metrics when labelled partitions are involved Key: YARN-9596 URL: https://issues.apache.org/jira/browse/YARN-9596 Projec

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-06-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854941#comment-16854941 ] Eric Payne commented on YARN-8625: -- [~Prabhu Joseph], in order to put these changes into

[jira] [Commented] (YARN-6055) ContainersMonitorImpl need be adjusted when NM resource changed.

2019-06-03 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854940#comment-16854940 ] Íñigo Goiri commented on YARN-6055: --- {{TestContainerSchedulerQueuing#testQueueShedding()

[jira] [Commented] (YARN-9569) Auto-created leaf queues do not honor cluster-wide min/max memory/vcores

2019-06-03 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854763#comment-16854763 ] Suma Shivaprasad commented on YARN-9569: +1. Patch LGTM > Auto-created leaf queue

[jira] [Commented] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854721#comment-16854721 ] Hudson commented on YARN-9580: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #166

[jira] [Commented] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854701#comment-16854701 ] Weiwei Yang commented on YARN-9580: --- Committed to trunk. [~Tao Yang], can you please pro

[jira] [Commented] (YARN-9580) Fulfilled reservation information in assignment is lost when transferring in ParentQueue#assignContainers

2019-06-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854697#comment-16854697 ] Weiwei Yang commented on YARN-9580: --- [~Tao Yang], thanks for the patch, it makes sense t

[jira] [Updated] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9595: --- Attachment: YARN-9595-001.patch > FPGA plugin: NullPointerException in > FpgaNodeResourceUpdateHandle

[jira] [Updated] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9595: --- Description: YARN-9264 accidentally introduced a bug in FpgaDiscoverer. Sometimes {{currentFpgaInfo}}

[jira] [Commented] (YARN-9587) TestDistributedShell#testDSShellWithoutDomainV2 fails intermittently

2019-06-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854649#comment-16854649 ] Prabhu Joseph commented on YARN-9587: - TestDistributedShell logs are filled with {code

[jira] [Commented] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-06-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854648#comment-16854648 ] Prabhu Joseph commented on YARN-9573: - No [~adam.antal], will analyze this as part of 

[jira] [Created] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9595: -- Summary: FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource() Key: YARN-9595 URL: https://issues.apache.org/jira/browse/YARN-9595

[jira] [Commented] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-06-03 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854624#comment-16854624 ] Adam Antal commented on YARN-9573: -- Added patchset v2 with removed \t characters and with

[jira] [Updated] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-06-03 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9573: - Attachment: YARN-9573.002.patch > DistributedShell cannot specify LogAggregationContext >

[jira] [Commented] (YARN-9557) Application fails in diskchecker when ReadWriteDiskValidator is configured.

2019-06-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854573#comment-16854573 ] Bibin A Chundatt commented on YARN-9557: Thank you [~BilwaST] for patch. Latest p

[jira] [Comment Edited] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854553#comment-16854553 ] Tao Yang edited comment on YARN-9578 at 6/3/19 12:49 PM: - For bett

[jira] [Comment Edited] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-03 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854556#comment-16854556 ] Adam Antal edited comment on YARN-9525 at 6/3/19 12:47 PM: --- Sett

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-03 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854556#comment-16854556 ] Adam Antal commented on YARN-9525: -- Setting the rollover size to 0 still fails because of

[jira] [Commented] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854553#comment-16854553 ] Tao Yang commented on YARN-9578: For better serving to users, we should support more optio

[jira] [Updated] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9578: --- Summary: Add limit/actions/summarize options for app activities REST API (was: Add limit option to control nu

[jira] [Commented] (YARN-9557) Application fails in diskchecker when ReadWriteDiskValidator is configured.

2019-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854502#comment-16854502 ] Hadoop QA commented on YARN-9557: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-8906) [UI2] NM hostnames not displayed correctly in Node Heatmap Chart

2019-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854463#comment-16854463 ] Hudson commented on YARN-8906: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #166

[jira] [Updated] (YARN-9557) Application fails in diskchecker when ReadWriteDiskValidator is configured.

2019-06-03 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-9557: Attachment: YARN-9557-003.patch > Application fails in diskchecker when ReadWriteDiskValidator is configured

[jira] [Commented] (YARN-8906) [UI2] NM hostnames not displayed correctly in Node Heatmap Chart

2019-06-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854440#comment-16854440 ] Sunil Govindan commented on YARN-8906: -- Thanks [~akhilpb] > [UI2] NM hostnames not d

[jira] [Commented] (YARN-8906) [UI2] NM hostnames not displayed correctly in Node Heatmap Chart

2019-06-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854439#comment-16854439 ] Sunil Govindan commented on YARN-8906: -- +1 > [UI2] NM hostnames not displayed correc

[jira] [Commented] (YARN-9594) Unknown event arrived at ContainerScheduler: EventType: RECOVERY_COMPLETED

2019-06-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854436#comment-16854436 ] Bibin A Chundatt commented on YARN-9594: Good catch .. +1 for the patch > Unknow

[jira] [Updated] (YARN-9594) Unknown event arrived at ContainerScheduler: EventType: RECOVERY_COMPLETED

2019-06-03 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-9594: Description: It seems that we miss a break in switch-case {code:java} case RECOVERY_COMPLETED: startPendingContain

[jira] [Updated] (YARN-9594) Unknown event arrived at ContainerScheduler: EventType: RECOVERY_COMPLETED

2019-06-03 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-9594: Description: It seems that we miss a break in switch-case {code:java} case RECOVERY_COMPLETED: startPendingContain

[jira] [Commented] (YARN-8199) Logging fileSize of log files under NM Local Dir

2019-06-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854350#comment-16854350 ] Prabhu Joseph commented on YARN-8199: - [~giovanni.fumarola] Thanks for checking this.

[jira] [Updated] (YARN-8499) ATS v2 Generic TimelineStorageMonitor

2019-06-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8499: Attachment: YARN-8499-010.patch > ATS v2 Generic TimelineStorageMonitor > --

[jira] [Commented] (YARN-8947) [UI2] Active User info missing from UI2

2019-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854281#comment-16854281 ] Hudson commented on YARN-8947: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #166