[jira] [Updated] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9127: --- Attachment: (was: YARN-9124.004.patch) > Create more tests to verify GpuDeviceInformationParser >

[jira] [Updated] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9127: --- Attachment: YARN-9124.004.patch > Create more tests to verify GpuDeviceInformationParser > ---

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9140: --- Attachment: YARN-9140.004.patch > Code cleanup in ResourcePluginManager.initialize and in > TestResou

[jira] [Updated] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9100: --- Attachment: YARN-9100-005.patch > Add tests for GpuResourceAllocator and do minor code cleanup > -

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882463#comment-16882463 ] Peter Bacsko commented on YARN-9667: [~eyang] I'm not exactly sure how to properly rep

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Description: NodeHealthScriptRunner does *not* report a bad health if the script exits with an exit c

[jira] [Commented] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882150#comment-16882150 ] Peter Bacsko commented on YARN-6715: Updated the JIRA description and title. > Fix do

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Description: NodeHealthScriptRunner does *not* report a bad health if the script exits with an exit c

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Summary: Fix documentation about NodeHealthScriptRunner (was: Correct documentation about NodeHealth

[jira] [Assigned] (YARN-6715) NodeHealthScriptRunner does not handle non-zero exit codes properly

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-6715: -- Assignee: Peter Bacsko > NodeHealthScriptRunner does not handle non-zero exit codes properly >

[jira] [Updated] (YARN-6715) Correct documentation about NodeHealthScriptRunner

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Summary: Correct documentation about NodeHealthScriptRunner (was: NodeHealthScriptRunner does not ha

[jira] [Assigned] (YARN-9011) Race condition during decommissioning

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9011: -- Assignee: Peter Bacsko (was: Antal Bálint Steinbach) > Race condition during decommissioning >

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9140: --- Attachment: YARN-9140.003.patch > Code cleanup in ResourcePluginManager.initialize and in > TestResou

[jira] [Comment Edited] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882020#comment-16882020 ] Peter Bacsko edited comment on YARN-9100 at 7/10/19 12:53 PM: --

[jira] [Commented] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882020#comment-16882020 ] Peter Bacsko commented on YARN-9100: Some changes in v4: * rebased patch * removed {

[jira] [Updated] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9100: --- Attachment: YARN-9100-004.patch > Add tests for GpuResourceAllocator and do minor code cleanup > -

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16881981#comment-16881981 ] Peter Bacsko commented on YARN-9667: ping [~eyang] > Container-executor.c duplicates

[jira] [Commented] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16881935#comment-16881935 ] Peter Bacsko commented on YARN-9660: Thanks [~eyang] I updated the patch. v2 should be

[jira] [Updated] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9660: --- Attachment: YARN-9660-002.patch > Enhance documentation of Docker on YARN support > --

[jira] [Commented] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16881181#comment-16881181 ] Peter Bacsko commented on YARN-9660: Thanks [~shaneku...@gmail.com] - could you or [~e

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880582#comment-16880582 ] Peter Bacsko commented on YARN-9667: I just found that this is probably even better: {

[jira] [Comment Edited] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880582#comment-16880582 ] Peter Bacsko edited comment on YARN-9667 at 7/8/19 5:50 PM: I

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880552#comment-16880552 ] Peter Bacsko commented on YARN-9667: Oh, thanks for saying - I didn't see that it's no

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880280#comment-16880280 ] Peter Bacsko commented on YARN-9667: cc [~shaneku...@gmail.com] also > Container-exec

[jira] [Comment Edited] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880230#comment-16880230 ] Peter Bacsko edited comment on YARN-9667 at 7/8/19 11:35 AM: -

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880234#comment-16880234 ] Peter Bacsko commented on YARN-9667: cc [~aceric] what do you think? Not sure who shou

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880230#comment-16880230 ] Peter Bacsko commented on YARN-9667: I suggest considering two things: 1) When settin

[jira] [Updated] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-04 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9660: --- Issue Type: Sub-task (was: Bug) Parent: YARN-8472 > Enhance documentation of Docker on YARN s

[jira] [Commented] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-04 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16878652#comment-16878652 ] Peter Bacsko commented on YARN-9660: Moved this under YARN-8472 > Enhance documentati

[jira] [Commented] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-02 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16876992#comment-16876992 ] Peter Bacsko commented on YARN-9660: Uploaded patch v1 to enhance the markdown file.

[jira] [Updated] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-02 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9660: --- Attachment: YARN-9660-001.patch > Enhance documentation of Docker on YARN support > --

[jira] [Resolved] (YARN-9473) [Umbrella] Support Vector Engine ( a new accelerator hardware) based on pluggable device framework

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-9473. Resolution: Fixed Fix Version/s: 3.3.0 > [Umbrella] Support Vector Engine ( a new accelerator

[jira] [Commented] (YARN-9473) [Umbrella] Support Vector Engine ( a new accelerator hardware) based on pluggable device framework

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16876454#comment-16876454 ] Peter Bacsko commented on YARN-9473: Subtasks have been committed to trunk - closing t

[jira] [Assigned] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9660: -- Assignee: Peter Bacsko > Enhance documentation of Docker on YARN support >

[jira] [Updated] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9660: --- Description: Right now, using Docker on YARN has some hard requirements. If these requirements are no

[jira] [Updated] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9660: --- Description: Right now, using Docker on YARN has some hard requirements. If these requirements are no

[jira] [Commented] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16876144#comment-16876144 ] Peter Bacsko commented on YARN-9660: cc [~shaneku...@gmail.com] [~eyang] [~snemeth] -

[jira] [Updated] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9660: --- Description: Right now, using Docker on YARN has some hard requirements. If these requirements are no

[jira] [Created] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-01 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9660: -- Summary: Enhance documentation of Docker on YARN support Key: YARN-9660 URL: https://issues.apache.org/jira/browse/YARN-9660 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-06-26 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16873458#comment-16873458 ] Peter Bacsko commented on YARN-9477: OK, now patch is should be good. Unit test failur

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-06-26 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-007.patch > Implement VE discovery using libudev > -

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-06-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-006.patch > Implement VE discovery using libudev > -

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-06-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-005.patch > Implement VE discovery using libudev > -

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-06-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871192#comment-16871192 ] Peter Bacsko commented on YARN-9477: [~tangzhankun] [~snemeth] please verify the lates

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-06-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-004.patch > Implement VE discovery using libudev > -

[jira] [Commented] (YARN-9621) FIX TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-17 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865444#comment-16865444 ] Peter Bacsko commented on YARN-9621: [~Prabhu Joseph] LGTM +1 (non-binding) Do you th

[jira] [Commented] (YARN-9621) FIX TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16864051#comment-16864051 ] Peter Bacsko commented on YARN-9621: I think the problem is this (https://github.com/

[jira] [Comment Edited] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863889#comment-16863889 ] Peter Bacsko edited comment on YARN-9525 at 6/14/19 9:43 AM: -

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863889#comment-16863889 ] Peter Bacsko commented on YARN-9525: [~adam.antal] is it possible to add some unit tes

[jira] [Assigned] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9525: -- Assignee: Adam Antal (was: Peter Bacsko) > IFile format is not working against s3a remote fold

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863207#comment-16863207 ] Peter Bacsko commented on YARN-9525: That's some nice finding [~adam.antal]. Looks lik

[jira] [Updated] (YARN-9622) All testcase fails in TestTimelineReaderWebServicesHBaseStorage on branch-3.2

2019-06-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9622: --- Affects Version/s: 3.2.0 > All testcase fails in TestTimelineReaderWebServicesHBaseStorage on branch-3

[jira] [Created] (YARN-9622) All testcase fails in TestTimelineReaderWebServicesHBaseStorage

2019-06-13 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9622: -- Summary: All testcase fails in TestTimelineReaderWebServicesHBaseStorage Key: YARN-9622 URL: https://issues.apache.org/jira/browse/YARN-9622 Project: Hadoop YARN

[jira] [Updated] (YARN-9622) All testcase fails in TestTimelineReaderWebServicesHBaseStorage on branch-3.2

2019-06-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9622: --- Summary: All testcase fails in TestTimelineReaderWebServicesHBaseStorage on branch-3.2 (was: All test

[jira] [Commented] (YARN-9621) Test failure TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863059#comment-16863059 ] Peter Bacsko commented on YARN-9621: [~Prabhu Joseph] do you know how to fix this? Bra

[jira] [Updated] (YARN-9621) Test failure TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9621: --- Component/s: test distributed-shell > Test failure > TestDSWithMultipleNodeManager.t

[jira] [Created] (YARN-9621) Test failure TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1

2019-06-13 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9621: -- Summary: Test failure TestDSWithMultipleNodeManager.testDistributedShellWithPlacementConstraint on branch-3.1 Key: YARN-9621 URL: https://issues.apache.org/jira/browse/YARN-9621

[jira] [Comment Edited] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855396#comment-16855396 ] Peter Bacsko edited comment on YARN-9595 at 6/4/19 6:50 AM: Th

[jira] [Commented] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855396#comment-16855396 ] Peter Bacsko commented on YARN-9595: Thanks for commit this quickly [~tangzhankun] >

[jira] [Updated] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9595: --- Attachment: YARN-9595-001.patch > FPGA plugin: NullPointerException in > FpgaNodeResourceUpdateHandle

[jira] [Updated] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9595: --- Description: YARN-9264 accidentally introduced a bug in FpgaDiscoverer. Sometimes {{currentFpgaInfo}}

[jira] [Created] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9595: -- Summary: FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource() Key: YARN-9595 URL: https://issues.apache.org/jira/browse/YARN-9595

[jira] [Comment Edited] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16852141#comment-16852141 ] Peter Bacsko edited comment on YARN-9525 at 5/30/19 5:57 PM: -

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16852141#comment-16852141 ] Peter Bacsko commented on YARN-9525: [~adam.antal] so what's that offset thing? Can we

[jira] [Commented] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

2019-05-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851933#comment-16851933 ] Peter Bacsko commented on YARN-9033: [~sunilg] could you review this patch please? >

[jira] [Commented] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

2019-05-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851838#comment-16851838 ] Peter Bacsko commented on YARN-9033: I reran the failed test successfully on my local

[jira] [Updated] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

2019-05-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9033: --- Attachment: YARN-9033-trunk.003.patch > ResourceHandlerChain#bootstrap is invoked twice during NM star

[jira] [Commented] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

2019-05-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851738#comment-16851738 ] Peter Bacsko commented on YARN-9033: Update: it works, I had to fine-tune permissions

[jira] [Comment Edited] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

2019-05-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851738#comment-16851738 ] Peter Bacsko edited comment on YARN-9033 at 5/30/19 10:56 AM: --

[jira] [Commented] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

2019-05-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851703#comment-16851703 ] Peter Bacsko commented on YARN-9033: Actually no, please don't commit this yet. I ran

[jira] [Commented] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

2019-05-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851612#comment-16851612 ] Peter Bacsko commented on YARN-9033: Thanks for the patch [~tangzhankun]. I tried it w

[jira] [Commented] (YARN-9581) Fix WebAppUtils#getRMWebAppURLWithScheme ignores rm2

2019-05-29 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851090#comment-16851090 ] Peter Bacsko commented on YARN-9581: Looks like there are some minor checkstyle issues

[jira] [Commented] (YARN-9581) Fix WebAppUtils#getRMWebAppURLWithScheme ignores rm2

2019-05-29 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851078#comment-16851078 ] Peter Bacsko commented on YARN-9581: LGTM +1 (non-binding) - pending Jenkins > Fix We

[jira] [Comment Edited] (YARN-9581) WebAppUtils#getRMWebAppURLWithScheme ignores rm2

2019-05-29 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850809#comment-16850809 ] Peter Bacsko edited comment on YARN-9581 at 5/29/19 12:44 PM: --

[jira] [Comment Edited] (YARN-9581) WebAppUtils#getRMWebAppURLWithScheme ignores rm2

2019-05-29 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850809#comment-16850809 ] Peter Bacsko edited comment on YARN-9581 at 5/29/19 12:44 PM: --

[jira] [Comment Edited] (YARN-9581) WebAppUtils#getRMWebAppURLWithScheme ignores rm2

2019-05-29 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850809#comment-16850809 ] Peter Bacsko edited comment on YARN-9581 at 5/29/19 12:43 PM: --

[jira] [Comment Edited] (YARN-9581) WebAppUtils#getRMWebAppURLWithScheme ignores rm2

2019-05-29 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850809#comment-16850809 ] Peter Bacsko edited comment on YARN-9581 at 5/29/19 12:40 PM: --

[jira] [Comment Edited] (YARN-9581) WebAppUtils#getRMWebAppURLWithScheme ignores rm2

2019-05-29 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850809#comment-16850809 ] Peter Bacsko edited comment on YARN-9581 at 5/29/19 12:32 PM: --

[jira] [Commented] (YARN-9581) WebAppUtils#getRMWebAppURLWithScheme ignores rm2

2019-05-29 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850809#comment-16850809 ] Peter Bacsko commented on YARN-9581: Thanks for the patch [~Prabhu Joseph]. Overall lo

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-22 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845679#comment-16845679 ] Peter Bacsko commented on YARN-9525: [~wangda] the test was performed by [~adam.antal]

[jira] [Assigned] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-20 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9525: -- Assignee: Peter Bacsko (was: Adam Antal) > IFile format is not working against s3a remote fold

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-20 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9525: --- Attachment: YARN-9525-001.patch > IFile format is not working against s3a remote folder >

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-20 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844083#comment-16844083 ] Peter Bacsko commented on YARN-9525: I uploaded a simple POC that seems to solve the i

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-20 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9525: --- Attachment: (was: IFile-S3A-POC01.patch) > IFile format is not working against s3a remote folder >

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-20 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9525: --- Attachment: IFile-S3A-POC01.patch > IFile format is not working against s3a remote folder > --

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-20 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9525: --- Attachment: IFile-S3A-POC01.patch > IFile format is not working against s3a remote folder > --

[jira] [Commented] (YARN-9360) Do not expose innards of QueueMetrics object into FSLeafQueue#computeMaxAMResource

2019-05-17 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842179#comment-16842179 ] Peter Bacsko commented on YARN-9360: LGTM +1 (non-binding) > Do not expose innards of

[jira] [Commented] (YARN-9360) Do not expose innards of QueueMetrics object into FSLeafQueue#computeMaxAMResource

2019-05-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840504#comment-16840504 ] Peter Bacsko commented on YARN-9360: [~snemeth] please check whether the test failures

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840350#comment-16840350 ] Peter Bacsko commented on YARN-9552: Thanks Szilard. Ok, I uploaded patch v4 just to m

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-004.patch > FairScheduler: NODE_UPDATE can cause NoSuchElementException > --

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-003.patch > FairScheduler: NODE_UPDATE can cause NoSuchElementException > --

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840256#comment-16840256 ] Peter Bacsko commented on YARN-9552: [~snemeth] I added a short comment to the testcas

[jira] [Commented] (YARN-9482) DistributedShell job with localization fails in unsecure cluster

2019-05-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840231#comment-16840231 ] Peter Bacsko commented on YARN-9482: If that's the case, then I give +1 (non-binding).

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-002.patch > FairScheduler: NODE_UPDATE can cause NoSuchElementException > --

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-001.patch > FairScheduler: NODE_UPDATE can cause NoSuchElementException > --

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Summary: FairScheduler: NODE_UPDATE can cause NoSuchElementException (was: FairScheduler: NODE_UPDATE

[jira] [Created] (YARN-9552) FairScheduler: NODE_UPDATE can cause a NoSuchElementException

2019-05-14 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9552: -- Summary: FairScheduler: NODE_UPDATE can cause a NoSuchElementException Key: YARN-9552 URL: https://issues.apache.org/jira/browse/YARN-9552 Project: Hadoop YARN

[jira] [Resolved] (YARN-9446) TestMiniMRClientCluster.testRestart is flaky

2019-05-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-9446. Resolution: Won't Do Closing this as Won't Do - related Hadoop JIRA (HADOOP-16238) should fix this

[jira] [Commented] (YARN-9482) DistributedShell job with localization fails in unsecure cluster

2019-05-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16836968#comment-16836968 ] Peter Bacsko commented on YARN-9482: There was a failed unit test in "hadoop.yarn.app

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-05-06 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833805#comment-16833805 ] Peter Bacsko commented on YARN-9477: [~snemeth] thanks for the comments, patch v3 fixe

<    9   10   11   12   13   14   15   16   17   >