[jira] [Updated] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9060: --- Attachment: YARN-9060-trunk.017.patch > [YARN-8851] Phase 1 - Support device isolation and use the Nvi

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-02 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: h2. Background GPU topology affects performance. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-02 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: h2. Background GPU topology affects performance. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-02 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: h2. Background GPU topology affects performance. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-02 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: GPU topology affects performance dramatically. There's been a discussion in YARN-7481. B

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-02 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: h2. Background GPU topology affects performance. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9060: --- Attachment: YARN-9060-trunk.018.patch > [YARN-8851] Phase 1 - Support device isolation and use the Nvi

[jira] [Commented] (YARN-9294) Potential race condition in setting GPU cgroups & execute command in the selected cgroup

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16765895#comment-16765895 ] Zhankun Tang commented on YARN-9294: [~oliverhuh...@gmail.com], Have you tried to do

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766109#comment-16766109 ] Zhankun Tang commented on YARN-9060: [~sunilg] , the failed test cases seems not relat

[jira] [Commented] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766636#comment-16766636 ] Zhankun Tang commented on YARN-8927: [~eyang], [~ebadger] Thanks for the review! If a

[jira] [Comment Edited] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766636#comment-16766636 ] Zhankun Tang edited comment on YARN-8927 at 2/13/19 1:25 AM: -

[jira] [Comment Edited] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766636#comment-16766636 ] Zhankun Tang edited comment on YARN-8927 at 2/13/19 1:35 AM: -

[jira] [Comment Edited] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766636#comment-16766636 ] Zhankun Tang edited comment on YARN-8927 at 2/13/19 1:28 AM: -

[jira] [Comment Edited] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766636#comment-16766636 ] Zhankun Tang edited comment on YARN-8927 at 2/13/19 1:31 AM: -

[jira] [Comment Edited] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766636#comment-16766636 ] Zhankun Tang edited comment on YARN-8927 at 2/13/19 1:39 AM: -

[jira] [Commented] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766696#comment-16766696 ] Zhankun Tang commented on YARN-8927: Just checked, if an image name is "repoA/userA/im

[jira] [Comment Edited] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766696#comment-16766696 ] Zhankun Tang edited comment on YARN-8927 at 2/13/19 2:52 AM: -

[jira] [Comment Edited] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766696#comment-16766696 ] Zhankun Tang edited comment on YARN-8927 at 2/13/19 2:52 AM: -

[jira] [Comment Edited] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766696#comment-16766696 ] Zhankun Tang edited comment on YARN-8927 at 2/13/19 3:03 AM: -

[jira] [Commented] (YARN-9265) FPGA plugin fails to recognize Intel Processing Accelerator Card

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766737#comment-16766737 ] Zhankun Tang commented on YARN-9265: [~pbacsko] , Thanks for the patch. It looks good

[jira] [Commented] (YARN-9118) Handle issues with parsing user defined GPU devices in GpuDiscoverer

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766750#comment-16766750 ] Zhankun Tang commented on YARN-9118: [~snemeth] , thanks for the patch! Please fix the

[jira] [Commented] (YARN-9294) Potential race condition in setting GPU cgroups & execute command in the selected cgroup

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766760#comment-16766760 ] Zhankun Tang commented on YARN-9294: [~oliverhuh...@gmail.com] , Yeah. Agree with the

[jira] [Comment Edited] (YARN-9294) Potential race condition in setting GPU cgroups & execute command in the selected cgroup

2019-02-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766760#comment-16766760 ] Zhankun Tang edited comment on YARN-9294 at 2/13/19 4:16 AM: -

[jira] [Commented] (YARN-9294) Potential race condition in setting GPU cgroups & execute command in the selected cgroup

2019-02-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766901#comment-16766901 ] Zhankun Tang commented on YARN-9294: [~oliverhuh...@gmail.com] , good job! Looking for

[jira] [Commented] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-02-14 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16768880#comment-16768880 ] Zhankun Tang commented on YARN-8927: [~eyang] , sorry for the late reply. Just go thro

[jira] [Commented] (YARN-9294) Potential race condition in setting GPU cgroups & execute command in the selected cgroup

2019-02-15 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769118#comment-16769118 ] Zhankun Tang commented on YARN-9294: [~oliverhuh...@gmail.com] , Do you mean that the

[jira] [Commented] (YARN-8927) Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

2019-02-15 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769904#comment-16769904 ] Zhankun Tang commented on YARN-8927: [~eyang] , Thanks for the review! [~ebadger] , I

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770980#comment-16770980 ] Zhankun Tang commented on YARN-9060: [~sunilg], [~cheersyang], Thanks for the reviews!

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770995#comment-16770995 ] Zhankun Tang commented on YARN-9139: [~snemeth] , Thanks for the patch. [~sunilg] , t

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Attachment: YARN-8821-trunk.006.patch > GPU hierarchy/topology scheduling support > --

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Attachment: YARN-8821-trunk.007.patch > GPU hierarchy/topology scheduling support > --

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: h2. Background GPU topology affects performance. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Attachment: GPUTopologyPerformance.png > GPU hierarchy/topology scheduling support > -

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: h2. Background GPU topology affects performance. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: h2. Background GPU topology affects performance. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Attachment: YARN-8821-trunk.008.patch > GPU hierarchy/topology scheduling support > --

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Attachment: YARN-8821-trunk.009.patch > GPU hierarchy/topology scheduling support > --

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: h2. Background GPU topology affects performance. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: h2. Background GPU topology affects performance. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) [YARN-8851] GPU hierarchy/topology scheduling support based on pluggable device framework

2019-02-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Summary: [YARN-8851] GPU hierarchy/topology scheduling support based on pluggable device framework (w

[jira] [Commented] (YARN-8821) [YARN-8851] GPU hierarchy/topology scheduling support based on pluggable device framework

2019-02-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16771683#comment-16771683 ] Zhankun Tang commented on YARN-8821: The unit test seems unrelated to this patch. > [

[jira] [Resolved] (YARN-8887) Support isolation in pluggable device framework

2019-02-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-8887. Resolution: Duplicate Resolve it as duplicated with YAR-9060 > Support isolation in pluggable devic

[jira] [Resolved] (YARN-8883) Phase 1 - Provide an example of fake vendor plugin

2019-02-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-8883. Resolution: Duplicate Resolve it due to the YARN-9060 has an example of Nvidia GPU plugin > Phase 1

[jira] [Resolved] (YARN-8889) Add well-defined interface in container-executor to support vendor plugins isolation request

2019-02-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-8889. Resolution: Duplicate Resolve this as already implemented in YARN-9060 > Add well-defined interface

[jira] [Resolved] (YARN-8888) Support device topology scheduling

2019-02-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-. Resolution: Won't Fix Resolve it due to the GPU topology algorithm is better implemented in the plu

[jira] [Resolved] (YARN-9103) Fix the bug in DeviceMappingManager#getReleasingDevices

2019-02-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-9103. Resolution: Won't Fix Resolve it as it is fixed in YARN-9060 > Fix the bug in DeviceMappingManager#

[jira] [Updated] (YARN-8821) [YARN-8851] GPU hierarchy/topology scheduling support based on pluggable device framework

2019-02-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Attachment: YARN-8821-trunk.010.patch > [YARN-8851] GPU hierarchy/topology scheduling support based on

[jira] [Commented] (YARN-8821) [YARN-8851] GPU hierarchy/topology scheduling support based on pluggable device framework

2019-02-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772640#comment-16772640 ] Zhankun Tang commented on YARN-8821: [~cheersyang] , Thanks for the review! {quote}1. 

[jira] [Updated] (YARN-8891) Documentation of the pluggable device framework

2019-02-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8891: --- Attachment: YARN-8891-trunk.001.patch > Documentation of the pluggable device framework >

[jira] [Updated] (YARN-8891) Documentation of the pluggable device framework

2019-02-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8891: --- Attachment: YARN-8891-trunk.003.patch > Documentation of the pluggable device framework >

[jira] [Updated] (YARN-8891) Documentation of the pluggable device framework

2019-02-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8891: --- Attachment: YARN-8891-trunk.002.patch > Documentation of the pluggable device framework >

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773570#comment-16773570 ] Zhankun Tang commented on YARN-9060: [~jojochuang] , Thanks for reporting this. I'll c

[jira] [Assigned] (YARN-9319) YARN-9060 does not compile

2019-02-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-9319: -- Assignee: Zhankun Tang > YARN-9060 does not compile > -- > >

[jira] [Updated] (YARN-9319) YARN-9060 does not compile

2019-02-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9319: --- Attachment: YARN-9319-trunk.001.patch > YARN-9060 does not compile > -- > >

[jira] [Commented] (YARN-9319) YARN-9060 does not compile

2019-02-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774212#comment-16774212 ] Zhankun Tang commented on YARN-9319: [~jojochuang] , it's caused by a compiler inconsi

[jira] [Comment Edited] (YARN-9319) YARN-9060 does not compile

2019-02-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774212#comment-16774212 ] Zhankun Tang edited comment on YARN-9319 at 2/21/19 3:52 PM: -

[jira] [Comment Edited] (YARN-9319) YARN-9060 does not compile

2019-02-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774212#comment-16774212 ] Zhankun Tang edited comment on YARN-9319 at 2/21/19 3:52 PM: -

[jira] [Commented] (YARN-9156) [YARN-8851] Improve debug message in device plugin method compatibility check of ResourcePluginManager

2019-02-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774684#comment-16774684 ] Zhankun Tang commented on YARN-9156: [~cheersyang] , could you please help to review t

[jira] [Updated] (YARN-8891) Documentation of the pluggable device framework

2019-02-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8891: --- Attachment: YARN-8891-trunk.004.patch > Documentation of the pluggable device framework >

[jira] [Updated] (YARN-8891) Documentation of the pluggable device framework

2019-02-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8891: --- Attachment: YARN-8891-trunk.005.patch > Documentation of the pluggable device framework >

[jira] [Updated] (YARN-8891) Documentation of the pluggable device framework

2019-02-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8891: --- Attachment: YARN-8891-trunk.006.patch > Documentation of the pluggable device framework >

[jira] [Updated] (YARN-8891) Documentation of the pluggable device framework

2019-02-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8891: --- Attachment: YARN-8891-trunk.007.patch > Documentation of the pluggable device framework >

[jira] [Commented] (YARN-8891) Documentation of the pluggable device framework

2019-02-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16774833#comment-16774833 ] Zhankun Tang commented on YARN-8891: [~sunilg] , All great suggestions. Thanks a lot!

[jira] [Commented] (YARN-8891) Documentation of the pluggable device framework

2019-02-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775067#comment-16775067 ] Zhankun Tang commented on YARN-8891: [~sunilg] , the Jenkins result is ok too. Could y

[jira] [Commented] (YARN-8821) [YARN-8851] GPU hierarchy/topology scheduling support based on pluggable device framework

2019-02-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776288#comment-16776288 ] Zhankun Tang commented on YARN-8821: [~sunilg] , [~Weiwei Yang] , Thanks for the revie

[jira] [Commented] (YARN-9121) Users of GpuDiscoverer.getInstance() are not possible to test as instance is a static field

2019-02-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776499#comment-16776499 ] Zhankun Tang commented on YARN-9121: [~snemeth] , thanks for the patch. Looks good to

[jira] [Created] (YARN-9331) Fix a bug that lacking cgroup initialization when bootstrap DeviceResourceHandlerImpl

2019-02-25 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-9331: -- Summary: Fix a bug that lacking cgroup initialization when bootstrap DeviceResourceHandlerImpl Key: YARN-9331 URL: https://issues.apache.org/jira/browse/YARN-9331 Project

[jira] [Updated] (YARN-9331) Fix a bug that lacking cgroup initialization when bootstrap DeviceResourceHandlerImpl

2019-02-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9331: --- Attachment: YARN-9331-trunk.001.patch > Fix a bug that lacking cgroup initialization when bootstrap >

[jira] [Updated] (YARN-9331) [YARN-8851] Fix a bug that lacking cgroup initialization when bootstrap DeviceResourceHandlerImpl

2019-02-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9331: --- Summary: [YARN-8851] Fix a bug that lacking cgroup initialization when bootstrap DeviceResourceHandler

[jira] [Commented] (YARN-9331) [YARN-8851] Fix a bug that lacking cgroup initialization when bootstrap DeviceResourceHandlerImpl

2019-02-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16777491#comment-16777491 ] Zhankun Tang commented on YARN-9331: [~cheersyang], Thanks a lot! > [YARN-8851] Fix a

[jira] [Resolved] (YARN-8890) Port existing GPU module into pluggable device framework

2019-03-06 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-8890. Resolution: Duplicate Since we have a sample Nvidia GPU plugin merged in YARN-9060. Need not to do

[jira] [Commented] (YARN-9266) Various fixes are needed in IntelFpgaOpenclPlugin

2019-03-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789410#comment-16789410 ] Zhankun Tang commented on YARN-9266: [~pbacsko] , Thanks for the patch! It looks good

[jira] [Commented] (YARN-9267) Various fixes are needed in FpgaResourceHandlerImpl

2019-03-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789414#comment-16789414 ] Zhankun Tang commented on YARN-9267: [~pbacsko] , Thanks for the patch. Looks good to

[jira] [Comment Edited] (YARN-9266) Various fixes are needed in IntelFpgaOpenclPlugin

2019-03-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789410#comment-16789410 ] Zhankun Tang edited comment on YARN-9266 at 3/11/19 11:02 AM: --

[jira] [Created] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

2019-04-08 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-9464: -- Summary: Support "Pending Resource" metrics in RM's RESTful API Key: YARN-9464 URL: https://issues.apache.org/jira/browse/YARN-9464 Project: Hadoop YARN Issue Ty

[jira] [Updated] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

2019-04-08 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9464: --- Description: Knowing only the "available", "used" resource is not enough for YARN management tools li

[jira] [Commented] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

2019-04-08 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16813038#comment-16813038 ] Zhankun Tang commented on YARN-9464: [~Prabhu Joseph] , Sure. Thanks for taking this.

[jira] [Created] (YARN-9473) [Umbrella] Support Vector Engine ( a new acceleration hardware) based on pluggable device framework

2019-04-11 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-9473: -- Summary: [Umbrella] Support Vector Engine ( a new acceleration hardware) based on pluggable device framework Key: YARN-9473 URL: https://issues.apache.org/jira/browse/YARN-9473

[jira] [Updated] (YARN-9473) [Umbrella] Support Vector Engine ( a new accelerator hardware) based on pluggable device framework

2019-04-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9473: --- Summary: [Umbrella] Support Vector Engine ( a new accelerator hardware) based on pluggable device fram

[jira] [Commented] (YARN-9475) Create basic VE plugin

2019-04-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821750#comment-16821750 ] Zhankun Tang commented on YARN-9475: [~sunilg] Thanks for the review. It looks good to

[jira] [Commented] (YARN-9475) Create basic VE plugin

2019-04-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823878#comment-16823878 ] Zhankun Tang commented on YARN-9475: [~pbacsko], [~sunilg]. Thanks. Make sense to me.

[jira] [Updated] (YARN-9475) Create basic VE plugin

2019-04-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9475: --- Labels: 3.3.0 (was: ) > Create basic VE plugin > -- > > Key: YARN

[jira] [Commented] (YARN-9476) Create unit tests for VE plugin

2019-04-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16829917#comment-16829917 ] Zhankun Tang commented on YARN-9476: [~snemeth] Thanks for the review! [~pbacsko] Than

[jira] [Commented] (YARN-9584) Should put initializeProcessTrees method call before get pid

2019-05-27 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848838#comment-16848838 ] Zhankun Tang commented on YARN-9584: [~jiwq], thanks for reporting this. It looks good

[jira] [Commented] (YARN-9584) Should put initializeProcessTrees method call before get pid

2019-05-27 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849295#comment-16849295 ] Zhankun Tang commented on YARN-9584: [~jiwq], does it cost much effort to do refactori

[jira] [Updated] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

2019-05-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9033: --- Attachment: YARN-9033-branch-3.2.001.patch > ResourceHandlerChain#bootstrap is invoked twice during NM

[jira] [Commented] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

2019-05-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16852717#comment-16852717 ] Zhankun Tang commented on YARN-9033: [~sunilg], this Jira is needed for branch-3.2 but

[jira] [Commented] (YARN-9595) FPGA plugin: NullPointerException in FpgaNodeResourceUpdateHandler.updateConfiguredResource()

2019-06-03 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855228#comment-16855228 ] Zhankun Tang commented on YARN-9595: Thanks, Peter! LGTM. +1. Committing shortly. > F

[jira] [Commented] (YARN-9612) Support using ip to register NodeID

2019-06-10 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16859883#comment-16859883 ] Zhankun Tang commented on YARN-9612: [~cane], thanks for mentioning this. Per my under

[jira] [Commented] (YARN-9612) Support using ip to register NodeID

2019-06-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861773#comment-16861773 ] Zhankun Tang commented on YARN-9612: [~cane], Thanks. But maybe I don't have much cont

[jira] [Commented] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861943#comment-16861943 ] Zhankun Tang commented on YARN-9608: Thanks for the patch! [~abmodi]. I took a glance

[jira] [Comment Edited] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861943#comment-16861943 ] Zhankun Tang edited comment on YARN-9608 at 6/12/19 10:17 AM: --

[jira] [Comment Edited] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861943#comment-16861943 ] Zhankun Tang edited comment on YARN-9608 at 6/12/19 10:24 AM: --

[jira] [Commented] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862789#comment-16862789 ] Zhankun Tang commented on YARN-9608: [~abmodi], Thanks. Just read through the whole pa

[jira] [Commented] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862826#comment-16862826 ] Zhankun Tang commented on YARN-9608: [~abmodi], Yeah. Thanks for the explanation! +1 f

[jira] [Commented] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865389#comment-16865389 ] Zhankun Tang commented on YARN-9608: [~abmodi], Sure. Will commit it soon. > Decommis

[jira] [Commented] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865479#comment-16865479 ] Zhankun Tang commented on YARN-9608: [~abmodi], thanks for the patch. Committed to tru

[jira] [Updated] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9608: --- Fix Version/s: 3.3.0 > DecommissioningNodesWatcher should get lists of running applications on node >

[jira] [Commented] (YARN-9584) Should put initializeProcessTrees method call before get pid

2019-06-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866214#comment-16866214 ] Zhankun Tang commented on YARN-9584: [~jiwq], sorry for the delay. Will commit this so

[jira] [Updated] (YARN-9584) Should put initializeProcessTrees method call before get pid

2019-06-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9584: --- Fix Version/s: 3.3.0 > Should put initializeProcessTrees method call before get pid >

<    1   2   3   4   5   6   7   8   9   10   >