[jira] [Commented] (YARN-8975) [Submarine] Use predefined Charset object StandardCharsets.UTF_8 instead of String "UTF-8"

[ https://issues.apache.org/jira/browse/YARN-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681012#comment-16681012 ] Hadoop QA commented on YARN-8975: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681002#comment-16681002 ] Weiwei Yang commented on YARN-8902: --- v9 patch uploaded, [~sunilg], pls take a look. Thanks > Add volume

[jira] [Updated] (YARN-8902) Add volume manager that manages CSI volume lifecycle

[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8902: -- Attachment: YARN-8902.009.patch > Add volume manager that manages CSI volume lifecycle >

[jira] [Updated] (YARN-8999) [Submarine] Remove redundant local variables

[ https://issues.apache.org/jira/browse/YARN-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8999: --- Attachment: YARN-8999-trunk-001.patch > [Submarine] Remove redundant local variables >

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680998#comment-16680998 ] Weiwei Yang commented on YARN-8902: --- Hi [~sunilg] Pls see my response below, {quote}Could we send

[jira] [Updated] (YARN-8998) [Submarine] Simplify the condition check in CliUtils#argsForHelp

[ https://issues.apache.org/jira/browse/YARN-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8998: --- Summary: [Submarine] Simplify the condition check in CliUtils#argsForHelp (was: Simplify the

[jira] [Created] (YARN-8999) [Submarine] Remove redundant local variables

Zhankun Tang created YARN-8999: -- Summary: [Submarine] Remove redundant local variables Key: YARN-8999 URL: https://issues.apache.org/jira/browse/YARN-8999 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680991#comment-16680991 ] Hadoop QA commented on YARN-8984: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8998) Simplify the condition check in CliUtils#argsForHelp

[ https://issues.apache.org/jira/browse/YARN-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8998: --- Attachment: YARN-8998-trunk-001.patch > Simplify the condition check in CliUtils#argsForHelp >

[jira] [Created] (YARN-8998) Simplify the condition check in CliUtils#argsForHelp

Zhankun Tang created YARN-8998: -- Summary: Simplify the condition check in CliUtils#argsForHelp Key: YARN-8998 URL: https://issues.apache.org/jira/browse/YARN-8998 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8619) Automate docker network configuration through YARN API

[ https://issues.apache.org/jira/browse/YARN-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680987#comment-16680987 ] Keqiu Hu commented on YARN-8619: Is our plan to integrate Consul into YARN for this automation? >

[jira] [Updated] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-8995: Summary: Log the event type of the too big AsyncDispatcher event queue size, and add the information to the

[jira] [Updated] (YARN-8997) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8997: --- Attachment: YARN-8997-trunk-001.patch > [Submarine] Simplify the logic in

[jira] [Updated] (YARN-8997) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8997: --- Description: In YarnServiceJobSubmitter#needHdfs. Below code can be simplified to just one line.

[jira] [Updated] (YARN-8997) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8997: --- Environment: (was: In YarnServiceJobSubmitter#needHdfs. Below code can be simplified to just one

[jira] [Created] (YARN-8997) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

Zhankun Tang created YARN-8997: -- Summary: [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs Key: YARN-8997 URL: https://issues.apache.org/jira/browse/YARN-8997 Project: Hadoop YARN

[jira] [Created] (YARN-8996) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

Zhankun Tang created YARN-8996: -- Summary: [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs Key: YARN-8996 URL: https://issues.apache.org/jira/browse/YARN-8996 Project: Hadoop YARN

[jira] [Commented] (YARN-8968) [Submarine] Support for executing tensorflow algorithm files on hdfs

[ https://issues.apache.org/jira/browse/YARN-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680977#comment-16680977 ] Zhankun Tang commented on YARN-8968: [~liuxun323] , Is this related to YARN-8714? > [Submarine]

[jira] [Commented] (YARN-8975) Use predefined Charset object StandardCharsets.UTF_8 instead of String "UTF-8"

[ https://issues.apache.org/jira/browse/YARN-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680966#comment-16680966 ] Zhankun Tang commented on YARN-8975: [~ajisakaa] , Yeah. Thanks for pointing out. Fix that in v2

[jira] [Updated] (YARN-8975) [Submarine] Use predefined Charset object StandardCharsets.UTF_8 instead of String "UTF-8"

[ https://issues.apache.org/jira/browse/YARN-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8975: --- Summary: [Submarine] Use predefined Charset object StandardCharsets.UTF_8 instead of String "UTF-8"

[jira] [Updated] (YARN-8995) Log the event type of the too big event queue size, and add the information to the metrics.

[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-8995: Description: In our growing cluster，there are unexpected situations that cause some event queues to block the

[jira] [Updated] (YARN-8975) Use predefined Charset object StandardCharsets.UTF_8 instead of String "UTF-8"

[ https://issues.apache.org/jira/browse/YARN-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8975: --- Attachment: YARN-8975-trunk.002.patch > Use predefined Charset object StandardCharsets.UTF_8 instead

[jira] [Created] (YARN-8995) Log the event type of the too big event queue size, and add the information to the metrics.

zhuqi created YARN-8995: --- Summary: Log the event type of the too big event queue size, and add the information to the metrics. Key: YARN-8995 URL: https://issues.apache.org/jira/browse/YARN-8995 Project:

[jira] [Updated] (YARN-8881) Add basic pluggable device plugin framework

[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8881: --- Attachment: YARN-8881-trunk.005.patch > Add basic pluggable device plugin framework >

[jira] [Commented] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680955#comment-16680955 ] Wilfred Spiegelenburg commented on YARN-8992: - [~haibochen] thank you for logging this. I'll

[jira] [Assigned] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-8992: --- Assignee: Wilfred Spiegelenburg > Fair scheduler can delete a dynamic queue

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680950#comment-16680950 ] Weiwei Yang commented on YARN-8902: --- Hi [~sunilg] Pls seem my comments below {quote}In VolumeImpl, we

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680952#comment-16680952 ] Sunil Govindan commented on YARN-8902: -- Few more comments 5. {code:java} try {

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680902#comment-16680902 ] Yang Wang commented on YARN-8984: - [~botong], [~kkaranasos] Thanks for your reply. I have add the null

[jira] [Updated] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-8984: Attachment: YARN-8984-004.patch > AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680897#comment-16680897 ] Hadoop QA commented on YARN-8933: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680892#comment-16680892 ] Zhankun Tang commented on YARN-8714: [~leftnoteasy], {quote}Does it mean the /opt/script.2 on the NM

[jira] [Commented] (YARN-8881) Add basic pluggable device plugin framework

[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680888#comment-16680888 ] Hadoop QA commented on YARN-8881: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680886#comment-16680886 ] Akira Ajisaka commented on YARN-8233: - bq. The infra issue seems resolved. Attaching the patch for

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680881#comment-16680881 ] Bibin A Chundatt commented on YARN-8898: [~subru] Any clarification required?? > Fix

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680848#comment-16680848 ] Sunil Govindan commented on YARN-8902: -- Thanks [~cheersyang]  Few comments. 1. In VolumeImpl, we

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680874#comment-16680874 ] Hadoop QA commented on YARN-8233: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8881) Add basic pluggable device plugin framework

[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8881: --- Attachment: YARN-8881-trunk.004.patch > Add basic pluggable device plugin framework >

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680804#comment-16680804 ] Akira Ajisaka commented on YARN-8233: - The infra issue seems resolved. Attaching the patch for

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Attachment: YARN-8233.001.branch-3.1.patch > NPE in CapacityScheduler#tryCommit when handling

[jira] [Created] (YARN-8994) Fix for race condition in move app and queue cleanup in FS

Wilfred Spiegelenburg created YARN-8994: --- Summary: Fix for race condition in move app and queue cleanup in FS Key: YARN-8994 URL: https://issues.apache.org/jira/browse/YARN-8994 Project: Hadoop

[jira] [Commented] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680725#comment-16680725 ] Wilfred Spiegelenburg commented on YARN-8990: - thank you [~haibochen] for the quick review and

[jira] [Commented] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

[ https://issues.apache.org/jira/browse/YARN-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680688#comment-16680688 ] Keqiu Hu commented on YARN-8983: Great, I'll play around with that, thanks! Is there any plan to put all

[jira] [Commented] (YARN-8987) Usability improvements node-attributes CLI

[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680678#comment-16680678 ] Weiwei Yang commented on YARN-8987: --- cc [~bibinchundatt] > Usability improvements node-attributes CLI >

[jira] [Comment Edited] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

[ https://issues.apache.org/jira/browse/YARN-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680660#comment-16680660 ] Eric Yang edited comment on YARN-8983 at 11/9/18 12:30 AM: ---

[jira] [Commented] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

[ https://issues.apache.org/jira/browse/YARN-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680660#comment-16680660 ] Eric Yang commented on YARN-8983: - [~oliverhuh...@gmail.com] Docker overlay network can work without

[jira] [Commented] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680656#comment-16680656 ] Hudson commented on YARN-8990: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15393 (See

[jira] [Comment Edited] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680649#comment-16680649 ] Tao Yang edited comment on YARN-8233 at 11/9/18 12:24 AM: -- Thanks [~ajisakaa] for

[jira] [Created] (YARN-8993) [Submarine] Add support to run deep learning workload in non-Docker containers

Wangda Tan created YARN-8993: Summary: [Submarine] Add support to run deep learning workload in non-Docker containers Key: YARN-8993 URL: https://issues.apache.org/jira/browse/YARN-8993 Project: Hadoop

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680649#comment-16680649 ] Tao Yang commented on YARN-8233: Thanks [~ajisakaa] for your effort to figure out this failure. Is this

[jira] [Created] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

Haibo Chen created YARN-8992: Summary: Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue Key: YARN-8992 URL: https://issues.apache.org/jira/browse/YARN-8992

[jira] [Updated] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8990: - Summary: Fix fair scheduler race condition in app submit and queue cleanup (was: FS: race condition in

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680632#comment-16680632 ] Tao Yang commented on YARN-8988: Thanks [~cheersyang] for the review and commit. > Reduce the verbose log

[jira] [Commented] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680630#comment-16680630 ] Haibo Chen commented on YARN-8992: -- See [^YARN-8990.002.patch] for the proposed fix included in the

[jira] [Comment Edited] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680630#comment-16680630 ] Haibo Chen edited comment on YARN-8992 at 11/9/18 12:01 AM: See

[jira] [Updated] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8992: - Description: As discovered in YARN-8990, QueueManager can see a leaf queue being empty while

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680628#comment-16680628 ] Haibo Chen commented on YARN-8990: -- Okay. I'll just do that. +1 on 001 patch. Will check it in shortly.

[jira] [Comment Edited] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680622#comment-16680622 ] Botong Huang edited comment on YARN-8933 at 11/8/18 11:53 PM: -- Good

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680623#comment-16680623 ] Wilfred Spiegelenburg commented on YARN-8990: - I think that is a good idea, I have been

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680622#comment-16680622 ] Botong Huang commented on YARN-8933: Good questions, there are several aspects:  # When we try to

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680620#comment-16680620 ] Haibo Chen commented on YARN-8990: -- Another option is to split out the new race condition in a different

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680617#comment-16680617 ] Wangda Tan commented on YARN-8877: -- [~cheersyang], make sense to me. > Extend service spec to allow

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680615#comment-16680615 ] Wangda Tan commented on YARN-8714: -- [~tangzhankun] , I'm still not quite sure about: {code:java}

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680601#comment-16680601 ] Wangda Tan commented on YARN-8960: -- [~yuan_zac] , as we discussed offline, do we still need the service

[jira] [Commented] (YARN-8776) Container Executor change to create stdin/stdout pipeline

[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680579#comment-16680579 ] Hadoop QA commented on YARN-8776: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8135) Hadoop {Submarine} Project: Simple and scalable deployment of deep learning training / serving jobs on Hadoop

[ https://issues.apache.org/jira/browse/YARN-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8135: - Description: Description: *Goals:* - Allow infra engineer / data scientist to run *unmodified*

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680570#comment-16680570 ] Wangda Tan commented on YARN-8763: -- [~sunilg] , I highly suggest reverting this from branch-3.2 if

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680551#comment-16680551 ] Hadoop QA commented on YARN-8990: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680481#comment-16680481 ] Haibo Chen commented on YARN-8990: -- Thanks [~wilfreds] for the patch!  I have taken the liberty to update

[jira] [Commented] (YARN-8776) Container Executor change to create stdin/stdout pipeline

[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680471#comment-16680471 ] Eric Yang commented on YARN-8776: - [~billie.rinaldi] Thans for the review offline. I clean up the debris

[jira] [Comment Edited] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

[ https://issues.apache.org/jira/browse/YARN-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680525#comment-16680525 ] Keqiu Hu edited comment on YARN-8983 at 11/8/18 10:42 PM: -- [~eyang] I took some

[jira] [Commented] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

[ https://issues.apache.org/jira/browse/YARN-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680525#comment-16680525 ] Keqiu Hu commented on YARN-8983: [~eyang] I took some time to go through the docker overlay network, it

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679416#comment-16679416 ] Tao Yang commented on YARN-8925: Attached v4 patch for review. [~cheersyang], pls help to review at your

[jira] [Updated] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8990: - Attachment: YARN-8990.002.patch > FS: race condition in app submit and queue cleanup >

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680005#comment-16680005 ] Szilard Nemeth commented on YARN-8990: -- Hi [~wilfreds]! Thanks for posting this patch! Patch LGTM,

[jira] [Updated] (YARN-8776) Container Executor change to create stdin/stdout pipeline

[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8776: Attachment: YARN-8776.007.patch > Container Executor change to create stdin/stdout pipeline >

[jira] [Updated] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8988: -- Description: When I get distributed node-attributes enabled, RM log is flooded with following logs

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679381#comment-16679381 ] Bibin A Chundatt commented on YARN-8933: Thank you [~botong] for updated patch. Could you

[jira] [Updated] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8988: -- Labels: log (was: ) > Reduce the verbose log on RM heartbeat path when distributed node-attributes >

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679546#comment-16679546 ] Hudson commented on YARN-8988: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15386 (See

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679605#comment-16679605 ] Hadoop QA commented on YARN-8925: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679402#comment-16679402 ] Hadoop QA commented on YARN-8985: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8880) Add configurations for pluggable plugin framework

[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679260#comment-16679260 ] Hadoop QA commented on YARN-8880: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679317#comment-16679317 ] Hadoop QA commented on YARN-8233: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679371#comment-16679371 ] Tao Yang edited comment on YARN-8925 at 11/8/18 7:16 AM: - Thanks [~cheersyang] for

[jira] [Comment Edited] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679381#comment-16679381 ] Bibin A Chundatt edited comment on YARN-8933 at 11/8/18 1:39 PM: - Thank

[jira] [Updated] (YARN-8987) Usability improvements node-attributes CLI

[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8987: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-8766 > Usability improvements

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679093#comment-16679093 ] Hadoop QA commented on YARN-8914: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675623#comment-16675623 ] Botong Huang edited comment on YARN-8933 at 11/8/18 12:25 AM: -- Ah good catch,

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679113#comment-16679113 ] Hadoop QA commented on YARN-8933: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679297#comment-16679297 ] Weiwei Yang edited comment on YARN-8984 at 11/8/18 4:53 AM: Hi [~fly_in_gis]

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Attachment: (was: YARN-8233.001-test-branch-3.1.patch) > NPE in CapacityScheduler#tryCommit

[jira] [Updated] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8988: -- Target Version/s: 3.3.0, 3.2.1 (was: 3.2.0) > Reduce the verbose log on RM heartbeat path when

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679369#comment-16679369 ] Sunil Govindan commented on YARN-8763: -- Hi [~eyang] I am getting errors of undefined refererence

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Attachment: YARN-8233.001-test-branch-3.1.patch > NPE in CapacityScheduler#tryCommit when handling

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680001#comment-16680001 ] Hadoop QA commented on YARN-8990: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679381#comment-16679381 ] Bibin A Chundatt edited comment on YARN-8933 at 11/8/18 1:31 PM: - Thank

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679446#comment-16679446 ] Sunil Govindan commented on YARN-8763: -- Sorry. Apologies. I had some old files in my .m2 repo and

[jira] [Created] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

Weiwei Yang created YARN-8988: - Summary: Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled Key: YARN-8988 URL: https://issues.apache.org/jira/browse/YARN-8988

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Attachment: YARN-8233.001-branch-3.1-test.patch > NPE in CapacityScheduler#tryCommit when handling

  1   2   >