[jira] [Commented] (YARN-8126) [Follow up] Support auto-spawning of admin configured services during bootstrap of rm

2018-04-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433482#comment-16433482 ] Rohith Sharma K S commented on YARN-8126: - It make sense to me to add new section t

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.004.patch > Resource leak when async scheduling is enabled >

[jira] [Commented] (YARN-8104) Add API to fetch node to attribute mapping

2018-04-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433451#comment-16433451 ] Bibin A Chundatt commented on YARN-8104: Thank you [~Naganarasimha] for review {

[jira] [Updated] (YARN-8104) Add API to fetch node to attribute mapping

2018-04-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8104: --- Attachment: YARN-8104-YARN-3409.004.patch > Add API to fetch node to attribute mapping > --

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433446#comment-16433446 ] genericqa commented on YARN-8127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433441#comment-16433441 ] genericqa commented on YARN-8127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8142) yarn service application stops when AM is killed with SIGTERM

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433405#comment-16433405 ] Eric Yang commented on YARN-8142: - [~cheersyang] If AM is hanging, then it is unlikely to g

[jira] [Commented] (YARN-7402) Federation V2: Global Optimizations

2018-04-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433404#comment-16433404 ] Wangda Tan commented on YARN-7402: -- [~curino] / [~subru], thanks for working on this impro

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.003.patch > Resource leak when async scheduling is enabled >

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: (was: YARN-8127.003.patch) > Resource leak when async scheduling is enabled > -

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.003.patch > Resource leak when async scheduling is enabled >

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: (was: YARN-8127.003.patch) > Resource leak when async scheduling is enabled > -

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433384#comment-16433384 ] genericqa commented on YARN-8127: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-7142) Support placement policy in yarn native services

2018-04-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433376#comment-16433376 ] Weiwei Yang commented on YARN-7142: --- Hi [~leftnoteasy]/[~gsaha] Is the patch for 3.1 bra

[jira] [Commented] (YARN-7941) Transitive dependencies for component are not resolved

2018-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433373#comment-16433373 ] Hudson commented on YARN-7941: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1396

[jira] [Comment Edited] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433368#comment-16433368 ] Tao Yang edited comment on YARN-8127 at 4/11/18 4:00 AM: - Thanks [~

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433368#comment-16433368 ] Tao Yang commented on YARN-8127: Attached v3 patch to simplify the check logic. > Resource

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.003.patch > Resource leak when async scheduling is enabled >

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433367#comment-16433367 ] Weiwei Yang commented on YARN-8127: --- Hi [~Tao Yang] Thanks for the patch, while reading

[jira] [Commented] (YARN-8138) No containers pre-empted from another queue when using node labels

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433362#comment-16433362 ] genericqa commented on YARN-8138: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7941) Transitive dependencies for component are not resolved

2018-04-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433360#comment-16433360 ] Rohith Sharma K S commented on YARN-7941: - committing shortly > Transitive depende

[jira] [Commented] (YARN-8142) yarn service application stops when AM is killed with SIGTERM

2018-04-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433340#comment-16433340 ] Weiwei Yang commented on YARN-8142: --- I am thinking another scenario, what if an app's AM

[jira] [Commented] (YARN-8143) Improve log message when Capacity Scheduler request allocation on node

2018-04-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1646#comment-1646 ] Weiwei Yang commented on YARN-8143: --- Hi [~Zian Chen] Thanks for filing this ticket. Any

[jira] [Updated] (YARN-8143) Improve log message when Capacity Scheduler request allocation on node

2018-04-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8143: -- Priority: Minor (was: Critical) > Improve log message when Capacity Scheduler request allocation on node

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433317#comment-16433317 ] Tao Yang commented on YARN-8127: Attached v2 patch to fix UT and the check-style error > R

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.002.patch > Resource leak when async scheduling is enabled >

[jira] [Commented] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens

2018-04-10 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433277#comment-16433277 ] Chun Chen commented on YARN-2674: - [~shaneku...@gmail.com] Please catch on the work here. I

[jira] [Commented] (YARN-8138) No containers pre-empted from another queue when using node labels

2018-04-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433270#comment-16433270 ] Zian Chen commented on YARN-8138: - Upload a patch to add new UT to TestCapacitySchedulerSur

[jira] [Updated] (YARN-8138) No containers pre-empted from another queue when using node labels

2018-04-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8138: Attachment: YARN-8138.001.patch > No containers pre-empted from another queue when using node labels > --

[jira] [Commented] (YARN-8138) No containers pre-empted from another queue when using node labels

2018-04-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433269#comment-16433269 ] Zian Chen commented on YARN-8138: - Investigated this issue and wrote a UT to reproduce it.

[jira] [Updated] (YARN-8142) yarn service application stops when AM is killed with SIGTERM

2018-04-10 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8142: - Target Version/s: 3.2.0, 3.1.1 > yarn service application stops when AM is killed with SIGTERM > --

[jira] [Updated] (YARN-8060) Create default readiness check for service components

2018-04-10 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8060: - Target Version/s: 3.2.0, 3.1.1 (was: 3.2.0) > Create default readiness check for service component

[jira] [Updated] (YARN-7941) Transitive dependencies for component are not resolved

2018-04-10 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7941: - Target Version/s: 3.2.0, 3.1.1 > Transitive dependencies for component are not resolved >

[jira] [Commented] (YARN-8116) Nodemanager fails with NumberFormatException: For input string: ""

2018-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433249#comment-16433249 ] Hudson commented on YARN-8116: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1396

[jira] [Commented] (YARN-8133) Doc link broken for yarn-service from overview page.

2018-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433250#comment-16433250 ] Hudson commented on YARN-8133: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1396

[jira] [Created] (YARN-8143) Improve log message when Capacity Scheduler request allocation on node

2018-04-10 Thread Zian Chen (JIRA)
Zian Chen created YARN-8143: --- Summary: Improve log message when Capacity Scheduler request allocation on node Key: YARN-8143 URL: https://issues.apache.org/jira/browse/YARN-8143 Project: Hadoop YARN

[jira] [Updated] (YARN-8133) Doc link broken for yarn-service from overview page.

2018-04-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8133: - Fix Version/s: 3.2.0 > Doc link broken for yarn-service from overview page. > -

[jira] [Comment Edited] (YARN-8133) Doc link broken for yarn-service from overview page.

2018-04-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433225#comment-16433225 ] Gour Saha edited comment on YARN-8133 at 4/11/18 12:28 AM: --- Thank

[jira] [Commented] (YARN-8133) Doc link broken for yarn-service from overview page.

2018-04-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433225#comment-16433225 ] Gour Saha commented on YARN-8133: - Thanks [~rohithsharma]. 002 patch looks good. +1 for com

[jira] [Assigned] (YARN-8140) Improve log message when launch cmd is ran for stopped yarn service

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-8140: --- Assignee: Eric Yang > Improve log message when launch cmd is ran for stopped yarn service > --

[jira] [Comment Edited] (YARN-8142) yarn service application stops when AM is killed with SIGTERM

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433210#comment-16433210 ] Eric Yang edited comment on YARN-8142 at 4/11/18 12:07 AM: --- In Un

[jira] [Commented] (YARN-8142) yarn service application stops when AM is killed with SIGTERM

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433210#comment-16433210 ] Eric Yang commented on YARN-8142: - In Unix terms, SIGTERM is used for terminating applicati

[jira] [Commented] (YARN-8126) [Follow up] Support auto-spawning of admin configured services during bootstrap of rm

2018-04-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433208#comment-16433208 ] Gour Saha commented on YARN-8126: - I think this deserves to be a new sub-topic "System Serv

[jira] [Commented] (YARN-7984) Delete registry entries from ZK on ServiceClient stop and clean up stop/destroy behavior

2018-04-10 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433207#comment-16433207 ] Billie Rinaldi commented on YARN-7984: -- Thanks, [~eyang]! I plan to cherry-pick this t

[jira] [Commented] (YARN-8104) Add API to fetch node to attribute mapping

2018-04-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433193#comment-16433193 ] Naganarasimha G R commented on YARN-8104: - Thanks for the patch [~bibinchundatt] A

[jira] [Commented] (YARN-7973) Support ContainerRelaunch for Docker containers

2018-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433188#comment-16433188 ] Hudson commented on YARN-7973: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1396

[jira] [Commented] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-04-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433185#comment-16433185 ] Jian He commented on YARN-7781: --- sure, go ahead. thanks > Update YARN-Services-Examples.md t

[jira] [Assigned] (YARN-8142) yarn service application stops when AM is killed with SIGTERM

2018-04-10 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-8142: Assignee: Billie Rinaldi > yarn service application stops when AM is killed with SIGTERM > -

[jira] [Updated] (YARN-7984) Delete registry entries from ZK on ServiceClient stop and clean up stop/destroy behavior

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7984: Fix Version/s: 3.2.0 > Delete registry entries from ZK on ServiceClient stop and clean up > stop/destroy beh

[jira] [Updated] (YARN-7973) Support ContainerRelaunch for Docker containers

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7973: Fix Version/s: 3.2.0 > Support ContainerRelaunch for Docker containers >

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433162#comment-16433162 ] Eric Yang commented on YARN-7221: - TestContainerSchedulerQueuing unit test failure is not r

[jira] [Commented] (YARN-7189) Container-executor doesn't remove Docker containers that error out early

2018-04-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433137#comment-16433137 ] Eric Badger commented on YARN-7189: --- Attaching first patch to fix this issue. There is a

[jira] [Updated] (YARN-7189) Container-executor doesn't remove Docker containers that error out early

2018-04-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7189: -- Attachment: YARN-7189-b3.0.001.patch > Container-executor doesn't remove Docker containers that error out

[jira] [Updated] (YARN-8142) yarn service application stops when AM is killed with SIGTERM

2018-04-10 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8142: - Summary: yarn service application stops when AM is killed with SIGTERM (was: yarn service application stop

[jira] [Created] (YARN-8142) yarn service application stops when AM is killed

2018-04-10 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-8142: Summary: yarn service application stops when AM is killed Key: YARN-8142 URL: https://issues.apache.org/jira/browse/YARN-8142 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-8142) yarn service application stops when AM is killed

2018-04-10 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8142: - Description: Steps: 1) Launch sleeper job ( non-docker yarn service) {code} RUNNING: /usr/hdp/current/ha

[jira] [Commented] (YARN-8140) Improve log message when launch cmd is ran for stopped yarn service

2018-04-10 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433093#comment-16433093 ] Yesha Vora commented on YARN-8140: -- yes [~eyang] this message sounds good. > Improve log

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

2018-04-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433090#comment-16433090 ] Eric Payne commented on YARN-4781: -- bq. Hence in case we use sizeBasedWeight, we are consi

[jira] [Commented] (YARN-8140) Improve log message when launch cmd is ran for stopped yarn service

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433083#comment-16433083 ] Eric Yang commented on YARN-8140: - [~yeshavora] This is because the application has not bee

[jira] [Comment Edited] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-04-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433081#comment-16433081 ] Shane Kumpf edited comment on YARN-8141 at 4/10/18 10:19 PM: - T

[jira] [Commented] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-04-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433081#comment-16433081 ] Shane Kumpf commented on YARN-8141: --- Thanks for reporting this, [~leftnoteasy] - {{YARN_

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433080#comment-16433080 ] genericqa commented on YARN-7221: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433071#comment-16433071 ] Eric Yang commented on YARN-7530: - [~leftnoteasy] YARN service have dependency setup backwa

[jira] [Commented] (YARN-7974) Allow updating application tracking url after registration

2018-04-10 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433067#comment-16433067 ] Jonathan Hung commented on YARN-7974: - Thanks for the comments, For 1 I think this is

[jira] [Commented] (YARN-7984) Delete registry entries from ZK on ServiceClient stop and clean up stop/destroy behavior

2018-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433062#comment-16433062 ] Hudson commented on YARN-7984: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1395

[jira] [Created] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-04-10 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8141: Summary: YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec Key: YARN-8141 URL: https://issues.apache.org/jira/browse/YARN-8141

[jira] [Commented] (YARN-8037) CGroupsResourceCalculator logs excessive warnings on container relaunch

2018-04-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433049#comment-16433049 ] Shane Kumpf commented on YARN-8037: --- Thanks [~miklos.szeg...@cloudera.com] - For most app

[jira] [Updated] (YARN-8140) Improve log message when launch cmd is ran for stopped yarn service

2018-04-10 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8140: - Description: Steps:  1) Launch sleeper app {code} RUNNING: /usr/hdp/current/hadoop-yarn-client/bin/yarn

[jira] [Created] (YARN-8140) Improve log message when launch cmd is ran for stopped yarn service

2018-04-10 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-8140: Summary: Improve log message when launch cmd is ran for stopped yarn service Key: YARN-8140 URL: https://issues.apache.org/jira/browse/YARN-8140 Project: Hadoop YARN

[jira] [Commented] (YARN-7984) Delete registry entries from ZK on ServiceClient stop and clean up stop/destroy behavior

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433038#comment-16433038 ] Eric Yang commented on YARN-7984: - [~billie.rinaldi] +1 to commit. Patch 2 looks good to me

[jira] [Assigned] (YARN-6925) FSSchedulerNode could be simplified extracting preemption fields into a class

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-6925: -- Assignee: (was: Yufei Gu) > FSSchedulerNode could be simplified extracting preemption fields into a

[jira] [Assigned] (YARN-6971) Clean up different ways to create resources

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-6971: -- Assignee: (was: Yufei Gu) > Clean up different ways to create resources > --

[jira] [Assigned] (YARN-6941) Allow Queue placement policies to be ordered by attribute

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-6941: -- Assignee: (was: Yufei Gu) > Allow Queue placement policies to be ordered by attribute >

[jira] [Assigned] (YARN-3797) NodeManager not blacklisting the disk (shuffle) with errors

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-3797: -- Assignee: (was: Yufei Gu) > NodeManager not blacklisting the disk (shuffle) with errors > --

[jira] [Assigned] (YARN-3890) FairScheduler should show the scheduler health metrics similar to ones added in CapacityScheduler

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-3890: -- Assignee: Gergo Repas (was: Yufei Gu) > FairScheduler should show the scheduler health metrics similar

[jira] [Assigned] (YARN-5824) Verify app starvation under custom preemption thresholds and timeouts

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-5824: -- Assignee: (was: Yufei Gu) > Verify app starvation under custom preemption thresholds and timeouts >

[jira] [Assigned] (YARN-6324) The log4j.properties in sample-conf doesn't work well for SLS

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-6324: -- Assignee: (was: Yufei Gu) > The log4j.properties in sample-conf doesn't work well for SLS >

[jira] [Assigned] (YARN-7347) Fixe the bug in Fair scheduler to handle a queue named "root.root"

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-7347: -- Assignee: Gergo Repas (was: Yufei Gu) > Fixe the bug in Fair scheduler to handle a queue named "root.ro

[jira] [Assigned] (YARN-7948) Enable refreshing maximum allocation for multiple resource types

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-7948: -- Assignee: Szilard Nemeth (was: Yufei Gu) > Enable refreshing maximum allocation for multiple resource t

[jira] [Resolved] (YARN-7968) Reset the queue name in submission context while recovering an application

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-7968. Resolution: Won't Fix > Reset the queue name in submission context while recovering an application >

[jira] [Assigned] (YARN-7263) Check host name resolution performance when resource manager starts up

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-7263: -- Assignee: (was: Yufei Gu) > Check host name resolution performance when resource manager starts up >

[jira] [Assigned] (YARN-6527) Provide a better out-of-the-box experience for SLS

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-6527: -- Assignee: (was: Yufei Gu) > Provide a better out-of-the-box experience for SLS > ---

[jira] [Assigned] (YARN-8061) An application may preempt itself in case of minshare preemption

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-8061: -- Assignee: (was: Yufei Gu) > An application may preempt itself in case of minshare preemption > -

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-04-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432970#comment-16432970 ] Wangda Tan commented on YARN-7494: -- Thanks [~sunilg],  In general change looks good. Coul

[jira] [Commented] (YARN-8116) Nodemanager fails with NumberFormatException: For input string: ""

2018-04-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432938#comment-16432938 ] Wangda Tan commented on YARN-8116: -- +1, thanks [~csingh], will commit shortly. > Nodemana

[jira] [Updated] (YARN-7221) Add security check for privileged docker container

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7221: Attachment: YARN-7221.022.patch > Add security check for privileged docker container > --

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432936#comment-16432936 ] Eric Yang commented on YARN-7221: - Patch 22 rebased to current trunk. > Add security check

[jira] [Commented] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-04-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432934#comment-16432934 ] Wangda Tan commented on YARN-7530: -- [~eyang], thanks for sharing ur thoughts. To me, for

[jira] [Commented] (YARN-7974) Allow updating application tracking url after registration

2018-04-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432922#comment-16432922 ] Wangda Tan commented on YARN-7974: -- [~jhung], Thanks for working on the feature, I can se

[jira] [Commented] (YARN-7974) Allow updating application tracking url after registration

2018-04-10 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432900#comment-16432900 ] Jonathan Hung commented on YARN-7974: - Hi [~wangda] - this is the tracking url change I

[jira] [Commented] (YARN-8130) Race condition when container events are published for KILLED applications

2018-04-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432723#comment-16432723 ] Vrushali C commented on YARN-8130: -- Yes, I agree, we need a configurable delay like the co

[jira] [Commented] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432732#comment-16432732 ] genericqa commented on YARN-7598: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7825) Maintain constant horizontal application info bar for all pages

2018-04-10 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-7825: - Attachment: Screen Shot 2018-04-10 at 11.06.40 AM.png Screen Shot 2018-04-10 at 11.07.29 AM.

[jira] [Commented] (YARN-8073) TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration

2018-04-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432710#comment-16432710 ] Vrushali C commented on YARN-8073: -- Hi [~rohithsharma] Yes, please go ahead with cherry p

[jira] [Commented] (YARN-7931) [atsv2 read acls] Include domain table creation as part of schema creator

2018-04-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432688#comment-16432688 ] Vrushali C commented on YARN-7931: -- Hi [~haibochen] That's a good question. Let me check

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432629#comment-16432629 ] genericqa commented on YARN-8127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2018-04-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432601#comment-16432601 ] Xuan Gong commented on YARN-7598: - Thanks for the review. [~djp] Uploaded a new patch to a

[jira] [Updated] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2018-04-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7598: Attachment: YARN-7598.4.patch > Document how to use classpath isolation for aux-services in YARN > --

[jira] [Commented] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens

2018-04-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432589#comment-16432589 ] Shane Kumpf commented on YARN-2674: --- [~chenchun] - Thanks for the patch here. We are seei

[jira] [Commented] (YARN-8134) Support specifying node resources in SLS

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432542#comment-16432542 ] genericqa commented on YARN-8134: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

  1   2   >